US6453068B1 - Luminance enhancement with overshoot reduction control based on chrominance information - Google Patents

Luminance enhancement with overshoot reduction control based on chrominance information Download PDF

Info

Publication number
US6453068B1
US6453068B1 US09/398,623 US39862399A US6453068B1 US 6453068 B1 US6453068 B1 US 6453068B1 US 39862399 A US39862399 A US 39862399A US 6453068 B1 US6453068 B1 US 6453068B1
Authority
US
United States
Prior art keywords
overshoot
luminance value
digital image
pixel
enhanced
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US09/398,623
Inventor
Xing Li
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xerox Corp
Original Assignee
Xerox Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Assigned to XEROX CORPORATION reassignment XEROX CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LI, XING
Priority to US09/398,623 priority Critical patent/US6453068B1/en
Application filed by Xerox Corp filed Critical Xerox Corp
Assigned to BANK ONE, NA, AS ADMINISTRATIVE AGENT reassignment BANK ONE, NA, AS ADMINISTRATIVE AGENT SECURITY AGREEMENT Assignors: XEROX CORPORATION
Publication of US6453068B1 publication Critical patent/US6453068B1/en
Application granted granted Critical
Assigned to JPMORGAN CHASE BANK, AS COLLATERAL AGENT reassignment JPMORGAN CHASE BANK, AS COLLATERAL AGENT SECURITY AGREEMENT Assignors: XEROX CORPORATION
Assigned to XEROX CORPORATION reassignment XEROX CORPORATION RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: JPMORGAN CHASE BANK, N.A.
Assigned to XEROX CORPORATION reassignment XEROX CORPORATION RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: BANK ONE, NA
Anticipated expiration legal-status Critical
Assigned to XEROX CORPORATION reassignment XEROX CORPORATION RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: JPMORGAN CHASE BANK, N.A. AS SUCCESSOR-IN-INTEREST ADMINISTRATIVE AGENT AND COLLATERAL AGENT TO BANK ONE, N.A.
Assigned to XEROX CORPORATION reassignment XEROX CORPORATION RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: JPMORGAN CHASE BANK, N.A. AS SUCCESSOR-IN-INTEREST ADMINISTRATIVE AGENT AND COLLATERAL AGENT TO JPMORGAN CHASE BANK
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/20Image enhancement or restoration using local operators
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/73Deblurring; Sharpening
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • G06T2207/10008Still image; Photographic image from scanner, fax or copier
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20192Edge enhancement; Edge preservation

Definitions

  • the present invention relates to the digital image processing arts.
  • it relates to enhancement of digital image data, and a method and apparatus for attenuating overshoot in the luminance channel based upon the chrominance channel when edge enhancement operations are performed.
  • the present invention provides a method and apparatus for reducing color shift and ringing due to edge enhancement operations without compromising resulting edge sharpness.
  • a main advantage of digital image reproduction relative to traditional light-lens image reproduction resides in the ability to process the digital image data so as to enhance the appearance of the final output image.
  • digital filtering is often performed to sharpen edges and fine lines for purposes of making an output image more visually appealing.
  • pre-filtering is often performed prior to sub-sampling for purposes of anti-aliasing. Due to limitations of the filtering algorithm, this filtering operation can blur an image.
  • color image reproduction it is a common practice to sub-sample the chrominance information to reduce the number of bits necessary to represent an image. This, too, can result in blurred edges. In either case and others, edge enhancement of the filtered image can be performed to sharpen the final output image.
  • luminance channel overshoot is less important to the appearance of the final output image if it occurs in areas of the image that are less colorful or “neutral,” e.g., in regions of black-and-white text data.
  • no effective method and apparatus have been provided for controlling luminance channel overshoot due to image enhancement operations without compromising edge sharpness.
  • no effective method and apparatus for controlling luminance channel overshoot have been provided wherein the overshoot attenuation is varied depending upon the chrominance of the image data.
  • a new and improved method and apparatus are provided for luminance channel overshoot control in image enhancement operations.
  • a method of digital image processing comprises receiving input digital image data defining a plurality of pixels of an input color digital image, wherein the input digital image data includes at least a luminance value and a chrominance value for each of the pixels of the input image.
  • the input digital image data defining the pixel is enhanced based upon the input digital image data defining neighborhood pixels in a spatial neighborhood established about the pixel to obtain enhanced digital image data defining the pixel, the enhanced digital image data including at least an enhanced luminance value.
  • an overshoot control operation is performed on the enhanced digital image data defining the pixel, wherein the overshoot control operation comprises: (i) determining local maximum and local minimum input luminance values in a spatial neighborhood about the pixel; (ii) comparing the enhanced luminance value of the pixel to the local maximum and local minimum luminance values to determine if the enhanced pixel luminance value is: (a) above the local maximum luminance value by a positive overshoot amount; or, (b) below the local minimum luminance value by a negative overshoot amount; (iii) receiving an input overshoot reduction coefficient; (iv) evaluating the chrominance of the pixel; (v) using the chrominance of the pixel to adjust the input overshoot reduction coefficient so as to obtain a modified overshoot reduction coefficient; (vi) if the enhanced luminance value of the pixel is above the local maximum luminance value, reducing the enhanced luminance value to attenuate the positive overshoo
  • a method of enhancing a color digital image comprises, for each of a plurality of pixels defining the color digital image, modifying a luminance value of a subject pixel in response to an enhancement filtering operation to obtain a modified luminance value for the subject pixel.
  • identifying a local minimum pixel luminance value and a local maximum pixel luminance value Within a neighborhood of pixels spatially near the subject pixel, identifying a local minimum pixel luminance value and a local maximum pixel luminance value.
  • the chroma of the subject pixel is determined and an overshoot reduction coefficient is received.
  • the overshoot reduction coefficient is modified based upon the chroma of the subject pixel to obtain a modified overshoot reduction coefficient, and the modified luminance value is compared to at least one of the local minimum and local maximum luminance values.
  • the modified overshoot reduction coefficient is used to reduce the modified luminance value of the subject pixel by a percentage of the amount by which the modified luminance value exceeds the local maximum luminance value. If the modified luminance value is less than the local minimum luminance value, the modified overshot reduction coefficient is used to increase the modified luminance value of the subject pixel by a percentage of the amount by which the modified luminance value is less than the local minimum luminance value.
  • a digital image processing apparatus comprises means for receiving input digital image data defining a plurality of pixels of an input color digital image, the input digital image data including at least a luminance value and a chrominance value for each of the pixels of the input image.
  • a means adapted for enhancing each of the pixels of the input digital image based upon the input digital image data defining neighborhood pixels in a spatial neighborhood established about each of the pixels to obtain enhanced digital image data defining each of the enhanced pixels is provided, the enhanced digital image data including at least an enhanced luminance value.
  • a means is also provided for performing an overshoot control operation on the enhanced digital image data defining each enhanced pixel, wherein the means for performing an overshoot control operation includes: (i)means for determining local maximum and local minimum input luminance values in a spatial neighborhood about each enhanced pixel; (ii) means for comparing the enhanced luminance value of each enhanced pixel to the local maximum and local minimum luminance values to determine if the enhanced pixel luminance value is: (a) above the local maximum luminance value by a positive overshoot amount; or, (b) below the local minimum luminance value by a negative overshoot amount; (iii) means for receiving an input overshoot reduction coefficient; (iv) means for evaluating the chrominance of the enhanced pixel as defined by the chrominance value; (v) means for using the chrominance of the enhanced pixel to adjust the input overshoot reduction coefficient so as to obtain a modified overshoot reduction coefficient; (vi) means for reducing the enhanced luminance value to attenu
  • a method of processing a digital image includes enhancing a luminance value (L*) of each of a plurality of input pixels (P) to obtain an enhanced luminance value (FIR_OUTPUT) for each pixel.
  • a positive overshoot is associated with a subject pixel of said digital image is identified if the enhanced luminance value (FIR_OUTPUT) of the subject pixel is greater than a local maximum luminance value (LOCAL_MAX) of input pixels (P) in a spatial neighborhood of the subject pixel in the digital image by a positive overshoot amount (OS).
  • a negative overshoot associated with a subject pixel of the digital image is identified if the enhanced luminance value (FIR_OUTPUT) of the subject pixel is less than a local minimum luminance value (LOCAL_MIN) of input pixels (P) in a spatial neighborhood of the subject pixel in the digital image by a negative overshoot amount (OS′).
  • An overshoot reduction coefficient (f) is provided for controlling the amount by which positive or negative overshoot associated with the subject pixel is attenuated.
  • the overshoot reduction coefficient (f) is adjusted according to a chrominance of the subject pixel so that the overshoot reduction coefficient (f) is adjusted to have increasing overshoot attenuation effect as the chrominance of the subject pixel increases.
  • the overshoot reduction coefficient (f) as adjusted based upon the chrominance of the subject pixel, is used to attenuate either the positive or negative overshoot associated with the subject pixel.
  • One advantage of the present invention is the provision of a method and apparatus for luminance channel overshoot control during digital image processing enhancement operations.
  • Another advantage of the present invention resides in the provision of a method and apparatus for controlling luminance channel overshoot resulting from edge enhancement processing wherein color shift and ringing are reduced or minimized without compromising edge sharpness.
  • a further advantage of the present invention is found in the provision of a method and apparatus for reducing luminance channel overshoot using original min/max luminance values from pixels in the neighborhood surrounding a pixel being processed and based upon the chrominance channel values for the pixel being processed.
  • a yet further advantage of the present invention resides in the provision of a method and apparatus for attenuating luminance channel overshoot in edge enhancement operations, wherein the attenuation varies depending upon whether the overshoot is positive or negative.
  • FIG. 1 is a diagrammatic illustration of a digital image processing system formed in accordance with the present invention
  • FIG. 2 is an illustration of a digital image wherein a portion of the digital image is subject to edge enhancement filtering
  • FIG. 3 graphically illustrates luminance channel overshoot and control of same in accordance with the present invention
  • FIG. 4 is a flow chart that illustrates edge enhancement with luminance channel overshoot control in accordance with the present invention
  • FIG. 5 is a block diagram illustrating a luminance channel overshoot apparatus formed in accordance with the present invention.
  • FIG. 6 is a block diagram illustrating the overshoot control unit of the apparatus shown in FIG. 5 as used for controlling luminance channel overshoot in accordance with the present invention
  • FIG. 7 is a block diagram of an apparatus adapted for adjusting a luminance overshoot reduction parameter based upon the chroma of the pixel being processed in accordance with the present invention.
  • FIG. 8 is a flow chart illustrating adjustment of a luminance overshoot reduction parameter based upon the chroma of the pixel being processed in accordance with the present invention.
  • FIG. 1 a digital image processing system 10 formed in accordance with the present invention is shown in FIG. 1 .
  • An image input unit 12 such as a scanner, image storage device, and/or computer image generator derives/delivers digital image data in the form of one or more monochromatic separations, wherein the picture elements or pixels of each separation are defined at a depth of “d” bits per pixel where “d” is an integer.
  • the digital image data is provided in terms of a single monochromatic separation, the image is monochromatic, for example, so called black-and-white image data.
  • a color image results when the data from the separations is combined, for example, red-green-blue (RGB) separations or cyan-magenta-yellow (CMY) separations.
  • RGB red-green-blue
  • CY cyan-magenta-yellow
  • Color digital image data supplied by the image input unit 12 can alternatively be supplied in the form of a luminance-chrominance color space, such as CIELAB or the like, as is well known in the art, and conversion among various color spaces is also contemplated herein.
  • the digital image signals are input from the scanner 12 to an image processing unit 14 wherein digital image processing, such as edge enhancement with luminance channel overshoot control in accordance with the present invention, is performed.
  • the image processing unit 14 may be provided by any suitable electronic computing apparatus such as a programmed general purpose computer, a dedicated electronic circuit, or any other suitable electronic circuit means.
  • the image processing unit 14 outputs processed digital image data in a suitable format to an image output terminal 16 , such as a storage device, a digital printer, and/or a visual display.
  • Suitable apparatus for digital image input and/or output include the XEROX Document Center 265DC digital imaging system, Pixelcraft 7650 Pro Imager Scanner, XEROX DocuTech Production Printing System scanners, the XEROX 5775 digital color copier, the XEROX 5760 and 5765 Majestik digital color copiers, or any other suitable color digital scanner/copier. Regardless of the depth “d” at which each pixel is defined, the location of each pixel in each separation bitmap is also defined, typically in terms of a row “n” and a column “m.”
  • FIG. 2 illustrates a color digital image I as derived by the image input terminal 12 .
  • the image I comprises a plurality of pixels P arranged in m rows and n columns so that each pixel P is uniquely identifiable by a row/column designation mn, e.g., P 22 which represents the pixel P located in the third row and third column.
  • mn row/column designation
  • each pixel P of a color digital image I is defined by several monochromatic gray values or in terms of its luminance and chrominance values depending upon the color space.
  • CIELAB is a perceptual color space wherein color is represented in three dimensions according to a lightness value (represented on the L* axis), a redness-greenness value (represented on the a* axis), and a yellowness-blueness value (represented on the b* axis).
  • the a* and b* chrominance values define first and second chrominance channels for the CIELAB color space.
  • the cross-hatched area F represents a spatial filter as is also well known in the art of digital image processing.
  • the 12 represented filter F is a finite impulse response (FIR) filter that alters the value of a centrally located subject pixel P based upon the original values of all other neighborhood pixels P, i.e., all other pixels P encompassed by the filter F at a given time.
  • FIR finite impulse response
  • the contribution of each neighborhood pixel to the final value of the subject pixel P varies depending upon the weight assigned to that neighborhood pixel according to the particular filtering operation being performed.
  • the filter F is an FIR edge enhancement filter of a size that is 5 pixels by 5 pixels (5 ⁇ 5).
  • the central pixel P 22 is the subject pixel, and the remaining pixels P encompassed by the filter are the neighborhood pixels that will be used to alter the value of the subject pixel P 22 for purposes of edge or other enhancement.
  • the filter F is applied to each pixel P in the image I for image enhancement operations.
  • the FIR filtering operation itself, is conventional and does not form a part of the present invention.
  • any other size/type of FIR or other edge enhancement filter may be used without departing from the overall scope and intent of the present invention.
  • FIG. 3 graphically illustrates luminance channel overshoot in response to FIR or other enhancement filtering and control of same in accordance with the present invention.
  • the solid line represents luminance values of the unfiltered image data I for each pixel P, e.g., in the CIELAB color space, the solid line represents the L* luminance channel. It can be seen that, in an edge region E of the image I, the luminance values change from a higher level to a lower level. However, this, change in luminance values is gradual and the edge region E of the image I is, thus, not well defined or “sharp.” To make the image I more visually appealing, FIR filtering is carried out on the original image I to enhance the edge region E and other edge regions.
  • the transition from a higher luminance to a lower luminance in the edge region of the image I is much steeper indicating a much sharper, enhanced edge region E′.
  • the FIR_OUTPUT luminance value of the pixel P 22 exceeds a local maximum original luminance value LOCAL_MAX of pixels P in a neighborhood about the pixel P 22 by a positive overshoot amount OS.
  • the neighborhood of original luminance values about the pixel P 22 used to identify LOCAL_MAX preferably corresponds to.
  • the neighborhood of the filter F or a subset of same, but may be any other neighborhood in the region of the subject pixel, in this case the pixel P 22 . Accordingly, the luminance of the pixel P 22 has been altered significantly relative to surrounding pixels, and the appearance of the output image may be undesirably altered due to color shift or “fringing” of the pixel P 22 .
  • the FIR filtering operation has caused its luminance value to be reduced from a luminance value L 4 (solid line) to an FIR_OUTPUT value L 6 (broken line).
  • the FIR_OUTPUT luminance value is less than a local minimum luminance value LOCAL_MIN of original image pixels P in the neighborhood of the pixel P rc by a negative overshoot amount OS′.
  • the neighborhood used to locate the local minimum luminance value LOCAL_MIN preferably corresponds to the neighborhood of the FIR filter, itself, or a subset thereof, but may be any other neighborhood in the region of the subject pixel, in this case the pixel P rc .
  • the luminance value of the pixel P rc has also been altered in a manner that will sharpen the edge E but may cause undesired color shift relative to the appearance of the original image I.
  • luminance channel overshoot control in accordance with the present invention attenuates luminance channel overshoot OS,OS′.
  • the phantom line OSC representing the same edge region at E′′ after overshoot control in accordance with the present invention is nearly as steep as the broken line FIR_OUTPUT representing the edge region E′ after FIR edge enhancement.
  • overshoot control in accordance with the present invention attenuates luminance overshoot without significantly compromising edge enhancement or sharpness.
  • luminance channel overshoot control in accordance with the present invention to obtain a final output luminance value OSC for each pixel P based upon an input luminance value FIR_OUTPUT provided after FIR or other edge enhancement operations can be described mathematically by the following:
  • f is programmable luminance overshoot reduction coefficient as noted above.
  • a step or means S 1 receives the digital image data of an original image I.
  • a step or means S 2 enhances the luminance channel image data defining the pixel P using FIR or other edge enhancement filtering.
  • the chrominance information defining the pixels P of the original image I could also be enhanced, but such does not necessarily form a part of the present invention.
  • a suitable method and apparatus for chrominance channel enhancement with overshoot control is described in co-pending and commonly owned U.S. application Ser. No.
  • a step or means S 3 adjusts the overshoot reduction coefficient f based upon the chrominance of the particular pixel P under consideration.
  • luminance channel overshoot is more objectionable when it is associated with more colorful pixels P having high chroma values.
  • luminance channel overshoot associated with less colorful pixels, such as neutral or black-and-white pixels is less objectionable (or even desirable).
  • the step or means S 3 examines the original (non-enhanced) chroma value of the pixel P being processed, and adjusts the overshoot reduction coefficient f accordingly so that pixels P with higher chroma values are subject to greater luminance channel overshoot attenuation than pixels with lower chroma values.
  • a step or means S 4 determines the original (non-enhanced) LOCAL_MIN and LOCAL_MAX luminance values of pixels in a neighborhood about the subject enhanced pixel P.
  • these values LOCAL_MIN,LOCAL_MAX are used to determine the existence of overshoot OS,OS′, and whether the overshoot, if any, is “positive” (above LOCAL_MAX) or “negative” (below LOCAL_MIN).
  • a step or means S 5 determines if the luminance of the enhanced pixel FIR_OUTPUT is greater than LOCAL_MAX and, if so, a step or means S 6 reduces the luminance FIR_OUTPUT of the enhanced pixel P as described above according to the overshoot reduction coefficient f.
  • a step or means S 7 determines if the luminance of the enhanced pixel P is less than LOCAL_MIN and, if so, a step or means S 8 increases the luminance FIR_OUTOUT of the enhanced pixel P as described above according to the overshoot reduction coefficient f.
  • FIGS. 5-7 diagrammatically illustrate one example of an apparatus specifically adapted for performing edge enhancement with luminance channel overshoot control in accordance with the present invention.
  • the apparatus illustrated in FIGS. 5-7 is preferably the image processing unit 14 , programmed or otherwise configured to provide structure and/or operations necessary for the subject invention.
  • Luminance input values such as CIELAB L* values
  • a buffer 40 a buffer 40 .
  • the chrominance values such as CIELAB a* and b* values
  • An FIR edge enhancement filter 42 performs the edge enhancement step S 2 on the luminance L* values
  • a neighborhood min/max detector 44 determines the luminance values for LOCAL_MIN and LOCAL_MAX to perform the operation S 4 .
  • These values LOCAL_MIN,LOCAL_MAX are input from the detector 44 to an overshoot control unit 50 , and the overshoot control unit 50 also includes one or more inputs 52 that receive the chrominance values, such as a* and b* values, for the pixel P being processed.
  • the overshoot control unit 50 performs luminance channel overshoot control in accordance with the present invention, in particular, steps S 3 , and S 5 -S 8 , as appropriate, and supplies the resulting luminance value OSC for each pixel P that is processed as output.
  • an overshoot control unit 50 includes subtractors 52 a , 52 b , sign extractors 5 a , 54 b , a decoder 56 , and a first selector 58 that perform the operations S 4 ,S 5 ,S 7 as appropriate to determine if the luminance value FIR_OUTPUT for an enhanced pixel P is greater than LOCAL_MAX, less than LOCAL_MIN, or between these values.
  • One or more initial values for the overshoot reduction coefficient f are preferably preprogrammed and stored in registers 60 a , 60 b , and a central processing unit CPU of the image processing unit 14 , together with a second selector 62 , causes one of the stored coefficients to be input to a coefficient modifier 64 .
  • the coefficient modifier 64 performs the operation S 3 to adjust the overshoot reduction coefficient f based upon the chrominance of the pixel P being processed.
  • the coefficient modifier 64 receives an initial overshoot reduction coefficient value f and also the chrominance value(s) (such as a* and b* in the CIELAB color space) of the pixel P being processed. Based upon the input chrominance values, the coefficient modifier 64 assesses the chrominance of the pixel P being processed and adjusts the overshoot reduction coefficient f based upon same to calculate a modified overshoot reduction coefficient f.
  • the first selector 58 as controlled by output from the decoder 56 , sends one of the overshoot values OS,OS′ from the subtractors 52 a , 52 b to a multiplier 70 .
  • the multiplier 70 also receives as input the modified overshoot reduction coefficient f from the coefficient modifier 64 , and performs the above-described multiplication of the adjusted overshoot reduction coefficient f with the overshoot values OS,OS′.
  • An adder 72 sums the result supplied by the multiplier 70 with the enhanced luminance value FIR_OUTPUT for the pixel P being processed to complete the overshoot control operations S 6 ,S 8 and obtain the output luminance value OSC.
  • the overshoot control unit 50 preferably includes registers or other means 60 a , 60 b for storing at least two different pre-programmed initial overshoot reduction coefficient values f.
  • the second selector 62 is programmed to select one of these stored coefficient values depending upon whether the overshoot is “positive” (FIR_OUTPUT>LOCAL_MAX) or “negative” (FIR_OUTPUT ⁇ LOCAL_MIN).
  • FIG. 7 is a block diagram illustrating an example of an overshoot reduction coefficient modifier apparatus 64 formed in accordance with the present invention
  • FIG. 8 is a flow-chart corresponding thereto illustrating adjustment of the overshoot reduction coefficient f for each pixel P being processed based upon the chrominance of the pixel.
  • a step or means S 10 determines the chrominance of the pixel.
  • the chrominance determined need not be an exact value, but can be an approximation or simply one or a plurality of discrete chrominance levels.
  • This chrominance value or level is input to a look-up table LUT along with the input overshoot reduction coefficient f by the step or means S 11 .
  • the output from the look-up table LUT is the modified overshoot reduction coefficient f. This, then, is used by the steps/means S 6 ,S 8 as previously described to reduce luminance overshoot in accordance with the present invention.
  • the apparatus illustrated in FIG. 7 implements the following equation that provides a method of approximating chrominance of a pixel P defined in terms of the CIELAB color space:
  • chrominance values such as a* and b* values in the present example, are input to magnitude extractors 80 a , 80 b , respectively, the min/max detector 82 , the division unit 84 and, finally, the look-up table LUT whereby the modified overshoot reduction coefficient is derived for use as noted above.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Image Processing (AREA)

Abstract

A method and apparatus for digital image processing are provided for controlling luminance channel overshoot in response to FIR or other enhancement processing based upon chrominance. The luminance value of the enhanced digital image data for each pixel of an image is compared to corresponding local minimum and maximum luminance values of the non-enhanced image obtained from the neighborhood of the subject pixel. If an enhanced luminance value for a subject pixel falls outside the corresponding local minimum/local maximum luminance value range by a positive or negative overshoot amount, the enhanced luminance value is adjusted to attenuate the overshoot amount. The amount by which the enhanced luminance value for an enhanced pixel is adjusted varies depending upon the chrominance of the enhanced pixel. Also, the amount of overshoot attenuation can vary depending upon whether the enhanced luminance value is greater than the local maximum luminance value or less than the local minimum luminance value.

Description

BACKGROUND OF THE INVENTION
The present invention relates to the digital image processing arts. In particular, it relates to enhancement of digital image data, and a method and apparatus for attenuating overshoot in the luminance channel based upon the chrominance channel when edge enhancement operations are performed. Thus, the present invention provides a method and apparatus for reducing color shift and ringing due to edge enhancement operations without compromising resulting edge sharpness.
A main advantage of digital image reproduction relative to traditional light-lens image reproduction resides in the ability to process the digital image data so as to enhance the appearance of the final output image. For example, digital filtering is often performed to sharpen edges and fine lines for purposes of making an output image more visually appealing. When reducing or scaling-down an image, pre-filtering is often performed prior to sub-sampling for purposes of anti-aliasing. Due to limitations of the filtering algorithm, this filtering operation can blur an image. Also, in color image reproduction, it is a common practice to sub-sample the chrominance information to reduce the number of bits necessary to represent an image. This, too, can result in blurred edges. In either case and others, edge enhancement of the filtered image can be performed to sharpen the final output image.
One drawback associated with conventional edge enhancement operations is that the luminance information can be altered significantly from its original value so that the color of the final output image is shifted compared to the original image. Another undesirable effect of enhancement operations is the formation of dark or light rings about colored image regions. Color fringing and ringing are, obviously, undesirable and must be controlled in order to provide an aesthetically pleasing final image. On the other hand, luminance channel overshoot is less important to the appearance of the final output image if it occurs in areas of the image that are less colorful or “neutral,” e.g., in regions of black-and-white text data. Heretofore, no effective method and apparatus have been provided for controlling luminance channel overshoot due to image enhancement operations without compromising edge sharpness. Furthermore, no effective method and apparatus for controlling luminance channel overshoot have been provided wherein the overshoot attenuation is varied depending upon the chrominance of the image data.
SUMMARY OF THE INVENTION
In accordance with the present invention, a new and improved method and apparatus are provided for luminance channel overshoot control in image enhancement operations.
In accordance with a first aspect of the present invention, a method of digital image processing comprises receiving input digital image data defining a plurality of pixels of an input color digital image, wherein the input digital image data includes at least a luminance value and a chrominance value for each of the pixels of the input image. For each of the pixels of the input digital image, the input digital image data defining the pixel is enhanced based upon the input digital image data defining neighborhood pixels in a spatial neighborhood established about the pixel to obtain enhanced digital image data defining the pixel, the enhanced digital image data including at least an enhanced luminance value. For each of the pixels of the input digital image, an overshoot control operation is performed on the enhanced digital image data defining the pixel, wherein the overshoot control operation comprises: (i) determining local maximum and local minimum input luminance values in a spatial neighborhood about the pixel; (ii) comparing the enhanced luminance value of the pixel to the local maximum and local minimum luminance values to determine if the enhanced pixel luminance value is: (a) above the local maximum luminance value by a positive overshoot amount; or, (b) below the local minimum luminance value by a negative overshoot amount; (iii) receiving an input overshoot reduction coefficient; (iv) evaluating the chrominance of the pixel; (v) using the chrominance of the pixel to adjust the input overshoot reduction coefficient so as to obtain a modified overshoot reduction coefficient; (vi) if the enhanced luminance value of the pixel is above the local maximum luminance value, reducing the enhanced luminance value to attenuate the positive overshoot amount by a quantity that depends upon the modified overshoot reduction coefficient; and, (vii) if the enhanced luminance value of the pixel is below the local minimum luminance value, increasing the enhanced luminance value to attenuate the negative overshoot amount by a quantity that depends upon the modified overshoot reduction coefficient.
In accordance with another aspect of the present invention, a method of enhancing a color digital image comprises, for each of a plurality of pixels defining the color digital image, modifying a luminance value of a subject pixel in response to an enhancement filtering operation to obtain a modified luminance value for the subject pixel. Within a neighborhood of pixels spatially near the subject pixel, identifying a local minimum pixel luminance value and a local maximum pixel luminance value. The chroma of the subject pixel is determined and an overshoot reduction coefficient is received. The overshoot reduction coefficient is modified based upon the chroma of the subject pixel to obtain a modified overshoot reduction coefficient, and the modified luminance value is compared to at least one of the local minimum and local maximum luminance values. If the modified luminance value is greater than the local maximum luminance value, the modified overshoot reduction coefficient is used to reduce the modified luminance value of the subject pixel by a percentage of the amount by which the modified luminance value exceeds the local maximum luminance value. If the modified luminance value is less than the local minimum luminance value, the modified overshot reduction coefficient is used to increase the modified luminance value of the subject pixel by a percentage of the amount by which the modified luminance value is less than the local minimum luminance value.
In accordance with still another aspect of the present invention, a digital image processing apparatus comprises means for receiving input digital image data defining a plurality of pixels of an input color digital image, the input digital image data including at least a luminance value and a chrominance value for each of the pixels of the input image. A means adapted for enhancing each of the pixels of the input digital image based upon the input digital image data defining neighborhood pixels in a spatial neighborhood established about each of the pixels to obtain enhanced digital image data defining each of the enhanced pixels is provided, the enhanced digital image data including at least an enhanced luminance value. A means is also provided for performing an overshoot control operation on the enhanced digital image data defining each enhanced pixel, wherein the means for performing an overshoot control operation includes: (i)means for determining local maximum and local minimum input luminance values in a spatial neighborhood about each enhanced pixel; (ii) means for comparing the enhanced luminance value of each enhanced pixel to the local maximum and local minimum luminance values to determine if the enhanced pixel luminance value is: (a) above the local maximum luminance value by a positive overshoot amount; or, (b) below the local minimum luminance value by a negative overshoot amount; (iii) means for receiving an input overshoot reduction coefficient; (iv) means for evaluating the chrominance of the enhanced pixel as defined by the chrominance value; (v) means for using the chrominance of the enhanced pixel to adjust the input overshoot reduction coefficient so as to obtain a modified overshoot reduction coefficient; (vi) means for reducing the enhanced luminance value to attenuate the positive overshoot amount by a quantity that depends upon the modified overshoot reduction coefficient if the enhanced luminance value of the pixel is above the local maximum luminance value; and, (vii) means for increasing the enhanced luminance value to attenuate the negative overshoot amount by a quantity that depends upon the modified overshoot reduction coefficient if the enhanced luminance value of the pixel is below the local minimum luminance value.
In accordance with yet another aspect of the present invention, a method of processing a digital image includes enhancing a luminance value (L*) of each of a plurality of input pixels (P) to obtain an enhanced luminance value (FIR_OUTPUT) for each pixel. A positive overshoot is associated with a subject pixel of said digital image is identified if the enhanced luminance value (FIR_OUTPUT) of the subject pixel is greater than a local maximum luminance value (LOCAL_MAX) of input pixels (P) in a spatial neighborhood of the subject pixel in the digital image by a positive overshoot amount (OS). A negative overshoot associated with a subject pixel of the digital image is identified if the enhanced luminance value (FIR_OUTPUT) of the subject pixel is less than a local minimum luminance value (LOCAL_MIN) of input pixels (P) in a spatial neighborhood of the subject pixel in the digital image by a negative overshoot amount (OS′). An overshoot reduction coefficient (f) is provided for controlling the amount by which positive or negative overshoot associated with the subject pixel is attenuated. The overshoot reduction coefficient (f) is adjusted according to a chrominance of the subject pixel so that the overshoot reduction coefficient (f) is adjusted to have increasing overshoot attenuation effect as the chrominance of the subject pixel increases. The overshoot reduction coefficient (f), as adjusted based upon the chrominance of the subject pixel, is used to attenuate either the positive or negative overshoot associated with the subject pixel.
One advantage of the present invention is the provision of a method and apparatus for luminance channel overshoot control during digital image processing enhancement operations.
Another advantage of the present invention resides in the provision of a method and apparatus for controlling luminance channel overshoot resulting from edge enhancement processing wherein color shift and ringing are reduced or minimized without compromising edge sharpness.
A further advantage of the present invention is found in the provision of a method and apparatus for reducing luminance channel overshoot using original min/max luminance values from pixels in the neighborhood surrounding a pixel being processed and based upon the chrominance channel values for the pixel being processed.
A yet further advantage of the present invention resides in the provision of a method and apparatus for attenuating luminance channel overshoot in edge enhancement operations, wherein the attenuation varies depending upon whether the overshoot is positive or negative.
Still other benefits and advantages of the present invention will become apparent to those of ordinary skill of the art to which the invention pertains upon reading and understanding the present specification.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention may take form in various components and arrangements of components, and in various steps and arrangements of steps, preferred embodiments of which are disclosed herein and illustrated in the accompanying drawings which form a part hereof and wherein:
FIG. 1 is a diagrammatic illustration of a digital image processing system formed in accordance with the present invention;
FIG. 2 is an illustration of a digital image wherein a portion of the digital image is subject to edge enhancement filtering;
FIG. 3 graphically illustrates luminance channel overshoot and control of same in accordance with the present invention;
FIG. 4 is a flow chart that illustrates edge enhancement with luminance channel overshoot control in accordance with the present invention;
FIG. 5 is a block diagram illustrating a luminance channel overshoot apparatus formed in accordance with the present invention;
FIG. 6 is a block diagram illustrating the overshoot control unit of the apparatus shown in FIG. 5 as used for controlling luminance channel overshoot in accordance with the present invention;
FIG. 7 is a block diagram of an apparatus adapted for adjusting a luminance overshoot reduction parameter based upon the chroma of the pixel being processed in accordance with the present invention; and,
FIG. 8 is a flow chart illustrating adjustment of a luminance overshoot reduction parameter based upon the chroma of the pixel being processed in accordance with the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Referring now to the drawings wherein the showings are for purposes of describing preferred embodiments of the invention only and not for purposes of limiting same, a digital image processing system 10 formed in accordance with the present invention is shown in FIG. 1. An image input unit 12, such as a scanner, image storage device, and/or computer image generator derives/delivers digital image data in the form of one or more monochromatic separations, wherein the picture elements or pixels of each separation are defined at a depth of “d” bits per pixel where “d” is an integer. Accordingly, each pixel of each separation is defined in terms of “d” bits per pixel (bit depth=d), and each pixel has some gray value between full “off” and full “on.” When the digital image data is provided in terms of a single monochromatic separation, the image is monochromatic, for example, so called black-and-white image data. On the other hand, when the digital image data is provided in terms of two or more monochromatic separations, a color image results when the data from the separations is combined, for example, red-green-blue (RGB) separations or cyan-magenta-yellow (CMY) separations. Color digital image data supplied by the image input unit 12 can alternatively be supplied in the form of a luminance-chrominance color space, such as CIELAB or the like, as is well known in the art, and conversion among various color spaces is also contemplated herein.
The digital image signals are input from the scanner 12 to an image processing unit 14 wherein digital image processing, such as edge enhancement with luminance channel overshoot control in accordance with the present invention, is performed. The image processing unit 14 may be provided by any suitable electronic computing apparatus such as a programmed general purpose computer, a dedicated electronic circuit, or any other suitable electronic circuit means. The image processing unit 14 outputs processed digital image data in a suitable format to an image output terminal 16, such as a storage device, a digital printer, and/or a visual display. Suitable apparatus for digital image input and/or output include the XEROX Document Center 265DC digital imaging system, Pixelcraft 7650 Pro Imager Scanner, XEROX DocuTech Production Printing System scanners, the XEROX 5775 digital color copier, the XEROX 5760 and 5765 Majestik digital color copiers, or any other suitable color digital scanner/copier. Regardless of the depth “d” at which each pixel is defined, the location of each pixel in each separation bitmap is also defined, typically in terms of a row “n” and a column “m.”
FIG. 2 illustrates a color digital image I as derived by the image input terminal 12. As described above, the image I comprises a plurality of pixels P arranged in m rows and n columns so that each pixel P is uniquely identifiable by a row/column designation mn, e.g., P22which represents the pixel P located in the third row and third column. As noted, each pixel P of a color digital image I is defined by several monochromatic gray values or in terms of its luminance and chrominance values depending upon the color space.
For convenience and ease of understanding the present invention, the invention will be described in terms of the pixels P being defined in the CIELAB color space. As is generally known in the art, CIELAB is a perceptual color space wherein color is represented in three dimensions according to a lightness value (represented on the L* axis), a redness-greenness value (represented on the a* axis), and a yellowness-blueness value (represented on the b* axis). Thus, the a* and b* chrominance values define first and second chrominance channels for the CIELAB color space. However, those of ordinary skill in the art will certainly recognize that the invention can be carried- out in any luminance-chrominance color space and that any other color space, such as RGB, CMYK, or the like is freely convertible into CIELAB or another luminance-chrominance color space. It is not intended that the invention be limited to any particular color space.
With continuing reference to FIG. 2, the cross-hatched area F represents a spatial filter as is also well known in the art of digital image processing. In particular, the 12 represented filter F is a finite impulse response (FIR) filter that alters the value of a centrally located subject pixel P based upon the original values of all other neighborhood pixels P, i.e., all other pixels P encompassed by the filter F at a given time. The contribution of each neighborhood pixel to the final value of the subject pixel P varies depending upon the weight assigned to that neighborhood pixel according to the particular filtering operation being performed.
As illustrated in FIG. 2, by way of example only, the filter F is an FIR edge enhancement filter of a size that is 5 pixels by 5 pixels (5×5). The central pixel P22 is the subject pixel, and the remaining pixels P encompassed by the filter are the neighborhood pixels that will be used to alter the value of the subject pixel P22 for purposes of edge or other enhancement. As is well known, the filter F is applied to each pixel P in the image I for image enhancement operations. The FIR filtering operation, itself, is conventional and does not form a part of the present invention. Thus, any other size/type of FIR or other edge enhancement filter may be used without departing from the overall scope and intent of the present invention.
FIG. 3 graphically illustrates luminance channel overshoot in response to FIR or other enhancement filtering and control of same in accordance with the present invention. The solid line represents luminance values of the unfiltered image data I for each pixel P, e.g., in the CIELAB color space, the solid line represents the L* luminance channel. It can be seen that, in an edge region E of the image I, the luminance values change from a higher level to a lower level. However, this, change in luminance values is gradual and the edge region E of the image I is, thus, not well defined or “sharp.” To make the image I more visually appealing, FIR filtering is carried out on the original image I to enhance the edge region E and other edge regions.
As is graphically illustrated with a broken line FIR_OUTPUT, after FIR filtering, the transition from a higher luminance to a lower luminance in the edge region of the image I is much steeper indicating a much sharper, enhanced edge region E′. However, with reference to the pixel P22 as an example, its luminance value has been raised from an original value L1 to an FIR_OUTPUT value of L3 Further, the FIR_OUTPUT luminance value of the pixel P22 exceeds a local maximum original luminance value LOCAL_MAX of pixels P in a neighborhood about the pixel P22 by a positive overshoot amount OS. The neighborhood of original luminance values about the pixel P22 used to identify LOCAL_MAX preferably corresponds to. the neighborhood of the filter F, or a subset of same, but may be any other neighborhood in the region of the subject pixel, in this case the pixel P22. Accordingly, the luminance of the pixel P22 has been altered significantly relative to surrounding pixels, and the appearance of the output image may be undesirably altered due to color shift or “fringing” of the pixel P22.
Similarly, with reference to the pixel Prc, the FIR filtering operation has caused its luminance value to be reduced from a luminance value L4 (solid line) to an FIR_OUTPUT value L6 (broken line). Also, the FIR_OUTPUT luminance value is less than a local minimum luminance value LOCAL_MIN of original image pixels P in the neighborhood of the pixel Prc by a negative overshoot amount OS′. Again, the neighborhood used to locate the local minimum luminance value LOCAL_MIN preferably corresponds to the neighborhood of the FIR filter, itself, or a subset thereof, but may be any other neighborhood in the region of the subject pixel, in this case the pixel Prc. Thus, the luminance value of the pixel Prc has also been altered in a manner that will sharpen the edge E but may cause undesired color shift relative to the appearance of the original image I.
With continuing reference to FIG. 3, it is shown that luminance channel overshoot control in accordance with the present invention attenuates luminance channel overshoot OS,OS′. The phantom overshoot control line OSC represents the pixel luminance values P for the same edge region at E″ after performance of luminance channel overshoot control in accordance with the present invention. It is shown that, the positive overshoot OS associated with of the pixel P22 is reduced by an amount X=OS*f, wherein, f is a programmable overshoot reduction coefficient discussed in full detail below. Likewise, the negative overshoot OS′ of the pixel Prc is attenuated via luminance channel overshoot control in accordance with the present invention by an amount X′=OS′*f. However, it is significant to note that the phantom line OSC representing the same edge region at E″ after overshoot control in accordance with the present invention is nearly as steep as the broken line FIR_OUTPUT representing the edge region E′ after FIR edge enhancement. Thus, it can be seen that overshoot control in accordance with the present invention attenuates luminance overshoot without significantly compromising edge enhancement or sharpness.
In general, luminance channel overshoot control in accordance with the present invention to obtain a final output luminance value OSC for each pixel P based upon an input luminance value FIR_OUTPUT provided after FIR or other edge enhancement operations can be described mathematically by the following:
OS=FIR_OUTPUT−LOCAL_MAX
OS′=LOCAL_MIN−FIR_OUTPUT
OSC=FIR_OUTPUT−f*OS
if FIR_OUTPUT>LOCAL_MAX;
OSC=FIR_OUTPUT+f*OS′
if FIR_OUTPUT<LOCAL_MIN; and,
OSC=FIR_OUTPUT
if LOCAL_MIN<=FIR_OUTPUT<=LOCAL_MAX,
again, wherein f is programmable luminance overshoot reduction coefficient as noted above. Thus, the amount of luminance overshoot control varies depending upon the value of the coefficient f. For example, if f=0.25, the overshoot OS,OS′ will be attenuated by 25%. Thus, the effects of the FIR enhancement operation are decreased by 25% to prevent undesired color fringing.
Referring now to FIG. 4, luminance channel overshoot control in accordance with the present invention is described. A step or means S1 receives the digital image data of an original image I. For each pixel P of the original image, a step or means S2 enhances the luminance channel image data defining the pixel P using FIR or other edge enhancement filtering. Those of ordinary skill in the art will recognize that the chrominance information defining the pixels P of the original image I could also be enhanced, but such does not necessarily form a part of the present invention. A suitable method and apparatus for chrominance channel enhancement with overshoot control is described in co-pending and commonly owned U.S. application Ser. No. 09/393,534, entitled “CHROMINANCE CHANNEL OVERSHOOT CONTROL IN IMAGE ENHANCEMENT” filed Sep. 10, 1999 (via U.S. Express Mail No. EM414702234US); Attorney Docket No. XER 2 0256) which is hereby expressly incorporated by reference herein.
A step or means S3 adjusts the overshoot reduction coefficient f based upon the chrominance of the particular pixel P under consideration. In general, as is described below, luminance channel overshoot is more objectionable when it is associated with more colorful pixels P having high chroma values. In contrast, luminance channel overshoot associated with less colorful pixels, such as neutral or black-and-white pixels, is less objectionable (or even desirable). Thus, in general, the step or means S3 examines the original (non-enhanced) chroma value of the pixel P being processed, and adjusts the overshoot reduction coefficient f accordingly so that pixels P with higher chroma values are subject to greater luminance channel overshoot attenuation than pixels with lower chroma values.
For each pixel P of the original image, a step or means S4 determines the original (non-enhanced) LOCAL_MIN and LOCAL_MAX luminance values of pixels in a neighborhood about the subject enhanced pixel P. As is described above, these values LOCAL_MIN,LOCAL_MAX are used to determine the existence of overshoot OS,OS′, and whether the overshoot, if any, is “positive” (above LOCAL_MAX) or “negative” (below LOCAL_MIN).
A step or means S5 determines if the luminance of the enhanced pixel FIR_OUTPUT is greater than LOCAL_MAX and, if so, a step or means S6 reduces the luminance FIR_OUTPUT of the enhanced pixel P as described above according to the overshoot reduction coefficient f. On the other hand, if the luminance FIR_OUTPUT of the enhanced pixel P is less than LOCAL_MAX, a step or means S7 determines if the luminance of the enhanced pixel P is less than LOCAL_MIN and, if so, a step or means S8 increases the luminance FIR_OUTOUT of the enhanced pixel P as described above according to the overshoot reduction coefficient f.
FIGS. 5-7 diagrammatically illustrate one example of an apparatus specifically adapted for performing edge enhancement with luminance channel overshoot control in accordance with the present invention. As noted above, those of ordinary skill in the art will recognize that the apparatus illustrated in FIGS. 5-7 is preferably the image processing unit 14, programmed or otherwise configured to provide structure and/or operations necessary for the subject invention.
Luminance input values, such as CIELAB L* values, are input to a buffer 40. As noted above, the chrominance values, such as CIELAB a* and b* values, could be enhanced in a different operation. An FIR edge enhancement filter 42 performs the edge enhancement step S2 on the luminance L* values, and a neighborhood min/max detector 44 determines the luminance values for LOCAL_MIN and LOCAL_MAX to perform the operation S4. These values LOCAL_MIN,LOCAL_MAX are input from the detector 44 to an overshoot control unit 50, and the overshoot control unit 50 also includes one or more inputs 52 that receive the chrominance values, such as a* and b* values, for the pixel P being processed. Thus, the overshoot control unit 50 performs luminance channel overshoot control in accordance with the present invention, in particular, steps S3, and S5-S8, as appropriate, and supplies the resulting luminance value OSC for each pixel P that is processed as output.
With particular reference to FIG. 6, the illustrated example of an overshoot control unit 50 includes subtractors 52 a,52 b, sign extractors 5 a,54 b, a decoder 56, and a first selector 58 that perform the operations S4,S5,S7 as appropriate to determine if the luminance value FIR_OUTPUT for an enhanced pixel P is greater than LOCAL_MAX, less than LOCAL_MIN, or between these values. One or more initial values for the overshoot reduction coefficient f are preferably preprogrammed and stored in registers 60 a,60 b, and a central processing unit CPU of the image processing unit 14, together with a second selector 62, causes one of the stored coefficients to be input to a coefficient modifier 64. The coefficient modifier 64 performs the operation S3 to adjust the overshoot reduction coefficient f based upon the chrominance of the pixel P being processed. In particular, the coefficient modifier 64 receives an initial overshoot reduction coefficient value f and also the chrominance value(s) (such as a* and b* in the CIELAB color space) of the pixel P being processed. Based upon the input chrominance values, the coefficient modifier 64 assesses the chrominance of the pixel P being processed and adjusts the overshoot reduction coefficient f based upon same to calculate a modified overshoot reduction coefficient f.
The first selector 58, as controlled by output from the decoder 56, sends one of the overshoot values OS,OS′ from the subtractors 52 a,52 b to a multiplier 70. The multiplier 70 also receives as input the modified overshoot reduction coefficient f from the coefficient modifier 64, and performs the above-described multiplication of the adjusted overshoot reduction coefficient f with the overshoot values OS,OS′. An adder 72 sums the result supplied by the multiplier 70 with the enhanced luminance value FIR_OUTPUT for the pixel P being processed to complete the overshoot control operations S6,S8 and obtain the output luminance value OSC.
As noted above, the overshoot control unit 50 preferably includes registers or other means 60 a,60 b for storing at least two different pre-programmed initial overshoot reduction coefficient values f. The second selector 62 is programmed to select one of these stored coefficient values depending upon whether the overshoot is “positive” (FIR_OUTPUT>LOCAL_MAX) or “negative” (FIR_OUTPUT<LOCAL_MIN). This allows for the overshoot OS,OS′ to be controlled differently in each case. For example, it may be desirable to use an initial value f=0.50 for negative overshoot control and an initial value f=0.75 for positive overshoot control. This, then, provides for greater flexibility in overshoot control as desired for a particular application.
FIG. 7 is a block diagram illustrating an example of an overshoot reduction coefficient modifier apparatus 64 formed in accordance with the present invention, and FIG. 8 is a flow-chart corresponding thereto illustrating adjustment of the overshoot reduction coefficient f for each pixel P being processed based upon the chrominance of the pixel. With particular reference initially to FIG. 8, for each pixel P, a step or means S10 determines the chrominance of the pixel. The chrominance determined need not be an exact value, but can be an approximation or simply one or a plurality of discrete chrominance levels. This chrominance value or level is input to a look-up table LUT along with the input overshoot reduction coefficient f by the step or means S11. The output from the look-up table LUT is the modified overshoot reduction coefficient f. This, then, is used by the steps/means S6,S8 as previously described to reduce luminance overshoot in accordance with the present invention.
The apparatus illustrated in FIG. 7 implements the following equation that provides a method of approximating chrominance of a pixel P defined in terms of the CIELAB color space:
Chrominance=max(|a*|,|b*|)+min(|a*|,|b*|)/2
This, of course, is an approximation of chrominance, and those of ordinary skill in the art will recognize that chrominance may be determined or approximated by other methods, and it is intended that the present invention be construed as encompassing all of same.
As shown in FIG. 7, to implement the foregoing, chrominance values, such as a* and b* values in the present example, are input to magnitude extractors 80 a,80 b, respectively, the min/max detector 82, the division unit 84 and, finally, the look-up table LUT whereby the modified overshoot reduction coefficient is derived for use as noted above.
The invention has been described with reference to preferred embodiments. Modifications and alterations will occur to others upon reading and understanding the preceding specification. It is intended that the invention be construed as including all such modifications and alterations insofar as they fall within the scope of the appended claims or equivalents thereof.

Claims (19)

Having thus described the preferred embodiments, what is claimed is:
1. A method of digital image processing comprising:
receiving input digital image data defining a plurality of pixels of an input color digital image, said input digital image data including at least a luminance value and a chrominance value for each of said pixels of said input image;
for each of said pixels of said input digital image, enhancing said input digital image data defining said pixel based upon the input digital image data defining neighborhood pixels in a spatial neighborhood established about said pixel to obtain enhanced digital image data defining said pixel, said enhanced digital image data including at least an enhanced luminance value;
for each of said pixels of said input digital image, performing an overshoot control operation on said enhanced digital image data defining said pixel, said overshoot control operation comprising:
determining local maximum and local minimum input luminance values in a spatial neighborhood about the pixel;
comparing the enhanced luminance value of said pixel to said local maximum and local minimum luminance values to determine if said enhanced pixel luminance value is one of: (i) above the local maximum luminance value by a positive overshoot amount; and, (ii) below the local minimum luminance value by a negative overshoot amount;
receiving an input overshoot reduction coefficient;
evaluating the chrominance of the pixel;
using the chrominance of the pixel to adjust the input overshoot reduction coefficient so as to obtain a modified overshoot reduction coefficient;
if said enhanced luminance value of said pixel is above said local maximum luminance value, reducing said enhanced luminance value to attenuate said positive overshoot amount by a quantity that depends upon said modified overshoot reduction coefficient; and,
if said enhanced luminance value of said pixel is below said local minimum luminance value, increasing said enhanced luminance value to attenuate said negative overshoot amount by a quantity that depends upon said modified overshoot reduction coefficient.
2. The digital image processing method as set forth in claim 1, wherein said step of enhancing said digital image data of said input digital image comprises applying a finite impulse response (FIR) filter to said digital image data defining each pixel of said input digital image to sharpen edge regions of said input digital image.
3. The digital image processing method as set forth in claim 1, wherein said digital image data defining each of said pixels of said input digital image is defined in a CIELAB color space in terms of a luminance value L* and first and second chrominance values a*,b*.
4. The digital image processing method as set forth in claim 3, wherein said step of evaluating the chrominance of the pixel comprises deriving a chroma value C that defines the chrominance of the pixel according to:
C=max(|a*|,|b*|)+min(|a*|,|b*|)/2.
5. The digital image processing method as set forth in claim 1, wherein said step of receiving an input overshoot reduction coefficient comprises:
receiving a first input overshoot reduction coefficient if said overshoot amount is a positive overshoot amount; and,
receiving a second input overshoot reduction coefficient, different from said first input overshoot coefficient, if said overshoot amount is a negative overshoot amount.
6. The digital image processing method as set forth in claim 1, wherein said step of reducing said enhanced luminance value to attenuate said positive overshoot amount comprises:
multiplying said positive overshoot amount by said modified overshoot reduction coefficient to obtain a positive overshoot attenuation amount; and,
subtracting said positive overshoot attenuation amount from said enhanced luminance value.
7. The digital image processing method as set forth in claim 1, wherein said step of increasing said enhanced luminance value to attenuate said negative overshoot amount comprises:
multiplying said negative overshoot amount by said modified overshoot reduction coefficient to obtain a negative overshoot attenuation amount; and,
adding said negative overshoot attenuation amount to said enhanced luminance value.
8. A method of enhancing a color digital image comprising, for each of a plurality of pixels defining said color digital image:
modifying a luminance value of a subject pixel in response to an enhancement filtering operation to obtain a modified luminance value for the subject pixel;
within a neighborhood of pixels spatially near the subject pixel, identifying a local minimum pixel luminance value and a local maximum pixel luminance value;
determining the chroma of the subject pixel;
receiving an overshoot reduction coefficient;
modifying said overshoot reduction coefficient based upon said chroma of the subject pixel to obtain a modified overshoot reduction coefficient;
comparing the modified luminance value to at least one of the local minimum and local maximum luminance values;
if said modified luminance value is greater than said local maximum luminance value, using said modified overshoot reduction coefficient to reduce said modified luminance value of said subject pixel by a percentage of the amount by which said modified luminance value exceeds said local maximum luminance value; and,
if said modified luminance value is less than said local minimum luminance value, using said modified overshot reduction coefficient to increase said modified luminance value of said subject pixel by a percentage of the amount by which said modified luminance value is less than said local minimum luminance value.
9. The method of enhancing a digital color image as set forth in claim 8, wherein said enhancement filtering operation comprises a finite impulse response (FIR) filtering operation.
10. The method of enhancing a digital color image as set forth in claim 8, wherein the plurality of pixels of the digital image are each defined in terms of a luminance value and first and second chrominance values.
11. A digital image processing apparatus comprising:
means for receiving input digital image data defining a plurality of pixels of an input color digital image, said input digital image data including at least a luminance value and a chrominance value for each of said pixels of said input image;
means adapted for enhancing each of said pixels of said input digital image based upon the input digital image data defining neighborhood pixels in a spatial neighborhood established about each of said pixels to obtain enhanced digital image data defining each of said enhanced pixels, said enhanced digital image data including at least an enhanced luminance value;
means adapted for performing an overshoot control operation on said enhanced digital image data defining each enhanced pixel, said means adapted for performing an overshoot control operation comprising:
means for determining local maximum and local minimum input luminance values in a spatial neighborhood about each enhanced pixel;
means for comparing the enhanced luminance value of each enhanced pixel to said local maximum and local minimum luminance values to determine if said enhanced pixel luminance value is one of: (i) above the local maximum luminance value by a positive overshoot amount; and, (ii) below the local minimum luminance value by a negative overshoot amount;
means for receiving an input overshoot reduction coefficient;
means for evaluating the chrominance of the enhanced pixel as defined by said chrominance value;
means for using the chrominance of the enhanced pixel to adjust the input overshoot reduction coefficient so as to obtain a modified overshoot reduction coefficient;
means for reducing said enhanced luminance value to attenuate said positive overshoot amount by a quantity that depends upon said modified overshoot reduction coefficient if said enhanced luminance value of said pixel is above said local maximum luminance value; and,
means for increasing said enhanced luminance value to attenuate said negative overshoot amount by a quantity that depends upon said modified overshoot reduction coefficient if said enhanced luminance value of said pixel is below said local minimum luminance value.
12. The digital image processing apparatus as set forth in claim 11, wherein said means for enhancing said digital image data of said input digital image comprises means for applying a finite impulse response (FIR) filter to said digital image data defining each pixel of said input digital image to sharpen edge regions of said input digital image.
13. The digital image processing apparatus as set forth in claim 11, wherein said digital image data defining each of said pixels of said input digital image is defined in a CIELAB color space in terms of a luminance value L* and first and second chrominance values a*,b*.
14. The digital image processing apparatus as set forth in claim 11, wherein said means for receiving an input overshoot reduction coefficient comprises:
means for receiving a first input overshoot reduction coefficient if said overshoot amount is a positive overshoot amount; and,
means for receiving a second input overshoot reduction coefficient, different from said first input overshoot coefficient, if said overshoot amount is a negative overshoot amount.
15. A method of processing a digital image, said method comprising:
enhancing a luminance value (L*) of each of a plurality of input pixels (P) to obtain an enhanced luminance value (FIR_OUTPUT) for each pixel;
identifying positive overshoot associated with a subject pixel of said digital image if the enhanced luminance value (FIR_OUTPUT) of the subject pixel is greater than a local maximum luminance value (LOCAL_MAX) of input pixels (P) in a spatial neighborhood of the subject pixel in said digital image by a positive overshoot amount (OS);
identifying negative overshoot associated with a subject pixel of said digital image if the enhanced luminance value (FIR_OUTPUT) of the subject pixel is less than a local minimum luminance value (LOCAL_MIN) of input pixels (P) in a spatial neighborhood of the subject pixel in said digital image by a negative overshoot amount (OS′);
providing an overshoot reduction coefficient (f) that controls the amount by which positive or negative overshoot associated with the subject pixel is attenuated;
adjusting said overshoot reduction coefficient (f) according to a chrominance of the subject pixel so that said overshoot reduction coefficient (f) is adjusted to have increasing overshoot attenuation effect as said chrominance of said subject pixel increases; and,
using said overshoot reduction coefficient (f), as adjusted based upon the chrominance of the subject pixel, to attenuate one of said positive and negative overshoot associated with the subject pixel.
16. The digital image processing method as set forth in claim 15, wherein said overshoot reduction coefficient is used to attenuate positive overshoot according to:
FIR_OUTPUT−f*OS
and used to attenuate negative overshoot according to:
FIR_OUTPUT+f*OS′.
17. The digital image processing method as set forth in claim 16, wherein said plurality of input pixels are defined in terms of a luminance value and first and second chrominance values.
18. The digital image processing method as set forth in claim 17, wherein said plurality of input pixels are defined in a CIELAB color space by:
said luminance value=L*;
said first chrominance value=a*; and,
said second chrominance value=b*,
wherein said chrominance used to adjust said overshoot reduction coefficient is defined by:
max(|a*|,|b*|)+min(|a*|,|b*|)/2.
19. The digital image processing method as set forth in claim 15 further comprising:
providing first and second different overshoot reduction coefficients;
if positive overshoot is associated with said subject pixel, adjusting said first overshoot reduction coefficient according to the chrominance of subject pixel so that said overshoot reduction coefficient is adjusted to have increasing overshoot attenuation effect as said chrominance of said subject pixel increases;
if negative overshoot is associated with said subject pixel, adjusting said second overshoot reduction coefficient according to the chrominance of subject pixel so that said overshoot reduction coefficient is adjusted to have increasing overshoot attenuation effect as said chrominance of said subject pixel increases;
using said first and second overshoot reduction coefficients to attenuate said positive and negative overshoot amounts associated with the subject pixel, respectively.
US09/398,623 1999-09-17 1999-09-17 Luminance enhancement with overshoot reduction control based on chrominance information Expired - Lifetime US6453068B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US09/398,623 US6453068B1 (en) 1999-09-17 1999-09-17 Luminance enhancement with overshoot reduction control based on chrominance information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US09/398,623 US6453068B1 (en) 1999-09-17 1999-09-17 Luminance enhancement with overshoot reduction control based on chrominance information

Publications (1)

Publication Number Publication Date
US6453068B1 true US6453068B1 (en) 2002-09-17

Family

ID=23576105

Family Applications (1)

Application Number Title Priority Date Filing Date
US09/398,623 Expired - Lifetime US6453068B1 (en) 1999-09-17 1999-09-17 Luminance enhancement with overshoot reduction control based on chrominance information

Country Status (1)

Country Link
US (1) US6453068B1 (en)

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010036305A1 (en) * 1999-12-30 2001-11-01 Sung-Chun Jun Detecting and compensating defective pixels in image sensor on real time basis
US20020085237A1 (en) * 2001-01-02 2002-07-04 Bradburn Brent M. Pixel processing system for image production
US20050018903A1 (en) * 2003-07-24 2005-01-27 Noriko Miyagi Method and apparatus for image processing and computer product
US20050074179A1 (en) * 2003-10-03 2005-04-07 Wilensky Gregg D. Tone selective adjustment of images
US20050135701A1 (en) * 2003-12-19 2005-06-23 Atkins C. B. Image sharpening
US20060245665A1 (en) * 2005-04-29 2006-11-02 Je-Ho Lee Method to detect previous sharpening of an image to preclude oversharpening
CN100394766C (en) * 2004-03-05 2008-06-11 佳能株式会社 Image signal processor and image signal processing method
US7466868B2 (en) 2003-10-03 2008-12-16 Adobe Systems Incorporated Determining parameters for adjusting images
US20090116763A1 (en) * 2007-11-02 2009-05-07 Samsung Electronics Co., Ltd. Block-based image restoration system and method
US20100002954A1 (en) * 2008-07-03 2010-01-07 Rastislav Lukac Reducing Signal Overshoots And Undershoots In Demosaicking
US7724400B2 (en) 2003-04-02 2010-05-25 Lexmark International, Inc. Simple and configurable all-in-one operator panel
US8165342B2 (en) * 2000-02-14 2012-04-24 Digimarc Corporation Color image or video processing
US20130114896A1 (en) * 2011-11-08 2013-05-09 Sony Corporation Image processing apparatus, image processing method and program
US20160307340A1 (en) * 2015-04-14 2016-10-20 Thomas Allmendinger Multispectral ct imaging
US20170061234A1 (en) * 2015-08-31 2017-03-02 Apple Inc. Noise filtering and image sharpening utilizing common spatial support
US9734603B2 (en) * 2015-06-30 2017-08-15 General Electric Company Systems and methods for peak tracking and gain adjustment
CN107132026A (en) * 2017-04-11 2017-09-05 上海汇尔通信息技术有限公司 The method of testing and system for the minimum display device backlight illumination that scanning device is supported
US9819849B1 (en) 2016-07-01 2017-11-14 Duelight Llc Systems and methods for capturing digital images
US9998721B2 (en) 2015-05-01 2018-06-12 Duelight Llc Systems and methods for generating a digital image
US10122981B2 (en) * 2015-09-08 2018-11-06 Sony Corporation Color conversion
US10178300B2 (en) 2016-09-01 2019-01-08 Duelight Llc Systems and methods for adjusting focus based on focus target information
US10182197B2 (en) 2013-03-15 2019-01-15 Duelight Llc Systems and methods for a digital image sensor
US10372971B2 (en) 2017-10-05 2019-08-06 Duelight Llc System, method, and computer program for determining an exposure based on skin tone
US10382702B2 (en) 2012-09-04 2019-08-13 Duelight Llc Image sensor apparatus and method for obtaining multiple exposures with zero interframe time
EP1854278B1 (en) * 2005-02-25 2020-04-08 Imagination Technologies Limited A method for controlling overshoot in a video enhancement system
US10924688B2 (en) 2014-11-06 2021-02-16 Duelight Llc Image sensor apparatus and method for obtaining low-noise, high-speed captures of a photographic scene
CN112419187A (en) * 2020-11-23 2021-02-26 杭州海康威视数字技术股份有限公司 Image processing method, device and equipment
US11463630B2 (en) 2014-11-07 2022-10-04 Duelight Llc Systems and methods for generating a high-dynamic range (HDR) pixel stream

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4631579A (en) * 1983-12-14 1986-12-23 Dr. Ing. Rudolf Hell Gmbh Method and apparatus for the production of color separations for single color printing
US5666443A (en) 1993-08-24 1997-09-09 Minolta Co., Ltd. Image processor with edge emphasis of image data
US5959683A (en) * 1997-06-26 1999-09-28 Xerox Corporation System to remove artifacts in a digital image derived from a television signal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4631579A (en) * 1983-12-14 1986-12-23 Dr. Ing. Rudolf Hell Gmbh Method and apparatus for the production of color separations for single color printing
US5666443A (en) 1993-08-24 1997-09-09 Minolta Co., Ltd. Image processor with edge emphasis of image data
US5959683A (en) * 1997-06-26 1999-09-28 Xerox Corporation System to remove artifacts in a digital image derived from a television signal

Cited By (62)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010036305A1 (en) * 1999-12-30 2001-11-01 Sung-Chun Jun Detecting and compensating defective pixels in image sensor on real time basis
US8165342B2 (en) * 2000-02-14 2012-04-24 Digimarc Corporation Color image or video processing
US8792675B2 (en) 2000-02-14 2014-07-29 Digimarc Corporation Color image or video processing
US20020085237A1 (en) * 2001-01-02 2002-07-04 Bradburn Brent M. Pixel processing system for image production
US6879721B2 (en) * 2001-01-02 2005-04-12 Hewlett-Packard Development Company, L.P. Pixel processing system for image production
US7724400B2 (en) 2003-04-02 2010-05-25 Lexmark International, Inc. Simple and configurable all-in-one operator panel
US20050018903A1 (en) * 2003-07-24 2005-01-27 Noriko Miyagi Method and apparatus for image processing and computer product
US7412105B2 (en) * 2003-10-03 2008-08-12 Adobe Systems Incorporated Tone selective adjustment of images
US7466868B2 (en) 2003-10-03 2008-12-16 Adobe Systems Incorporated Determining parameters for adjusting images
US7783127B1 (en) 2003-10-03 2010-08-24 Adobe Systems Incorporated Determining parameters for adjusting images
US7853096B1 (en) 2003-10-03 2010-12-14 Adobe Systems Incorporated Tone selective adjustment of images
US20050074179A1 (en) * 2003-10-03 2005-04-07 Wilensky Gregg D. Tone selective adjustment of images
US8260080B1 (en) 2003-10-03 2012-09-04 Adobe Systems Incorporated Tone selective adjustment of images
US7522314B2 (en) * 2003-12-19 2009-04-21 Hewlett-Packard Development Company, L.P. Image sharpening
US20050135701A1 (en) * 2003-12-19 2005-06-23 Atkins C. B. Image sharpening
CN100394766C (en) * 2004-03-05 2008-06-11 佳能株式会社 Image signal processor and image signal processing method
EP1854278B1 (en) * 2005-02-25 2020-04-08 Imagination Technologies Limited A method for controlling overshoot in a video enhancement system
US10841461B2 (en) 2005-02-25 2020-11-17 Imagination Technologies Limited Method and apparatus for controlling overshoot in a video enhancement system
US20060245665A1 (en) * 2005-04-29 2006-11-02 Je-Ho Lee Method to detect previous sharpening of an image to preclude oversharpening
US8107765B2 (en) * 2007-11-02 2012-01-31 Samsung Electronics Co., Ltd Block-based image restoration system and method
US20090116763A1 (en) * 2007-11-02 2009-05-07 Samsung Electronics Co., Ltd. Block-based image restoration system and method
US8131110B2 (en) 2008-07-03 2012-03-06 Seiko Epson Corporation Reducing signal overshoots and undershoots in demosaicking
US20100002954A1 (en) * 2008-07-03 2010-01-07 Rastislav Lukac Reducing Signal Overshoots And Undershoots In Demosaicking
US20130114896A1 (en) * 2011-11-08 2013-05-09 Sony Corporation Image processing apparatus, image processing method and program
US10652478B2 (en) 2012-09-04 2020-05-12 Duelight Llc Image sensor apparatus and method for obtaining multiple exposures with zero interframe time
US12003864B2 (en) 2012-09-04 2024-06-04 Duelight Llc Image sensor apparatus and method for obtaining multiple exposures with zero interframe time
US10382702B2 (en) 2012-09-04 2019-08-13 Duelight Llc Image sensor apparatus and method for obtaining multiple exposures with zero interframe time
US11025831B2 (en) 2012-09-04 2021-06-01 Duelight Llc Image sensor apparatus and method for obtaining multiple exposures with zero interframe time
US10182197B2 (en) 2013-03-15 2019-01-15 Duelight Llc Systems and methods for a digital image sensor
US10931897B2 (en) 2013-03-15 2021-02-23 Duelight Llc Systems and methods for a digital image sensor
US10498982B2 (en) 2013-03-15 2019-12-03 Duelight Llc Systems and methods for a digital image sensor
US11394894B2 (en) 2014-11-06 2022-07-19 Duelight Llc Image sensor apparatus and method for obtaining low-noise, high-speed captures of a photographic scene
US10924688B2 (en) 2014-11-06 2021-02-16 Duelight Llc Image sensor apparatus and method for obtaining low-noise, high-speed captures of a photographic scene
US11463630B2 (en) 2014-11-07 2022-10-04 Duelight Llc Systems and methods for generating a high-dynamic range (HDR) pixel stream
US10290122B2 (en) * 2015-04-14 2019-05-14 Siemens Aktiengesellschaft Multi-spectral CT imaging
US20160307340A1 (en) * 2015-04-14 2016-10-20 Thomas Allmendinger Multispectral ct imaging
US10129514B2 (en) 2015-05-01 2018-11-13 Duelight Llc Systems and methods for generating a digital image
US10375369B2 (en) 2015-05-01 2019-08-06 Duelight Llc Systems and methods for generating a digital image using separate color and intensity data
US10904505B2 (en) 2015-05-01 2021-01-26 Duelight Llc Systems and methods for generating a digital image
US10110870B2 (en) 2015-05-01 2018-10-23 Duelight Llc Systems and methods for generating a digital image
US11356647B2 (en) 2015-05-01 2022-06-07 Duelight Llc Systems and methods for generating a digital image
US9998721B2 (en) 2015-05-01 2018-06-12 Duelight Llc Systems and methods for generating a digital image
US9734603B2 (en) * 2015-06-30 2017-08-15 General Electric Company Systems and methods for peak tracking and gain adjustment
US20170061234A1 (en) * 2015-08-31 2017-03-02 Apple Inc. Noise filtering and image sharpening utilizing common spatial support
US9747514B2 (en) * 2015-08-31 2017-08-29 Apple Inc. Noise filtering and image sharpening utilizing common spatial support
US10122981B2 (en) * 2015-09-08 2018-11-06 Sony Corporation Color conversion
US9819849B1 (en) 2016-07-01 2017-11-14 Duelight Llc Systems and methods for capturing digital images
US10477077B2 (en) 2016-07-01 2019-11-12 Duelight Llc Systems and methods for capturing digital images
US11375085B2 (en) 2016-07-01 2022-06-28 Duelight Llc Systems and methods for capturing digital images
US10469714B2 (en) 2016-07-01 2019-11-05 Duelight Llc Systems and methods for capturing digital images
US10178300B2 (en) 2016-09-01 2019-01-08 Duelight Llc Systems and methods for adjusting focus based on focus target information
US10785401B2 (en) 2016-09-01 2020-09-22 Duelight Llc Systems and methods for adjusting focus based on focus target information
US12003853B2 (en) 2016-09-01 2024-06-04 Duelight Llc Systems and methods for adjusting focus based on focus target information
CN107132026B (en) * 2017-04-11 2019-04-30 上海汇尔通信息技术有限公司 The test method and system for the minimum display equipment backlight illumination that scanning device is supported
CN107132026A (en) * 2017-04-11 2017-09-05 上海汇尔通信息技术有限公司 The method of testing and system for the minimum display device backlight illumination that scanning device is supported
US10586097B2 (en) 2017-10-05 2020-03-10 Duelight Llc System, method, and computer program for capturing an image with correct skin tone exposure
US11455829B2 (en) 2017-10-05 2022-09-27 Duelight Llc System, method, and computer program for capturing an image with correct skin tone exposure
US10558848B2 (en) 2017-10-05 2020-02-11 Duelight Llc System, method, and computer program for capturing an image with correct skin tone exposure
US11699219B2 (en) 2017-10-05 2023-07-11 Duelight Llc System, method, and computer program for capturing an image with correct skin tone exposure
US10372971B2 (en) 2017-10-05 2019-08-06 Duelight Llc System, method, and computer program for determining an exposure based on skin tone
CN112419187A (en) * 2020-11-23 2021-02-26 杭州海康威视数字技术股份有限公司 Image processing method, device and equipment
CN112419187B (en) * 2020-11-23 2023-08-25 杭州海康威视数字技术股份有限公司 Image processing method, device and equipment

Similar Documents

Publication Publication Date Title
US6453068B1 (en) Luminance enhancement with overshoot reduction control based on chrominance information
EP0684729B1 (en) Image-dependent color saturation correction in a natural scene pictorial image
EP1383341B1 (en) Method and apparatus for adaptively enhancing colors in color images
US7760934B2 (en) Color to grayscale conversion method and apparatus utilizing a high pass filtered chrominance component
US5426517A (en) Automated tone correction apparatus and method using filtered histogram equalization
US6205257B1 (en) System and method for selectively noise-filtering digital images
RU2146425C1 (en) Method and circuits to raise definition ( versions )
US8305645B2 (en) Image processing and/or forming apparatus for performing black generation and under color removal processes on selected pixels, image processing and/or forming method for the same, and computer-readable storage medium for storing program for causing computer to function as image processing and/or forming apparatus for the same
JP2003153006A (en) Image processing apparatus
JPH0372778A (en) Area identification system for picture processing unit
US6614944B1 (en) Image enhancement filter with adaptive threshold
EP1098511A2 (en) Gamut mapping preserving local luminance differences with adaptive spatial filtering
JP4172616B2 (en) Image processing device
US6483941B1 (en) Crominance channel overshoot control in image enhancement
JPH10214339A (en) Picture filtering method
US20070085857A1 (en) Method and apparatus for adaptively filtering input image in color domains
JP2906975B2 (en) Color image processing method and apparatus
JP6335614B2 (en) Image processing apparatus, control method thereof, and program
JP4112413B2 (en) Image processing apparatus, image forming apparatus, image processing method, image processing program, and computer-readable recording medium on which image processing program is recorded
US8665498B2 (en) Method and system for automatically detecting and processing halftone regions in scanned documents
JP4305917B2 (en) Video signal processing apparatus and television apparatus
JPH07254994A (en) Method and device for forming image
JP2011059193A (en) Image processing device, image forming device equipped with the same, image processing method, control program, and recording medium
JPH10340332A (en) Image processor, image processing method and medium recording image processing control program
JP4176656B2 (en) Image processing apparatus, image processing method, image forming apparatus, image processing program, and recording medium recording the program

Legal Events

Date Code Title Description
AS Assignment

Owner name: XEROX CORPORATION, CONNECTICUT

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LI, XING;REEL/FRAME:010350/0545

Effective date: 19990917

AS Assignment

Owner name: BANK ONE, NA, AS ADMINISTRATIVE AGENT, ILLINOIS

Free format text: SECURITY AGREEMENT;ASSIGNOR:XEROX CORPORATION;REEL/FRAME:013111/0001

Effective date: 20020621

Owner name: BANK ONE, NA, AS ADMINISTRATIVE AGENT,ILLINOIS

Free format text: SECURITY AGREEMENT;ASSIGNOR:XEROX CORPORATION;REEL/FRAME:013111/0001

Effective date: 20020621

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: JPMORGAN CHASE BANK, AS COLLATERAL AGENT, TEXAS

Free format text: SECURITY AGREEMENT;ASSIGNOR:XEROX CORPORATION;REEL/FRAME:015134/0476

Effective date: 20030625

Owner name: JPMORGAN CHASE BANK, AS COLLATERAL AGENT,TEXAS

Free format text: SECURITY AGREEMENT;ASSIGNOR:XEROX CORPORATION;REEL/FRAME:015134/0476

Effective date: 20030625

FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

FPAY Fee payment

Year of fee payment: 12

AS Assignment

Owner name: XEROX CORPORATION, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BANK ONE, NA;REEL/FRAME:034881/0827

Effective date: 20030625

Owner name: XEROX CORPORATION, NEW YORK

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:034882/0471

Effective date: 20061204

AS Assignment

Owner name: XEROX CORPORATION, CONNECTICUT

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JPMORGAN CHASE BANK, N.A. AS SUCCESSOR-IN-INTEREST ADMINISTRATIVE AGENT AND COLLATERAL AGENT TO BANK ONE, N.A.;REEL/FRAME:061388/0388

Effective date: 20220822

Owner name: XEROX CORPORATION, CONNECTICUT

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JPMORGAN CHASE BANK, N.A. AS SUCCESSOR-IN-INTEREST ADMINISTRATIVE AGENT AND COLLATERAL AGENT TO JPMORGAN CHASE BANK;REEL/FRAME:066728/0193

Effective date: 20220822