WO2009002121A1 - Non-linear tone mapping apparatus and method and computer readable medium stored thereon computer executable instructions for performing the method - Google Patents

Non-linear tone mapping apparatus and method and computer readable medium stored thereon computer executable instructions for performing the method Download PDF

Info

Publication number
WO2009002121A1
WO2009002121A1 PCT/KR2008/003730 KR2008003730W WO2009002121A1 WO 2009002121 A1 WO2009002121 A1 WO 2009002121A1 KR 2008003730 W KR2008003730 W KR 2008003730W WO 2009002121 A1 WO2009002121 A1 WO 2009002121A1
Authority
WO
WIPO (PCT)
Prior art keywords
value
pixel
luminance
image information
computing
Prior art date
Application number
PCT/KR2008/003730
Other languages
French (fr)
Inventor
Young-Sin Lee
Original Assignee
Core Logic, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Core Logic, Inc. filed Critical Core Logic, Inc.
Priority to CN2008800222156A priority Critical patent/CN101690169B/en
Priority to JP2010514624A priority patent/JP2010531513A/en
Priority to EP08766651A priority patent/EP2163087A4/en
Publication of WO2009002121A1 publication Critical patent/WO2009002121A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • G06T5/92Dynamic range modification of images or parts thereof based on global image properties
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/57Control of contrast or brightness
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/77Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase
    • H04N9/78Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase for separating the brightness signal or the chrominance signal from the colour television signal, e.g. using comb filter

Definitions

  • the present invention relates to apparatus and method for correcting a low luminous intensity area of an input image, and in particular, to apparatus and method for providing a converted image having higher visual perception according to human visual perception system.
  • the image processing includes feature extraction, image enhancement, image restoration, image reconstruction, image analysis, image recognition or image compression.
  • the image processing employs techniques appropriate for its objects mentioned above.
  • a method f ⁇ r ' correcting a luminous intensity of an area of an image is used to address the above-mentioned image enhancement problem.
  • various methods are suggested, for example histogram stretching, gamma correction, algebra conversion or compulsory adjustment of brightness coefficient value. '
  • g(x,y) is a stretched image information
  • f(x,y) is an original image information
  • g max is a maximum value of a pixel
  • g min is a minimum value of a pixel.
  • the stretching is a technique for processing an image by the above-mentioned equation, and adjusts to stretch a pixel value distribution of an image having a low contrast more widely.
  • the gamma correction or algebra conversion uses a specific function such as an exponential function or a log function, in which an original image information is an independent variable and a function value of the function is a dependent variable, and the function value corresponds to the resultant image.
  • the above-mentioned techniques do not take into account the characteristic of the entire image based on human perception to brightness of the image, and uses a method for uniformly changing brightness information of the image by conversion to increase the luminous intensity of a low luminous intensity area.
  • a'dark area may be expressed as a bright area, however the brightness and color of the entire image is changed, or the brightness and the color of the original image is considerably influenced by distortion of image information such as color twist of a specific area.
  • An object of the present invention is to provide an apparatus and a method, which corrects a low luminous intensity area by matching brightness of the low luminous intensity area with an equal or similar level to an image information value of a bright image, thereby overcoming error in color information and making the brightness gradation of an entire image natural.
  • Another object of the present invention is to provide a computer readable medium stored thereon computer executable instructions for performing the above-mentioned method.
  • a non-linear tone mapping apparatus comprises a luminance value computing unit for computing a luminance value of each pixel of an object image using an image information of each pixel; a cbmputing unit for computing a light adaptive value of each pixel using the image information and luminance value of each pixel, the light adaptive value representing the degree of response to brightness of the image in the image information of each pixel; and a converting unit for converting the image information of each pixel of the object image using a ratio of the image information to the light adaptive value for each pixel.
  • the computing unit may include a luminance adaptive value computing unit for computing a luminance adaptive value of each pixel using the image information of each pixel and the luminance value of each pixel; a global luminance adaptive value computing unit for computing a global luminance adaptive value of the object image using a statistical computation value of the image information and a statistical computation value of the luminance value; and a light adaptive value computing unit for computing a light adaptive value corresponding to the image information of each pixel using the luminance adaptive value of each pixel and the global luminance adaptive value.
  • the non-linear tone mapping apparatus further comprises a normalization unit for normalizing the image information of each pixel of the object image; and a denormalization unit for denormalizing the image information of each pixel converted by the converting unit, and the computing unit may be configured to compute a luminance value using the image information of each pixel normalized by the normalization unit.
  • a non-linear tone mapping method comprises a luminance value computing step of computing a luminance value of each pixel of an object image using an image information of each pixel; a light adaptive value computing step of computing a light adaptive value of each pixel using the image information and luminance value of each pixel, the light adaptive value representing the degree of response to brightness of the image in the image information of each pixel; and a converting step of converting the image information of each pixel of the object image using a ratio of the image information to the light adaptive value for each pixel.
  • FIG. 1 is a block diagram illustrating a non-linear tone mapping apparatus according to a preferred embodiment of the present invention.
  • FIG. 2 is a block diagram illustrating a non-linear tone mapping apparatus according to another embodiment of the present invention.
  • FIG. 3 is a flow chart illustrating a non-linear tone mapping method according to a preferred embodiment of the present invention.
  • FIG. 4 is a view illustrating results of image information converted by the present invention.
  • a color space of an image essential to image processing may be expressed variously, for example RGB (Red, Green, Blue), CMYK (Cyan, Magenta, Yellow, Key (Black)), HS-family, CIE (The Commission Internationale d'Eclairage) or Y-family, according to point of view such as view toward color mixture or similarity to human vision system, and may be converted to another kind of color space by a simple mathematical conversion formula.
  • an input image includes a plurality of pixels, and each pixel has its unique image information (brightness, hue, saturation and so on).
  • image information has values of 0 to 255 and is indicated as information of 8 bit.
  • the image information may be indicated as information of 10 bit or 12 bit depending on application conditions.
  • a color space coordinate system used as an example in the present invention may be applicable to another color space coordinate equally or similarly, and a bit size of an image information of a pixel in the input image is just an Example of the present invention for description.
  • FIG. 1 is a block diagram illustrating a non-linear tone mapping apparatus according to a preferred embodiment of the present invention.
  • FIG. 2 is a block diagram illustrating a non-linear tone mapping apparatus according to another embodiment of the present invention.
  • FIG. 3 is a flow chart illustrating a non-linear tone mapping method according to a preferred embodiment of the present invention.
  • a non-linear tone mapping apparatus 100 comprises an input unit 110, a normalization unit 120, a luminance value computing unit 130, a computing unit 135, a converting unit 170 and a denormalization unit 180.
  • the input unit 110 receives an input object image for conversion (S200), and serves as an interface for transmitting the input object image to another configuration of the present invention.
  • S200 input object image for conversion
  • S200 input object image for conversion
  • the human vision system used to correct an image information of a low luminous intensity area is described briefly.
  • the term, 'adaptation' means adjusting the condition of the human visual system to increase the visual perception to an object, variable according to amount of light incident upon the human eye and power spectral distribution of the light.
  • Luminance (brightness) adaptation includes light adaptation and dark adaptation.
  • the light adaptation means that in the case of a sudden movement to higher luminance, the eye becomes dark-adapted through decreases of the sensitivity.
  • the dark adaptation means that in the case of a sudden movement to lower luminance, the eye becomes light-adapted through increases of the sensitivity.
  • color adaptation or chromatic adaptation means that the sensitivity of three kinds of cones changes according to spectral composition of an illuminating light and light on an object, and spectral sensitivity of the human visual system changes accordingly.
  • the human eye sees color uniformly.
  • the present invention corrects a low luminous intensity area based on light and mechanism of human visual perception to allow a more natural image correction without distortion of image information.
  • the normalization unit 120 normalizes an image information of each pixel of the object image inputted through the input unit 110 (S210). ; In' alternative embodiments, normalization may be not performed, and in this case, the object image inputted through the input unit 110 is inputted into the luminance value computing unit 130. This embodiment uses the normalized image information, however alternative embodiments may use an image information that is not passed through normalization. [0038] Normalization maps a statistical sample value that may have various values to a value between 0 and 1. Typically, the normalized value is expressed as (function value-min)/(max-min).
  • the object image has an image information expressed as RGB for each pixel.
  • the image information may be expressed as various color spaces.
  • the normalization unit 120 normalizes an image information of each pixel of the object image shown in the above Table 1 using a mathematical formula such as (image information value-min)/(max-min).
  • the following Table 2 shows the normalized image information that is expressed as "I”.
  • the normalized jmage information is inputted into the luminance value computing unit 130.
  • the luminance value computing unit 130 computes a luminance value of each pixel using the normalized image information of each pixel of the object image (S220).
  • Equation 2 a method for computing a luminance value using the normalized image information uses the following Equation 2. [0047] Equation 2
  • L is a luminance value of each pixel
  • Ir, Ig, and Ib are normalized image information for each R, G and B of each pixel and has a value between 0 and 1.
  • A, B and C are weight constants of the image information
  • A is a user input constant set between 0.15 and 0.20
  • B is a user input constant set between 0.65 and 0.75
  • C is a user input constant set between 0.05 and 0.15.
  • the luminance value may be set as an average value of RGB image information, however preferably the luminance value uses a coefficient value in such a form that a visual receptor of human actually receives by the above equation.
  • the user input constant may be provided by another module in the
  • the computing unit 135 computes a light adaptive value representing the degree of response to brightness of the image in the image information of each pixel using the luminance value of each pixel computed by the luminance value computing unit 130 and the image information of each pixel (S225).
  • a light adaptive value on which the degree of response of human vision system to brightness of the image is reflected is computed as a factor.
  • the computed light adaptive value is inputted into the converting unit 170 later and is used as a standard for pixel conversion.
  • the above-mentioned method allows image conversion appropriate for a mechanism of human visual perception.
  • the computing unit 135 may include a global luminance adaptive value computing unit 140, a luminance adaptive value computing unit 150 and a light adaptive value computing unit 160.
  • the luminance adaptive value computing unit 150 computes a luminance adaptive value of each pixel using the image information of each pixel and the luminance value of each pixel (S230).
  • the luminance adaptive value indicates the degree of relation between the image information of each pixel and the luminance value of each pixel, and reflects chromatic adaptation.
  • the luminance adaptive value is computed using a value obtained by applying weight values to the normalized image information of each pixel and the luminance value of each pixel, with the sum of the weight values being
  • tKe luminance adaptive value computed by the luminance adaptive value computing unit 150 is represented by the following Equation 3.
  • Equation 3 / a is a luminance adaptive value of each pixel
  • b is a user input constant between 0 and 1
  • L is a luminance value
  • a luminance adaptive value of a corresponding pixel is a luminance value of the pixel itself.
  • a luminance adaptive value of a corresponding pixel is a channel image information value of the pixel.
  • the constant 'b' is a user input value that reflects the degree of chromatic adaptation in the above-mentioned range.
  • the luminance adaptive value is computed for each channel (RGB) of each pixel. That is, in the case of a 3 x 3 matrix, 9 pixels exist and each pixel has 3 (RGB) image information, and thus 27 local luminance adaptive values are computed.
  • the global luminance adaptive value computing unit 140 of the present invention computes a global luminance adaptive value of the object image using a statistical computation value of the image information and a statistical computation value of the luminance value or using a value obtained by applying weight values to a statistical-computation value of the normalized image information of each pixel and a statistical computation value of the luminance value of each pixel, with the sum of the weight values being 1 (S230).
  • the luminance adaptive value indicates the degree of relation between the image information for each channel of each pixel and the luminance value, and reflects chromatic adaptation.
  • the global luminance adaptive value means the statistical value of all the pixels, and is not computed by unit of pixel.
  • the global luminance adaptive value reflects statistical and general chromatic adaptation of all the pixels.
  • the global luminance adaptive value uses a statistical computation value of the image information and a statistical computation value of the luminance value, and preferably is computed by the following Equation 4.
  • Equation 4 j global
  • IsI* is a statistical computation value of the normalized R, G, B image ⁇ av information of each pixel, and I ⁇ is a statistical computation value of the luminance value, and c is a user input constant between 0 and 1.
  • the statistical computation value may be one of various statistical computation values representing a statistical property of the image information and the luminance value. However, preferably a statistical average value, i.e. an average value of the image information of each pixel and an average value of the luminance value of each pixel is used, thereby reflecting an algebraically general value.
  • the global luminance adaptive value computed by the global luminance adaptive value computing unit 140 is shown in the following Table 5. [0074] Table 5
  • the global luminance adaptive value is computed for each channel information, and thus 3 global luminance adaptive values are computed.
  • the light adaptive value computing unit 160 computes a light adaptive value corresponding to the image information of each pixel using the luminance adaptive value of each pixel and the global luminance adaptive value (S240).
  • the light adaptive value indicates the relation between the luminance adaptive value of each pixel and the global luminance adaptive value of the object pixel, and thus changes together with the whole characteristic of the image in the case of change of the image information.
  • the light adaptive value is computed using a value obtained by applying weight values to the luminance adaptive value of each pixel and the global luminance adaptive value 1 , with the weight values being 1. Specifically, the light adaptive value is computed by the following Equation 5.
  • Ia is a light adaptive value
  • « is a luminance
  • T global adaptive value of each pixel, « is a global luminance adaptive value, and d is a user input constant between 0 and 1.
  • Ia r 3i Ia g 3i , Iau3i .
  • Ia r 23. Ia g 23, Iab23 Ia r 33, Ia g 33.
  • Iab33 Iab33
  • the converting unit 170 converts the image information of each pixel using a ratio of the image information of each pixel to the light adaptive value of each pixel (S250).
  • the light adaptive value computed using the luminance value, the global luminance adaptive value and the luminance adaptive value corresponds to a value related to luminance of each pixel, i.e. a value that the human vision mechanism responding to brightness is reflected.
  • the image information of each pixel is converted using a ratio value of the image information of each pixel to the light adaptive value, so that the image information is generated appropriate for the human vision mechanism.
  • the converted value of the image information of each pixel may be computed by the following Equation 6.
  • Equation 6 a is a constant equal to or greater than 0, r / 9/b ⁇ s
  • the r /d/b mav means a normalized image information of each pixel.
  • Equation 6 is related to modelling a sensing type of the human eye, in particular the cones for discerning color in HVS (Human Vision System), and corresponds to equation for abstracting functionally an adaptation phenomenon of a photoreceptor.
  • the resulting value of the above Equation 6 corresponds to a conversion value of each pixel.
  • the constant 'a' is a constant value for preventing the case that a denominator becomes 0.
  • the constant may be 0.
  • the constant 'gam' is generally used to correct a unique value in a physical equipment, and thus is determined according to application embodiment or usage environment. In the case that gamma correction is not necessary, the constant
  • 'gam' may be set to 1.
  • m is a correction constant for correcting color distortion, and may be inputted by a user or stored in an internal system and utilized according to embodiment.
  • the constant is used to complement for distortion of a color information in the image information using a value between 0 and 1 to reduce a partial color distortion phenomenon.
  • Equation 6 Equation 6
  • the denormalization unit 180 denormalizes the normalized image information (S260). Thus, a series of processes of a non-linear tone mapping method are completed. [0097] As mentioned above, in the case that normalization is omitted, the denormalization is not necessary.
  • FIG. 4 is a view illustrating the resultant image (b) converted by the present invention and the original object image (a). As shown in FIG. 4, naturalness of the whole color of the object image was maintained and a low luminous intensity area was corrected.
  • each component of the non-lineartone mapping apparatus according to the present invention is not divided physically, but logically. That is, each component corresponds to a logic component for realizing the technical spirit of the present invention, and thus it should be interpreted that it is in the range of the present invention if a function performed by a logic configuration of the present invention is realized, although the component is operated integrally or separately.
  • the non-linear tone mapping method according to the present invention may be incorporated as a computer readable code in a computer readable medium.
  • the computer readable medium includes all kinds of storage devices for storing data readable by a computer system.
  • the computer readable medium is ROM (Read Only Memory), RAM (Random Access Memory), CD-ROM (Compact Disc Read Only Memory); a magnetic tape, a floppy disc or an optical data storage device, and may be incorporated in the form of a carrier wave (for example, transmission via the Internet).
  • the computer readable medium may store and execute a code that is dispersed in computer systems connected to each other via a network and is readable by a computer through a dispersion method. Further, function program, code and code segments for implementing the non-linear tone mapping method may be easily inferred by programmers in the prior art.
  • the non-linear tone mapping apparatus and method according to the present invention reflects the human vision system on image processing, thereby correcting a low luminous intensity area without the whole color change.
  • the present invention allows a natural gradation from a low luminous intensity to a high luminous intensity, thereby overcoming an artificial and compulsory image processing.
  • the present invention overcomes the situation that it is difficult to discern an object in the case that the object is taken by an image obtaining device in a dark place or the object located at a shaded area is taken by an image obtaining device even in a bright place, and is additionally applied to a general AE (Auto Exposure), thereby providing an easier image obtaining method.
  • AE Auto Exposure

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Picture Signal Circuits (AREA)
  • Facsimile Image Signal Circuits (AREA)

Abstract

The present invention provides non-linear tone mapping apparatus and method and a computer readable medium stored thereon computer executable instructions for performing the method. The non-linear tone mapping apparatus according to the present invention comprises a luminance value computing unit for computing a luminance value of each pixel of an object image using an image information of each pixel; a computing unit for computing a light adaptive value of each pixel using the image information and luminance value of each pixel, the light adaptive value representing the degree of response to brightness of the image in the image information of each pixel; and a converting unit for converting the image information of each pixel of the object image using a ratio of the image information of each pixel to the light adaptive value.

Description

NON-LINEAR TONE MAPPING APPARATUS AND METHOD AND COMPUTER
READABLE MEDIUM STORED THEREON COMPUTER EXECUTABLE
INSTRUCTIONS FOR PERFORMING THE METHOD
CLAIM OF PRIORITY [0001] This application claims priority under 35 USC §119(a) to Korean Patent
Application No. 10-2007-0063503, filed on June 27, 2007, in the Korean Intellectual Property Office, the entire contents of which are hereby incorporated by reference.
TECHNICAL FIELD
[0002] The present invention relates to apparatus and method for correcting a low luminous intensity area of an input image, and in particular, to apparatus and method for providing a converted image having higher visual perception according to human visual perception system.
BACKGROUND ART [0003] With increasing interest in digital image processing, various image processing technologies, apparatus or techniques are suggested. The image processing is utilized in various industries to improve the human visual perception. [0004] The image processing includes feature extraction, image enhancement, image restoration, image reconstruction, image analysis, image recognition or image compression. The image processing employs techniques appropriate for its objects mentioned above. l
[0005] In the case that an image of an object is taken under limited conditions such as a physical limitation of an image pickup device, characteristic of the object or various external environments where the object is located, the effects of the limited conditions are reflected on the resultant image.
[0006] A method fόr' correcting a luminous intensity of an area of an image is used to address the above-mentioned image enhancement problem. To reflect an actual appearance of an object to increase human perception to the resultant image of the object, various methods are suggested, for example histogram stretching, gamma correction, algebra conversion or compulsory adjustment of brightness coefficient value. '
[0007] Among the conventional methods, stretching in image processing is represented by the following Equation 1.
[0008] Equation 1
Figure imgf000003_0001
[0009] In the Equation 1 , g(x,y) is a stretched image information, f(x,y) is an original image information, gmax is a maximum value of a pixel, and gmin is a minimum value of a pixel. The stretching is a technique for processing an image by the above-mentioned equation, and adjusts to stretch a pixel value distribution of an image having a low contrast more widely.
[0010] And, the gamma correction or algebra conversion uses a specific function such as an exponential function or a log function, in which an original image information is an independent variable and a function value of the function is a dependent variable, and the function value corresponds to the resultant image.
[0011] However, the above-mentioned techniques do not take into account the characteristic of the entire image based on human perception to brightness of the image, and uses a method for uniformly changing brightness information of the image by conversion to increase the luminous intensity of a low luminous intensity area. [0012] In this case, a'dark area may be expressed as a bright area, however the brightness and color of the entire image is changed, or the brightness and the color of the original image is considerably influenced by distortion of image information such as color twist of a specific area.
DISCLOSURE [0013] The present invention was devised to solve the above-mentioned problems. An object of the present invention is to provide an apparatus and a method, which corrects a low luminous intensity area by matching brightness of the low luminous intensity area with an equal or similar level to an image information value of a bright image, thereby overcoming error in color information and making the brightness gradation of an entire image natural.
[0014] Another object of the present invention is to provide a computer readable medium stored thereon computer executable instructions for performing the above-mentioned method. [0015] These and other features, aspects, and advantages of the present invention will be more fully described in the preferred embodiments of the present invention. And, the objects and advantages of the present invention can be implemented by configurations recited in the claims singularly or in combination. [0016] To achieve the above-mentioned objects, a non-linear tone mapping apparatus according to the present invention comprises a luminance value computing unit for computing a luminance value of each pixel of an object image using an image information of each pixel; a cbmputing unit for computing a light adaptive value of each pixel using the image information and luminance value of each pixel, the light adaptive value representing the degree of response to brightness of the image in the image information of each pixel; and a converting unit for converting the image information of each pixel of the object image using a ratio of the image information to the light adaptive value for each pixel.
[0017] And, the computing unit may include a luminance adaptive value computing unit for computing a luminance adaptive value of each pixel using the image information of each pixel and the luminance value of each pixel; a global luminance adaptive value computing unit for computing a global luminance adaptive value of the object image using a statistical computation value of the image information and a statistical computation value of the luminance value; and a light adaptive value computing unit for computing a light adaptive value corresponding to the image information of each pixel using the luminance adaptive value of each pixel and the global luminance adaptive value.
[0018] Further, the non-linear tone mapping apparatus further comprises a normalization unit for normalizing the image information of each pixel of the object image; and a denormalization unit for denormalizing the image information of each pixel converted by the converting unit, and the computing unit may be configured to compute a luminance value using the image information of each pixel normalized by the normalization unit.
[0019] Meanwhile, to achieve the above-mentioned objects, a non-linear tone mapping method comprises a luminance value computing step of computing a luminance value of each pixel of an object image using an image information of each pixel; a light adaptive value computing step of computing a light adaptive value of each pixel using the image information and luminance value of each pixel, the light adaptive value representing the degree of response to brightness of the image in the image information of each pixel; and a converting step of converting the image information of each pixel of the object image using a ratio of the image information to the light adaptive value for each pixel.
BRIEF DESCRIPTION OF THE DRAWINGS [0020] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to the description, it should be understood that the terms used in the specification and the appended claims should not be construed as limited to general and dictionary meanings, but interpreted based on the meanings and concepts corresponding to technical aspects of the present invention on the basis of the principle that the inventor is allowed to define terms appropriately for the best explanation. [0021] FIG. 1 is a block diagram illustrating a non-linear tone mapping apparatus according to a preferred embodiment of the present invention. [0022] FIG. 2 is a block diagram illustrating a non-linear tone mapping apparatus according to another embodiment of the present invention.
[0023] FIG. 3 is a flow chart illustrating a non-linear tone mapping method according to a preferred embodiment of the present invention. [0024] FIG. 4 is a view illustrating results of image information converted by the present invention.
BEST MODE
[0025] While this specification contains many specifics, these should not be construed as limitations on the scope of any invention or of what may be claimed, but rather as descriptions of features that may be specific to particular embodiments of particular inventions. Certain features that are described in this specification in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
[0026] Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may,be directed to a subcombination or variation of a subcombination.
[0027] Generally, a color space of an image, essential to image processing may be expressed variously, for example RGB (Red, Green, Blue), CMYK (Cyan, Magenta, Yellow, Key (Black)), HS-family, CIE (The Commission Internationale d'Eclairage) or Y-family, according to point of view such as view toward color mixture or similarity to human vision system, and may be converted to another kind of color space by a simple mathematical conversion formula.
[0028] And, an input image includes a plurality of pixels, and each pixel has its unique image information (brightness, hue, saturation and so on). Generally, the image information has values of 0 to 255 and is indicated as information of 8 bit.
However, in alternative embodiments, the image information may be indicated as information of 10 bit or 12 bit depending on application conditions.
[0029] Therefore, it should be understood that a color space coordinate system used as an example in the present invention may be applicable to another color space coordinate equally or similarly, and a bit size of an image information of a pixel in the input image is just an Example of the present invention for description.
[0030] FIG. 1 is a block diagram illustrating a non-linear tone mapping apparatus according to a preferred embodiment of the present invention. FIG. 2 is a block diagram illustrating a non-linear tone mapping apparatus according to another embodiment of the present invention. FIG. 3 is a flow chart illustrating a non-linear tone mapping method according to a preferred embodiment of the present invention.
Referring to FIGs. 1 to 3, a non-linear tone mapping apparatus 100 according to the present invention comprises an input unit 110, a normalization unit 120, a luminance value computing unit 130, a computing unit 135, a converting unit 170 and a denormalization unit 180.
[0031] The input unit 110 receives an input object image for conversion (S200), and serves as an interface for transmitting the input object image to another configuration of the present invention. [0032] Prior to describing a configuration of the present invention in detail, the human vision system used to correct an image information of a low luminous intensity area is described briefly.
[0033] The term, 'adaptation' means adjusting the condition of the human visual system to increase the visual perception to an object, variable according to amount of light incident upon the human eye and power spectral distribution of the light.
[0034] Luminance (brightness) adaptation includes light adaptation and dark adaptation. The light adaptation means that in the case of a sudden movement to higher luminance, the eye becomes dark-adapted through decreases of the sensitivity. The dark adaptation means that in the case of a sudden movement to lower luminance, the eye becomes light-adapted through increases of the sensitivity. [0035] And, color adaptation or chromatic adaptation means that the sensitivity of three kinds of cones changes according to spectral composition of an illuminating light and light on an object, and spectral sensitivity of the human visual system changes accordingly. Thus, the human eye sees color uniformly. Through color adaptation, the human eye controls the change of color caused by change of a light source to perceive the color as original. [0036] The present invention corrects a low luminous intensity area based on light and mechanism of human visual perception to allow a more natural image correction without distortion of image information.
[0037] The normalization unit 120 according to the present invention normalizes an image information of each pixel of the object image inputted through the input unit 110 (S210).; In' alternative embodiments, normalization may be not performed, and in this case, the object image inputted through the input unit 110 is inputted into the luminance value computing unit 130. This embodiment uses the normalized image information, however alternative embodiments may use an image information that is not passed through normalization. [0038] Normalization maps a statistical sample value that may have various values to a value between 0 and 1. Typically, the normalized value is expressed as (function value-min)/(max-min).
[0039] All statistical values are normalized between 0 and 1 by the above-mentioned mathematical expression. Normalization adjusts all input variables to be calculated within a predetermined range, thereby increasing calculation efficiency.
[0040] For convenience of description, a 3 x 3 object image shown in the following Table 1 is taken as an example.
[0041] Table 1
Figure imgf000008_0001
[0042] The object image has an image information expressed as RGB for each pixel. However, as mentioned above, it is obvious that the image information may be expressed as various color spaces.
[0043] The normalization unit 120 normalizes an image information of each pixel of the object image shown in the above Table 1 using a mathematical formula such as (image information value-min)/(max-min). The following Table 2 shows the normalized image information that is expressed as "I".
[0044] Table 2
IrI I , Igi i > IbI I Ir12, Ig12, IbI 2 Ir13, Ig13, IbI 3
Ir21 , IQ21 , Ib21 Ir22, Ig22, Ib22 If23, Ig23, Ib23
If31 , IQ31 , Ib31 If 32, Ig32, Ib32 If 33, Ig33, Ib33
[0045] The normalized jmage information is inputted into the luminance value computing unit 130. The luminance value computing unit 130 computes a luminance value of each pixel using the normalized image information of each pixel of the object image (S220).
[0046] Preferably, a method for computing a luminance value using the normalized image information uses the following Equation 2. [0047] Equation 2
L = AxIr + BxIg + CxIb
[0048] In the Equation 2, L is a luminance value of each pixel, and Ir, Ig, and Ib are normalized image information for each R, G and B of each pixel and has a value between 0 and 1. A, B and C are weight constants of the image information, A is a user input constant set between 0.15 and 0.20, B is a user input constant set between 0.65 and 0.75, and C is a user input constant set between 0.05 and 0.15. [0049] That is, preferably a weight value for an image information of GREEN among the normalized image information is reflected the most highly, for example about 70%. The luminance value of green, the color that the human eye feels most comfortable with, is assigned the highest weight. A preferred luminance computation equation obtained through an experimental example is L = 0.2125 Ir + 0.7154 Ig + 0.0721 Ib. [0050] The luminance value may be set as an average value of RGB image information, however preferably the luminance value uses a coefficient value in such a form that a visual receptor of human actually receives by the above equation.
[0051] And, the user input constant may be provided by another module in the
apparatus, or may be directly inputted by an operator such as a user through an
external interface. [0052] The luminance value computed for each pixel is shown in the following
Table 3.
[0053] Table 3
Figure imgf000009_0001
[0054] The computing unit 135 computes a light adaptive value representing the degree of response to brightness of the image in the image information of each pixel using the luminance value of each pixel computed by the luminance value computing unit 130 and the image information of each pixel (S225). [0055] As mentioned above, to eliminate a one-to-one pixel conversion by applying a function having a linear property, a light adaptive value on which the degree of response of human vision system to brightness of the image is reflected, is computed as a factor. The computed light adaptive value is inputted into the converting unit 170 later and is used as a standard for pixel conversion. [0056] The above-mentioned method allows image conversion appropriate for a mechanism of human visual perception. In the case that an image conversion is performed using different light adaptive values for each pixel, a specific correction value for brightness such as luminance of each pixel can be computed. [0057] The light adaptive value computed by the above-mentioned method uses statistical values of luminance for the whole brightness of the object image to compute an accurate light correction value in harmony with all the pixels of the object image. For this purpose, the computing unit 135 according to a preferred embodiment of the present invention may include a global luminance adaptive value computing unit 140, a luminance adaptive value computing unit 150 and a light adaptive value computing unit 160. [0058] The luminance adaptive value computing unit 150 computes a luminance adaptive value of each pixel using the image information of each pixel and the luminance value of each pixel (S230).
[0059] The luminance adaptive value indicates the degree of relation between the image information of each pixel and the luminance value of each pixel, and reflects chromatic adaptation. The luminance adaptive value is computed using a value obtained by applying weight values to the normalized image information of each pixel and the luminance value of each pixel, with the sum of the weight values being
1.
[0060] Specifically, tKe luminance adaptive value computed by the luminance adaptive value computing unit 150 is represented by the following Equation 3.
[0061] Equation 3
!local = b I + { l _ h) L local
[0062] In the Equation 3, / a is a luminance adaptive value of each pixel,
b is a user input constant between 0 and 1 , L is a luminance value, and r' 9/b \s normalized R1G1 B image information of each pixel.
[0063] In the case that b is 0, a luminance adaptive value of a corresponding pixel is a luminance value of the pixel itself. In the case that b is 1 , a luminance adaptive value of a corresponding pixel is a channel image information value of the pixel. The constant 'b' is a user input value that reflects the degree of chromatic adaptation in the above-mentioned range.
[0064] The luminance adaptive value computed by the Equation 3 is shown in the following Table 4.
[0065] Table 4
Figure imgf000011_0001
[0066] As shown in the Table 4, the luminance adaptive value is computed for each channel (RGB) of each pixel. That is, in the case of a 3 x 3 matrix, 9 pixels exist and each pixel has 3 (RGB) image information, and thus 27 local luminance adaptive values are computed.
[0067] And, the global luminance adaptive value computing unit 140 of the present invention computes a global luminance adaptive value of the object image using a statistical computation value of the image information and a statistical computation value of the luminance value or using a value obtained by applying weight values to a statistical-computation value of the normalized image information of each pixel and a statistical computation value of the luminance value of each pixel, with the sum of the weight values being 1 (S230).
[0068] As mentioned above, the luminance adaptive value indicates the degree of relation between the image information for each channel of each pixel and the luminance value, and reflects chromatic adaptation. The global luminance adaptive value means the statistical value of all the pixels, and is not computed by unit of pixel. The global luminance adaptive value reflects statistical and general chromatic adaptation of all the pixels.
[0069] Therefore, the global luminance adaptive value uses a statistical computation value of the image information and a statistical computation value of the luminance value, and preferably is computed by the following Equation 4.
[0070] Equation 4
Figure imgf000012_0001
j global
[0071] In the Equation 4, « js a global luminance adaptive value,
- av 7"IsI* is a statistical computation value of the normalized R, G, B image γav information of each pixel, and I^ is a statistical computation value of the luminance value, and c is a user input constant between 0 and 1. [0072] The statistical computation value may be one of various statistical computation values representing a statistical property of the image information and the luminance value. However, preferably a statistical average value, i.e. an average value of the image information of each pixel and an average value of the luminance value of each pixel is used, thereby reflecting an algebraically general value. [0073] The global luminance adaptive value computed by the global luminance adaptive value computing unit 140 is shown in the following Table 5. [0074] Table 5
AVERAGE VALUE OF LUIINANCE, L" (L1, + L|2 + L13 + + L32 + L33) / 9
T (XO
(IrII + IrK * > w + IrSI + Ir-Z + IrtS + U + Ir« + 1«) / 9
(I8H + Igiz + I8IS + + I8SI + Igffi ÷w / 9
T OO ' " ' -
J b (Ib.. H I- Ibi? + Ibis + +IbM + IbM / 9
GLOBAL LUMINANCE ADAPTIVE VALUE jφtol j≠*al{g)
[0075] As shown in the^Table 5, the global luminance adaptive value is computed for each channel information, and thus 3 global luminance adaptive values are computed.
[0076] After the luminance adaptive value of each pixel and the global luminance adaptive value are computed, the light adaptive value computing unit 160 computes a light adaptive value corresponding to the image information of each pixel using the luminance adaptive value of each pixel and the global luminance adaptive value (S240).
[0077] The light adaptive value indicates the relation between the luminance adaptive value of each pixel and the global luminance adaptive value of the object pixel, and thus changes together with the whole characteristic of the image in the case of change of the image information.
[0078] That is, the light adaptive value is computed using a value obtained by applying weight values to the luminance adaptive value of each pixel and the global luminance adaptive value1, with the weight values being 1. Specifically, the light adaptive value is computed by the following Equation 5.
[0079] Equation 5
Ia = dl^ocal+ (l - d)la 9lobal j-local
[0080] In the Equation 5, Ia is a light adaptive value, « is a luminance
T global adaptive value of each pixel, « is a global luminance adaptive value, and d is a user input constant between 0 and 1.
[0081] As shown in the Table 4, the number of luminance adaptive values, j local
1 a , of all the pixels is 27 (R: 9, G: 9, B: 9), and as shown in the Table 5, the j global number of global luminance adaptive values, a is 3 (R, G, B).
[0082] Therefore, the number of light adaptive values is 27, and the computed light adaptive values are shown in the following Table 6.
[0083] Table 6 Iari 1 , Iagi i , Iabn Iari2, Iagi2, lab 12 Iari3. IaBi3, lab 13
Iar2i , Iag2i , Iab2i Iar22, Iag22, Iab22 Iar23, Iag23, Iab23
Iar3i , Iag3i , Iau3i . Iar23. Iag23, Iab23 Iar33, Iag33. Iab33
[0084] After the light adaptive value is computed, the converting unit 170 according to the present invention converts the image information of each pixel using a ratio of the image information of each pixel to the light adaptive value of each pixel (S250).
[0085] As mentioned above, the light adaptive value computed using the luminance value, the global luminance adaptive value and the luminance adaptive value corresponds to a value related to luminance of each pixel, i.e. a value that the human vision mechanism responding to brightness is reflected. Thus, the image information of each pixel is converted using a ratio value of the image information of each pixel to the light adaptive value, so that the image information is generated appropriate for the human vision mechanism.
[0086] And, to reflect the human vision mechanism more delicately, the converted value of the image information of each pixel may be computed by the following Equation 6.
[0087] Equation 6
Figure imgf000014_0001
[0088] In the Equation 6, a is a constant equal to or greater than 0, r/ 9/b \s
an image information of each pixel, gam is a gamma input constant, α is the light adaptive value, f is a light adaptive value converting function, and m is a color distortion correcting input constant. In the case that normalized image information is used according to an embodiment of the present invention, the r/d/b mav means a normalized image information of each pixel.
[0089] The above Equation 6 is related to modelling a sensing type of the human eye, in particular the cones for discerning color in HVS (Human Vision System), and corresponds to equation for abstracting functionally an adaptation phenomenon of a photoreceptor.
[0090] The resulting value of the above Equation 6 corresponds to a conversion value of each pixel. In the Equation 6, the constant 'a' is a constant value for preventing the case that a denominator becomes 0. In the case that a value of another term corresponding to a denominator of the Equation 6 is equal to or greater than 0, the constant may be 0. And, it is possible to set the constant to a small number approximate to 0.
[0091] The constant 'gam' is generally used to correct a unique value in a physical equipment, and thus is determined according to application embodiment or usage environment. In the case that gamma correction is not necessary, the constant
'gam' may be set to 1.
[0092] The function f is a conversion function, and may be expressed as various functions, for example a function (f(x)=x), in which the light adaptive value is an independent variable and the independent variable is converted as it is to adjust the degree of conversion of the light adaptive value. Preferably, the function is incorporated into an exponential function, i.e. f(x)=exp(-x) to increase the width of image change ratio.
[0093] And, in the Equation 6, m is a correction constant for correcting color distortion, and may be inputted by a user or stored in an internal system and utilized according to embodiment. The constant is used to complement for distortion of a color information in the image information using a value between 0 and 1 to reduce a partial color distortion phenomenon.
[0094] That is, in the case that m is set to 1 and the conversion function is f(x) = exp(-x), the Equation 6 is represented as follows. [0095] Equation 7
Figure imgf000016_0001
[0096] After the converted value is computed, the denormalization unit 180 denormalizes the normalized image information (S260). Thus, a series of processes of a non-linear tone mapping method are completed. [0097] As mentioned above, in the case that normalization is omitted, the denormalization is not necessary.
[0098] FIG. 4 is a view illustrating the resultant image (b) converted by the present invention and the original object image (a). As shown in FIG. 4, naturalness of the whole color of the object image was maintained and a low luminous intensity area was corrected.
[0099] As such, a non-linear tone mapping apparatus according to the present invention was described in detail. However, it should be understood that each component of the non-lineartone mapping apparatus according to the present invention is not divided physically, but logically. That is, each component corresponds to a logic component for realizing the technical spirit of the present invention, and thus it should be interpreted that it is in the range of the present invention if a function performed by a logic configuration of the present invention is realized, although the component is operated integrally or separately. [00100] The non-linear tone mapping method according to the present invention may be incorporated as a computer readable code in a computer readable medium. The computer readable medium includes all kinds of storage devices for storing data readable by a computer system. For example, the computer readable medium is ROM (Read Only Memory), RAM (Random Access Memory), CD-ROM (Compact Disc Read Only Memory); a magnetic tape, a floppy disc or an optical data storage device, and may be incorporated in the form of a carrier wave (for example, transmission via the Internet). And, the computer readable medium may store and execute a code that is dispersed in computer systems connected to each other via a network and is readable by a computer through a dispersion method. Further, function program, code and code segments for implementing the non-linear tone mapping method may be easily inferred by programmers in the prior art.
[00101] Only a few implementations and examples are described and other implementations, enhancements and variations can be made based on what is described and illustrated in this application.
[00102] The non-linear tone mapping apparatus and method according to the present invention reflects the human vision system on image processing, thereby correcting a low luminous intensity area without the whole color change.
[00103] And, the present invention allows a natural gradation from a low luminous intensity to a high luminous intensity, thereby overcoming an artificial and compulsory image processing. [00104] That is, the present invention overcomes the situation that it is difficult to discern an object in the case that the object is taken by an image obtaining device in a dark place or the object located at a shaded area is taken by an image obtaining device even in a bright place, and is additionally applied to a general AE (Auto Exposure), thereby providing an easier image obtaining method.

Claims

What is claimed is:
1. A non-linear tone mapping apparatus, comprising: a luminance value computing unit for computing a luminance value of each pixel of an object image using an image information of each pixel; a computing unit for computing a light adaptive value of each pixel using the image information and luminance value of each pixel, where the light adaptive value represents each pixel's degree of response to brightness of the image; and a converting unit for converting the image information of each pixel using a ratio of the image information to the light adaptive value of each pixel.
2. The non-linear tone mapping apparatus according to claim 1 , wherein the computing unit comprises: a luminance adaptive value computing unit for computing a luminance adaptive value of each pixel using the image information of each pixel and the luminance value of each pixel; a global luminance adaptive value computing unit for computing a global luminance adaptive value of the object image using a statistical computation value of the image information and a statistical computation value of the luminance values; and a light adaptive value computing unit for computing the light adaptive value corresponding to the image information of each pixel using the luminance adaptive value of each pixel and the global luminance adaptive value.
3. The non-linear tone mapping apparatus according to claim 2, further comprising: a normalization unit for normalizing the image information of each pixel of the object image; and a denormalization unit for denormalizing the image information of each pixel converted by the converting unit, wherein the luminance value computing unit computes the luminance value using the image information of each pixel normalized by the normalization unit.
4. The non-linear tone mapping apparatus according to claim 2, wherein the statistical computation value of the image information is an average value of the image information, and the statistical computation value of the luminance value is an average value of the luminance values.
5. The non-linear tone mapping apparatus according to claim 3, wherein the luminance adaptive value computing unit computes the luminance adaptive value using a first value and a second value, where the first value is the product of applying a first weight to the normalized image information of each pixel, and the second value is the product of applying a second weight to the luminance value of each pixel, where a sum of the first weight and the second weight is 1.
6. The non-linear tone mapping apparatus according to claim 3, wherein the global luminance adaptive value computing unit computes the global luminance adaptive value using a third value and a fourth value, where the third value is the product of applying a third weight to the statistical computation value of the normalized image information of each pixel, and the fourth value is the product of applying a fourth weight to the statistical computation value of the luminance value of each pixel, where a sum of the third weight and the fourth weight is 1.
7. The non-linear tone mapping apparatus according to claim 3, wherein the light adaptive value computing unit computes the light adaptive value using a fifth value and a sixth value, where the fifth value is the product of applying a fifth weight to the luminance adaptive value of each pixel, and the sixth value is the product of applying a sixth weight to the global luminance adaptive value, where a sum of the fifth weight and the sixth weight is 1.
8. The non-linear tone mapping apparatus according to claim 1 , wherein the converting unit converts the image information of each pixel using a value obtained by applying gamma correction to a ratio of the image information and a denominator value, where the denominator value is calculated using a function result value and the image information, where the function result value is obtained by applying a conversion function to the light adaptive value, where the conversion function is capable of adjusting a degree of conversion of the light adaptive value.
9. The non-linear tone mapping apparatus according to claim 8, wherein the function result value is a value obtained by applying an exponential function of a color correction constant to the light adaptive value.
10. The non-linear tone mapping apparatus according to claim 8, wherein the conversion function is an exponential function.
11. A non-linear tone mapping method, comprising: a luminance value computing step of computing a luminance value of each pixel of an object image using an image information of each pixel; a light adaptive value computing step of computing a light adaptive value of each pixel using the image information and luminance value of each pixel, where the light adaptive value represents each pixel's degree of response to brightness of the image; and a converting step of converting the image information of each pixel using a ratio of the image information to the light adaptive value of each pixel.
12. The non-linear tone mapping method according to claim 11 , wherein the light adaptive value computing step comprises: a luminance adaptive value computing step of computing a luminance adaptive value of each pixel using the image information of each pixel and the luminance value of each pixel; a global luminance adaptive value computing step of computing a global luminance adaptive value of the object image using a statistical computation value of the image information and a statistical computation value of the luminance values; and a light adaptive value computing step of computing the light adaptive value corresponding to the image information of each pixel using the luminance adaptive value of each pixel and the global luminance adaptive value.
13. The non-linear tone mapping method according to claim 12, further comprising: a normalization step of normalizing the image information of each pixel of the object image; and a denormalization step of denormalizing the image information of each pixel converted in the converting step, wherein the luminance value computing step computes the luminance value using the image information of each pixel normalized in the normalization step.
14. The non-linear tone mapping method according to claim 12, wherein the statistical computation value of the image information is an average value of the image information, and the statistical computation value of the luminance value is an average value of the luminance values.
15. The non-linear tone mapping method according to claim 13, wherein the luminance adaptive value computing step computes the luminance adaptive value using a first value and a second value, where the first value is the product of applying a first weight to the normalized image information of each pixel, and the second value is the product of applying a second weight to the luminance value of each pixel, where a sum of the first weight and the second weight is 1.
16. The non-linear tone mapping method according to claim 13, wherein the global luminance adaptive value computing step computes the global luminance adaptive value using a third value and a fourth value, where the third value is the product of applying a third weight to the statistical computation value of the normalized image information of each pixel, and the fourth value is the product of applying a fourth weight to the statistical computation value of the luminance value of each pixel, where a sum of the third weight and the fourth weight is 1.
17. The non-linear tone mapping method according to claim 13, wherein the light adaptive value computing step computes the light adaptive value using a fifth value and a sixth value, where the fifth value is the product of applying a fifth weight to the luminance adaptive value of each pixel, and the sixth value is the product of applying a sixth weight to the global luminance adaptive value, where a sum of the fifth weight and the sixth weight is 1.
18. The non-linear tone mapping method according to claim 11 , wherein the converting step converts the image information of each pixel using a value obtained by applying gamma correction to a ratio of the image information and a denominator value, where the denominator value is calculated using a function result value and the image information, where the function result value is obtained by applying a conversion function to the light adaptive value, where the conversion function is capable of adjusting a degree of conversion of the light adaptive value.
19. The non-linear tone mapping method according to claim 18, wherein the function result value is a value obtained by applying an exponential function of a color correction constant to the light adaptive value.
20. The non-linear tone mapping method according to claim 18, wherein the conversion function is an exponential function.
21. A computer readable medium stored thereon computer executable instructions for performing the non-linear tone mapping method defined in claim 11.
PCT/KR2008/003730 2007-06-27 2008-06-27 Non-linear tone mapping apparatus and method and computer readable medium stored thereon computer executable instructions for performing the method WO2009002121A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN2008800222156A CN101690169B (en) 2007-06-27 2008-06-27 Non-linear tone mapping apparatus and method
JP2010514624A JP2010531513A (en) 2007-06-27 2008-06-27 Non-linear undertone correction apparatus, method, and computer-readable recording medium containing computer execution instructions for performing the method
EP08766651A EP2163087A4 (en) 2007-06-27 2008-06-27 Non-linear tone mapping apparatus and method and computer readable medium stored thereon computer executable instructions for performing the method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2007-0063503 2007-06-27
KR1020070063503A KR100900694B1 (en) 2007-06-27 2007-06-27 Apparatus and method for correcting a low tone with non-linear mapping and computer readable medium stored thereon computer executable instruction recorded with time-series data structure

Publications (1)

Publication Number Publication Date
WO2009002121A1 true WO2009002121A1 (en) 2008-12-31

Family

ID=40160585

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2008/003730 WO2009002121A1 (en) 2007-06-27 2008-06-27 Non-linear tone mapping apparatus and method and computer readable medium stored thereon computer executable instructions for performing the method

Country Status (6)

Country Link
US (1) US8300931B2 (en)
EP (1) EP2163087A4 (en)
JP (1) JP2010531513A (en)
KR (1) KR100900694B1 (en)
CN (1) CN101690169B (en)
WO (1) WO2009002121A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011014170A1 (en) * 2009-07-30 2011-02-03 Hewlett-Packard Development Company, L.P. Method for tone mapping an image

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101517360B1 (en) * 2008-12-05 2015-05-04 삼성전자주식회사 Apparatus and method for enhancing image based on luminance information of pixel
US8483479B2 (en) * 2009-05-11 2013-07-09 Dolby Laboratories Licensing Corporation Light detection, color appearance models, and modifying dynamic range for image display
JP5296253B2 (en) * 2012-10-22 2013-09-25 浜松ホトニクス株式会社 Laser packaging method and resin film packaging product manufacturing method
KR20140141328A (en) 2013-05-31 2014-12-10 삼성디스플레이 주식회사 Display device and protecting method of the same
KR101348220B1 (en) * 2013-07-23 2014-01-06 (주)나임기술 Apparatus and method for improving illumination
KR102234092B1 (en) * 2013-12-27 2021-04-01 인터디지털 매디슨 페턴트 홀딩스 에스에이에스 Method for inverse tone mapping of an image
US9307120B1 (en) * 2014-11-19 2016-04-05 Himax Imaging Limited Image processing system adaptable to a dual-mode image device
CN105791906A (en) * 2014-12-15 2016-07-20 深圳Tcl数字技术有限公司 Information pushing method and system
CN107680068A (en) * 2017-08-31 2018-02-09 田其冲 A kind of digital image enhancement method for considering image naturalness
KR102022234B1 (en) * 2018-03-20 2019-11-04 주식회사 만도 Apparatus for image enhancement and method thereof
CN108898564A (en) * 2018-07-06 2018-11-27 中国科学院光电技术研究所 A kind of high dynamic range image tone mapping method based on visual model and WLS filter
CN111292269B (en) * 2020-02-13 2023-09-01 珠海全志科技股份有限公司 Image tone mapping method, computer device, and computer-readable storage medium
CN111508443B (en) * 2020-05-29 2021-08-24 京东方科技集团股份有限公司 Display device and backlight brightness control method and device thereof

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10164396A (en) * 1996-11-29 1998-06-19 Samsung Electron Co Ltd Method for adaptively correcting contour component of luminance signal and correction circuit
JPH10215385A (en) * 1997-01-30 1998-08-11 Fuji Photo Film Co Ltd Color conversion method for image
KR20040048791A (en) * 2002-12-03 2004-06-10 삼성전자주식회사 Apparatus and Method for adaptive brightness control
JP2004222024A (en) * 2003-01-16 2004-08-05 Fuji Photo Film Co Ltd Imaging device
US20050134705A1 (en) * 2003-12-22 2005-06-23 Moon-Cheol Kim Digital image processing apparatus and method thereof

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ATE205621T1 (en) * 1998-04-03 2001-09-15 Da Vinci Systems Inc DEVICE FOR GENERATING ADAPTED GAMMA CURVES FOR A COLOR CORRECTION SYSTEM
US6717698B1 (en) * 2000-02-02 2004-04-06 Eastman Kodak Company Tone scale processing based on image modulation activity
JP2002230546A (en) * 2001-01-30 2002-08-16 Fujitsu Ltd Image processing program, computer readable storage medium storing it, and image processing method and device
US7283662B1 (en) * 2002-11-19 2007-10-16 Adobe System Incorporated Protecting colors from clipping
US20040109091A1 (en) * 2002-12-03 2004-06-10 Samsung Electronics Co., Ltd. Apparatus and method for adaptive brightness control
JP2005141527A (en) * 2003-11-07 2005-06-02 Sony Corp Image processing apparatus, image processing method and computer program
US7692666B1 (en) * 2004-04-07 2010-04-06 Adobe Systems Incorporated Constructing color profile for parameterized image color space
JP4341597B2 (en) * 2005-08-25 2009-10-07 セイコーエプソン株式会社 Gamma curve adjustment device and adjustment point setting method
US7639893B2 (en) * 2006-05-17 2009-12-29 Xerox Corporation Histogram adjustment for high dynamic range image mapping
KR100809347B1 (en) * 2006-07-31 2008-03-05 삼성전자주식회사 Method and apparatus for compensating shadow area
JP5003196B2 (en) * 2007-02-19 2012-08-15 ソニー株式会社 Image processing apparatus and method, and program
US7965300B2 (en) * 2007-11-15 2011-06-21 Sharp Laboratories Of America, Inc. Methods and systems for efficient white balance and gamma control

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10164396A (en) * 1996-11-29 1998-06-19 Samsung Electron Co Ltd Method for adaptively correcting contour component of luminance signal and correction circuit
JPH10215385A (en) * 1997-01-30 1998-08-11 Fuji Photo Film Co Ltd Color conversion method for image
KR20040048791A (en) * 2002-12-03 2004-06-10 삼성전자주식회사 Apparatus and Method for adaptive brightness control
JP2004222024A (en) * 2003-01-16 2004-08-05 Fuji Photo Film Co Ltd Imaging device
US20050134705A1 (en) * 2003-12-22 2005-06-23 Moon-Cheol Kim Digital image processing apparatus and method thereof

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, vol. 11, no. 1, January 2001 (2001-01-01)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011014170A1 (en) * 2009-07-30 2011-02-03 Hewlett-Packard Development Company, L.P. Method for tone mapping an image

Also Published As

Publication number Publication date
JP2010531513A (en) 2010-09-24
US20090003697A1 (en) 2009-01-01
KR20080114172A (en) 2008-12-31
EP2163087A1 (en) 2010-03-17
US8300931B2 (en) 2012-10-30
KR100900694B1 (en) 2009-06-04
CN101690169A (en) 2010-03-31
CN101690169B (en) 2012-01-25
EP2163087A4 (en) 2010-07-07

Similar Documents

Publication Publication Date Title
EP2163087A1 (en) Non-linear tone mapping apparatus and method and computer readable medium stored thereon computer executable instructions for performing the method
US6462835B1 (en) Imaging system and method
US7480421B2 (en) Rendering of high dynamic range images
JP3640989B2 (en) Exposure changing method and image processing system
US8941755B2 (en) Image processing device with automatic white balance
JP4266461B2 (en) Color illumination color temperature detection method and apparatus
US20150097985A1 (en) Compensating for sensor saturation and microlens modulation during light-field image processing
US20050163393A1 (en) Visibility improvement in color video stream
US9342872B2 (en) Color correction parameter computation method, color correction parameter computation device, and image output system
JP2000069310A (en) Method for processing images
JP4421438B2 (en) Image color balance correction system and method
US20030002059A1 (en) Automatic color balance
US20220222792A1 (en) Method and system for image enhancement
CN113170028A (en) Method for generating image data of imaging algorithm based on machine learning
US7064769B2 (en) Systems and methods for computing the presence of self-luminous elements in an image
Mazin et al. Estimation of illuminants from projections on the planckian locus
WO2022120799A9 (en) Image processing method and apparatus, electronic device, and storage medium
WO2019097937A1 (en) Image processing device, image processing method, and program, and image formation device
US20120293533A1 (en) Methods for creating gamma correction and tone mapping effects in a digital image
Choi et al. A perceptual tone mapping HDR images using tone mapping operator and chromatic adaptation transform
JP4881325B2 (en) Profiling digital image input devices
JP4370989B2 (en) Image processing apparatus, image processing method, and image processing program
Guarnieri et al. Color rendering in high dynamic range images
JP2005175785A (en) White balance processing method, white balance processing device, white balance processing program, digital image processing method, and digital image processing system

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200880022215.6

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08766651

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2010514624

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2008766651

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE