EP1287685A1 - A system and method for analyzing, optimizing and/or designing spectral sensitivity curves for an imaging device - Google Patents

A system and method for analyzing, optimizing and/or designing spectral sensitivity curves for an imaging device

Info

Publication number
EP1287685A1
EP1287685A1 EP01922637A EP01922637A EP1287685A1 EP 1287685 A1 EP1287685 A1 EP 1287685A1 EP 01922637 A EP01922637 A EP 01922637A EP 01922637 A EP01922637 A EP 01922637A EP 1287685 A1 EP1287685 A1 EP 1287685A1
Authority
EP
European Patent Office
Prior art keywords
spectral sensitivity
image quality
color
imaging device
set forth
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP01922637A
Other languages
German (de)
French (fr)
Inventor
Naoya Katoh
Noboru Ohta
Shuxue Quan
Mitchell Rosen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Rochester Institute of Technology
Original Assignee
Sony Corp
Rochester Institute of Technology
University of Rochester
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp, Rochester Institute of Technology, University of Rochester filed Critical Sony Corp
Publication of EP1287685A1 publication Critical patent/EP1287685A1/en
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • H04N17/02Diagnosis, testing or measuring for television systems or their details for colour television signals
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J3/50Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J3/52Measurement of colour; Colour measuring devices, e.g. colorimeters using colour charts
    • G01J3/524Calibration of colorimeters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • H04N17/002Diagnosis, testing or measuring for television systems or their details for television cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J2003/466Coded colour; Recognition of predetermined colour; Determining proximity to predetermined colour
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J3/462Computing operations in or between colour spaces; Colour management systems
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J3/465Measurement of colour; Colour measuring devices, e.g. colorimeters taking into account the colour perception of the eye; using tristimulus detection
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J3/50Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors
    • G01J3/51Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors using colour filters

Definitions

  • the invention relates generally to imaging and, more particularly, to a method and system for evaluating, optimizing and/or designing one or more spectral sensitivity curves for an imaging device.
  • digital imaging devices or systems such as a digital camera or color scanner
  • these digital devices comprise a charge-coupled device or complementary metal- oxide-semiconductor (CCD/CMOS) sensor array with a set of filters before it.
  • CCD/CMOS complementary metal- oxide-semiconductor
  • these digital imaging devices capture color images in a substantially accurate and aesthetically pleasing manner.
  • CIE Commission Internationale de l'Eclairage
  • the spectral sensitivity functions for color imaging device channels should satisfy the Luther condition, that is the channel spectral sensitivities need not be exact duplicates of the CIE color-matching functions described above, but need to be a nonsingular transformation of them.
  • the channel spectral sensitivities need not be exact duplicates of the CIE color-matching functions described above, but need to be a nonsingular transformation of them.
  • Measurement noise also plays an important role and will degrade the color accuracy even when spectral sensitivity curves fulfill the Luther condition.
  • a measure of goodness or quality factor for evaluating, optimizing, and/or designing spectral sensitivity curves for color imaging devices is desirable.
  • developing methods and/or systems for obtaining a measure of goodness or a quality factor has been challenging.
  • ⁇ -factor Quality factor for filters whose spectral transmittances are different from color mixture curves, and its application to color photography
  • J. Opt. Soc. Am. Vol. 46, No.10, pg. 821-824 (1956) which is herein incorporated by reference.
  • a major disadvantage of the Q-factor is that it is designed to evaluate only single spectral sensitivities. Thus, it is easily possible to design an imaging device where all channels associate with high Q-factors, and still the system delivers color signals which cannot be used in creating high quality color reproductions.
  • the trivial example of such a system is a three-channel device where all three channels are made with small deviations from the same spectral sensitivity signature. Although all three show high O-factor, the result is a nearly monochrome image.
  • Another quality factor, known as the ⁇ -factor, for evaluating and designing spectral sensitivity functions is disclosed in P. L. Nora and H. J. Trussell, "Measure of goodness of a set of color-scanning filters", J. Opt. Soc. Am. A, Nol.10, ⁇ o.7, pg. 1499-1503 (1993), which is herein incorporated by reference.
  • the ⁇ -factor is a quality factor which evaluates an arbitrary number of device channel sensitivity functions as an ensemble.
  • the ⁇ -factor describes the difference between the orthonormal subspaces of the CIE color matching functions and the spectral sensitivity space.
  • a ⁇ -factor approximately equal to one is an indication of an imaging device expected to deliver high quality color reproduction.
  • some color imaging devices with a poor ⁇ -factor can still generate a good image reproduction.
  • Nora and Trussell have thus introduced a metric which does not have a straight forward correlation with expected image quality.
  • Another problem with the ⁇ -factor is that it does not penalize systems that by virtue of channel sensitivity choices tend to amplify system noise. Such noise is unavoidable in real systems and a system designer needs to carefully control it so as to avoid swamping the eventual color reproduction.
  • CIELAB color space is a non-linear transfromation of the CIE color matching functions used as an approximation to a perceptually uniform color space.
  • a figure of merit for color scanners, based on locally-linearized CIELAB space, having an incorporated model for measurement of noise is present in G. Sharma et al. "Figure of merit for color scanners," IEEE Trans. Image Processing, Vol. 6, No. 7, pg. 990-1001 (1997) which is herein incorporated by reference.
  • the new figure has a high degree of perceptual relevance and also accounts for noise performance of sets of channel sensitivities.
  • the noise aspect of Sharma' s metric is, however completely independent of the input stimulus and thus is limited in its usefulness.
  • a method for determining a color rendering capability of at least one color imaging device with multiple color channels in accordance with one embodiment of the present invention includes a few steps. Spectral sensitivity curves for two or more of the multiple color channels in the color imaging device are obtained. An image quality value for the color imaging device is determined from the spectral sensitivity curves for the two or more of the multiple color channels in the color imaging device. The color rendering capability of the color imaging device can be evaluated based on the determined image quality value.
  • a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with another embodiment of the present invention includes selecting an image quality value and then determining a spectral sensitivity curve for at least one of the color channels of the color imaging device so that the spectral sensitivity curves for each of the color channels in the color imaging device results in the image quality value.
  • a method for determining the tolerances for one or more color channels in a color imaging device in accordance with another embodiment of the present invention includes a few steps.
  • a spectral sensitivity curve for at least one of the multiple color channels in the color imaging device and an image quality value are obtained.
  • a first pair of upper and lower peak wavelength tolerances from the obtained spectral sensitivity for the at least one of the multiple color channels and the obtained image quality value are determined.
  • a second pair of upper and lower tolerances on the width from the obtained spectral sensitivity curve for at least one of the multiple color channels and the obtained image quality value are determined.
  • An imaging device analyzing system in accordance with another embodiment of the present invention includes a source for spectral sensitivity curves for two or more of the multiple color channels in a color imaging device, an image quality processing system, and an evaluation system.
  • the image quality processing system determines an image quality value for the color imaging device from the spectral sensitivity curves for the two or more of the multiple color channels in the color imaging device.
  • An imaging device designing system in accordance with another embodimen of the present invention includes a selection system and a design processing system.
  • the selection system obtains an image quality value.
  • the design processing system determines a spectral sensitivity curve for at least one of the color channels of the color imaging device so that the spectral sensitivity curves for each of the color channels in the color imaging device results in the image quality value.
  • a system for determining the tolerances for one or more color channels in . * . a color imaging device in accordance with another embodiment of the present invention includes a source and a design processing system.
  • the source provides a spectral sensitivity curve for at least one of the multiple color channels in the color imaging device.
  • the design processing system determines a first, pair of upper and lower tolerances for the obtained spectral sensitivity for the at least one of the multiple color channels and determines a second pair of upper and lower tolerances on the full width half maximum for the obtained spectral sensitivity curve for at least one of the multiple color channels.
  • an objective evaluation of the quality of color images captured by the evaluated imaging device is now provided using an analysis of the spectral sensitivity curves of channels in the imaging device.
  • the resulting evaluation also provides information on how much room for improvement there is for the evaluated imaging device.
  • the image quality of different imaging devices can now be compared.
  • spectral sensitivity curves for an imaging device can be designed or optimized. As a result, an imaging device with a desired level of image quality can be produced. Additionally, with the present invention determinations of image quality versus the cost of obtaining that level of image quality can be made.
  • tolerances for spectral sensitivity curves for an imaging device can be determined. These determined tolerances provide an evaluation of the tolerance range of the imaging device. Additionally, these determined tolerances can be used to select other sets of spectral sensitivity curves that might also be used with the same resulting image quality.
  • FIG. 1 is a block diagram of a system for evaluating, optimizing and/or designing one or more spectral sensitivity curves for an imaging device in accordance with one embodiment of the present invention
  • FIG. 2 is a block diagram of a color channel in an imaging device
  • FIG. 3 A is a flow chart of a method for determining a color rendering capability of at least one color imaging device with multiple color channels in accordance with one embodiment of the present invention
  • FIG. 3B is a flow chart of a method for determining a color rendering capability of at least one color imaging device with multiple color channels in accordance with another embodiment of the present invention
  • FIG. 4A is a flow chart of a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with another embodiment of the present invention
  • FIG. 4B is a flow chart of a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with yet another embodiment of the present invention.
  • FIG. 5 is a flow chart of a method for determining the tolerances for one or more color channels in a color imaging device in accordance with another embodiment of the present invention.
  • FIGS. 1, 3 A, 3B, 4A, 4B, and 5 A system 10 and method for evaluating, optimizing and/or designing one or more spectral sensitivity curves for an imaging device in accordance with one embodiment of the present invention is illustrated in FIGS. 1, 3 A, 3B, 4A, 4B, and 5.
  • the method in accordance with one embodiment includes determining an image quality value for the color imaging device from spectral sensitivity curves for two or more of the multiple color channels in the color imaging device and then evaluating the color rendering capability of the color imaging device based on the determined image quality value.
  • the present invention can provide an objective evaluation of an imaging device, one or more spectral sensitivity curve or curves for an optimized set of spectral sensitivity curves for the imaging device, and tolerances for one or more spectral sensitivity curves for an imaging device.
  • the system 10 includes a spectral sensitivity ("SS") processing system 12 and an optional CCD camera 14, although system 10 may have other components, other numbers of the components, and other combinations of the components.
  • the SS processing system 12 is operatively coupled to the camera 14.
  • a variety of communication systems and/or methods can be used to operatively couple and communicate between the SS processing system 12 and the camera 14, including a direct connection, a local area network, a wide area network, the world wide web, modems and phone lines, or wireless communication technology each having communications protocols.
  • a direct connection a local area network, a wide area network, the world wide web, modems and phone lines, or wireless communication technology each having communications protocols.
  • SS processing system 12 includes at least one processor 16, at least one memory 18, at least one input/output interface 20, and a user input device 23 which are coupled together by a bus system 22 or other link, although the SS processing system 12 may comprise other components, other numbers of the components, and other combinations of the components.
  • the processor 16 executes a program of stored instructions for at least a portion of the method for evaluating, optimizing and/or designing one or more spectral sensitivity curves for an imaging device in accordance with one embodiment of the present invention as described herein and set forth in FIGS. 3-5.
  • a variety of different types of memory storage devices such as a random access memory (RAM) or a read only memory (ROM) in the system or a floppy disk, hard disk, CD ROM, or other computer readable medium which is read from and/or written to by a magnetic, optical, or other reading and/or writing system that is coupled to the processor 16, can be used to store the programmed instructions described herein as well as other information.
  • RAM random access memory
  • ROM read only memory
  • a floppy disk hard disk
  • CD ROM or other computer readable medium which is read from and/or written to by a magnetic, optical, or other reading and/or writing system that is coupled to the processor 16
  • the input/output interface 20 is used to operatively couple and communicate between the SS processing system 12 and the camera 14.
  • the user input device 23 enables an operator to generate and transmit signals or commands to the processor 16, such as an image quality value, a set of tolerances for spectral sensitivity curves, or one or more selected spectral sensitivity curves for analysis.
  • signals or commands such as an image quality value, a set of tolerances for spectral sensitivity curves, or one or more selected spectral sensitivity curves for analysis.
  • a variety of different types of user input devices can be used, such as a keyboard or computer mouse.
  • the color channel in the imaging device includes a filter 24, a detector 26, and an analog-to- digital converter 28, although the color channel in the imaging device can comprise other components and other combinations of components.
  • Each component of an imaging device color channel has a certain response to its expected input.
  • the color filter 24 has a spectral transmission wherein photons at different wavelengths from scene radiation hv have different probabilities of being passed through to the detector 26. Such transmission properties can be precisely determined.
  • the detector 26 has a spectral sensitivity wherein for any photon from scene radiation hv ' which passes through filter 24 is incident upon the detector 26.
  • step 50 a flow chart for analyzing a color rendering capability of at least one color imaging device with multiple color channels in accordance with one embodiment of the present invention is illustrated. In step 50, this method starts.
  • spectral sensitivity curves or functions for two or more of the multiple color channels in the color imaging device are obtained.
  • Spectral sensitivity of a color imaging device or system is defined as the product of the spectral sensitivity of the imaging detector and the transmittance of the filter.
  • a useful simplified model assumes the spectral sensitivity to be a smooth single- peaked curve in visible range with nonnegative values, although real channel spectral sensitivities may be more complex.
  • the spectral sensitivity curves are retrieved from memory 18 from a prior measurement of an imaging device, although the spectral sensitivity curves can be obtained in a variety of other manners, such as, from another memory storage device, by generating the spectral sensitivity curves hypothetically or by operator input via user input device 23.
  • the spectral sensitivity curves can be generated hypothetically by SS processing system 12. More specifically, the spectral sensitivities for the simplified model can be simulated by a combination of smooth cubic spline functions.
  • step 54 the obtained spectral sensitivity curves from step 52 are used by the SS processing system 12 to determine a ⁇ -factor.
  • the ⁇ -factor is calculated by summing the g-factors of the orthonormalized vectors of the obtained spectral sensitivity curves and dividing the summation by three, although other manners for determining a ⁇ -factor can be used. Since the process of determining a ⁇ -factor and ⁇ -/-factors are known, they will not be described in detail here.
  • a color difference metric value in this case a delta E (“ E") value, for the color imaging device is determined in SS processing system 12 from the ⁇ -factor, although other combinations of the ⁇ -factor and/or other quality factors could also be used to determine the color difference metric value.
  • E delta E
  • a relationship between ⁇ -factor and E stored in memory 18 is used by processor 16 to determine the color difference metric value.
  • One example of such a derived relationship between ⁇ -factor and E is set forth below:
  • the color difference metric value in this particular embodiment is obtained by averaging the minimum and maximum expected E value expected for the determined ⁇ -factor. For example, a ⁇ -factor of 0.98 would result in color difference metric value of 1.85.
  • step 60 the color rendering capability of the color imaging device is evaluated based on the determined image quality value.
  • image quality value is compared against a standard to provide an evaluation, e.g. a standard might state that an image quality value of zero is ideal, an image quality value of 0 to 2.0 is acceptable, and an image quality value above 2.0 is unacceptable, although other types of evaluations could be used.
  • a standard might state that an image quality value of zero is ideal, an image quality value of 0 to 2.0 is acceptable, and an image quality value above 2.0 is unacceptable, although other types of evaluations could be used.
  • the image quality values of two different imaging devices could also be compared against each other to identify the imaging device which would produce color images with better quality.
  • a color difference metric value is determined, other types of image quality values could also be determined, such as a color quality and noise sensitivity metric value.
  • An image quality value is a number which correlates how well an image fits associated quality criteria from the view point of a typical human observer.
  • a color quality metric value is an image quality value based on the criteria of how well the channel sensitivities of a device correlate with the human visual system.
  • a color difference metric value is an image quality value which correlates with the magnitude of change in color a typical human observer would detect between two images.
  • a color quality and noise sensitivity metric value an image quality value based on color criteria and an image quality value based on quantifying how the amplification of noise in a system affects perceived quality to a human observer.
  • step 62 this method starts.
  • step 64 spectral sensitivity curves or functions for two or more of the multiple color channels in the color imaging device are obtained. Since the process in step 64 is identical to that described earlier in step 52, it will not described again here.
  • step 66 the obtained spectral sensitivity curves from step 52 are used by the SS processing system 12 to determine a Universal Measure of Goodness (UMG) factor.
  • UMG takes into account the total noise of the system, both shot noise which is signal dependent and dark noise which is signal independent, and an expected average color difference. Total noise is measured through the sum of the shot noise covariance and the dark current noise co variance, while the expectation of the noise is still zero.
  • is the information content which would be delivered by the system described by the spectral sensitivity curves.
  • is a function of the total noise and the average E.
  • is the information content which a perfectly noise-free colorimetric system would deliver.
  • UMG is the ratio of ⁇ to ⁇ .
  • a color quality and noise sensitivity metric value for the color imaging device is determined in SS processing system 12 from the UMG factor, although other combinations of the UMG factor and/or other quality factors could also be used to determine the color quality and noise sensitivity metric value.
  • a relationship between the UMG factor and E stored in memory 18 is used by processor 16 to determine the color difference metric value. Since the process in this step is the same as described earlier in step 58 except a color quality and noise sensitivity metric value is being determined here instead of a color difference metric value and a UMG factor is used here instead of a ⁇ -factor, the process will not described again here.
  • One of the advantages of this method is the use of a noise sensitivity metric because it involves a consideration of image-dependent noise.
  • Image dependent noise is noise dependent on the input signal level, rather than independent, white noise as described in greater detail in Gerald C. Hoist, "CCD Arrays Cameras and Displays", SPIE Optical Engineering Press 1998 which is herein incorporated by reference.
  • this embodiment of the present invention generates an image quality metric value which is more coincident with what occurs in the real world.
  • step 72 the color rendering capability of the color imaging device is evaluated based on the determined color quality and noise sensitivity metric value. Since the process in step 68 is identical to that described earlier in step 56, except that the evaluation is based using a color quality and noise sensitivity metric value instead of a color difference metric value, it will not described again here.
  • FIG. 4A is a flow chart of a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with another embodiment of the present invention is illustrated.
  • this method starts.
  • an image quality value is obtained.
  • user input device 23 can be used to select or input the image quality value or the value could be retrieved from a memory device.
  • image quality metric values could be used, such as a color difference metric value or a color quality and noise sensitivity metric value.
  • the SS processing system 12 uses the obtained image quality value to obtain or retrieve one or more tables, sets, or enumerations of combinations of spectral sensitivity curves from memory 18.
  • the one or more tables sets, or enumerations of combinations of spectral sensitivity curves can be obtained in a variety of different manners, such as based on the image quality value itself or on a portion of the image quality value, such as a ⁇ -factor on which the image quality value is at least partially based or on other factors. Two illustrative examples of such tables set forth below.
  • the tables are stored in memory 18, although the tables could be stored elsewhere.
  • the tables are accessed by processor 16 to determine the spectral sensitivity curve(s) which are unknown needed or desired for the particular application.
  • step 80 the known spectral sensitivity curves are used to identify a combination or combinations of spectral sensitivity curves in the obtained table that could be used for the particular application.
  • step 82 one of the identified combinations of spectral sensitivity curves is selected.
  • factors could be used by SS processing system 12 to determine how this selection is made, such as which combination of spectral sensitivity curves would have the best color rendering capability or by an operator making a selection using user input device 23.
  • step 84 the missing and desired spectral sensitivity curve or curves are determined from the selected combination.
  • the selected combination will contain the needed information and/or data on the missing and desired spectral sensitivity curve or curves.
  • this method is set forth below. If, for example, one chooses to design a third channel for a three-channel system where an image quality value is selected that is based at least partly on a ⁇ -factor with a desired value of 0.98, then Table I would be selected.
  • the spectral sensitivity curve(s) is determined using tables, the selected image quality value, and the known spectral sensitivity curves, other methods for determining ⁇ the spectral sensitivity curve may also be used.
  • FIG. 4B is a flow chart of a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with another embodiment of the present invention is illustrated.
  • this method starts.
  • step 88 an image quality value is obtained. Since the process in step 88 is identical to that described earlier in step 76, it will not described again here.
  • step 90 the SS processing system 12 uses the obtained image quality value to obtain or retrieve one or more tables, sets, or enumerations of combinations of spectral sensitivity curves from memory 18. Since the process in step 90 is identical to that described earlier in step 78, it will not described again here.
  • one or more characteristics are used by SS processing system 12 to identify a combination or combinations of spectral sensitivity curves in the obtained table that could be used for the particular application.
  • a variety of different characteristics, numbers of characteristics (one or more than one, and a variety of different combinations can be used as needed or desired for the particular application.
  • the characteristics can be obtained in a variety of different manners, such as from memory 18 or via operator input using user input device 23.
  • step 94 one of the identified combinations of spectral sensitivity curves is selected.
  • factors could be used by SS processing system 12 to determine how this selection is made, such as which combination of spectral sensitivity curves would have the best color rendering capability or by an operator making a selection using user input device 23.
  • step 96 the desired spectral sensitivity curves are obtained from the selected combination.
  • the selected combination will contain the needed information and/or data on these spectral sensitivity curves.
  • Table I would be selected in this example. For that table, every channel sensitivity combination described in that table is associated with a ⁇ -factor of 0.98.
  • the ⁇ -factor for an image quality value can be used to select a set or table of spectral sensitivity curves.
  • an optimization approach can be used by SS processing system 12 to select one of the combinations of spectral sensitivity curves.
  • three or more spectral sensitivity curves could be optimized by maximizing the image quality metric within one or more constraints.
  • these constraints can be:
  • the transmittance of spectral sensitivity at each wavelength is non-negative.
  • the transmittance at each wavelength cannot exceed one, or a constant that is less than one.
  • the transmittance of the filter has one global maximum, and without local maximum.
  • constraints are discussed above, a variety of different types of constraints and combinations of them can be used depending upon the particular application and its requirements.
  • FIG. 5 a flow chart of a method for determining the tolerances for one or more color channels in a color imaging device in accordance with another embodiment of the present invention is illustrated.
  • this method starts.
  • step 100 a spectral sensitivity curve for at least one of the multiple color channels in the color imaging device is obtained in a manner as described in greater detail earlier.
  • step 102 an image quality value is obtained. Since methods and systems for obtaining spectral sensitivity curve(s) and/or image quality values are discussed earlier, they will not be described here again.
  • a first pair of upper and lower tolerances on the peak wavelength is determined for the obtained spectral sensitivity curves for one of the multiple color channels.
  • These tolerances may be obtained by processor 16 through reference to the tables stored in memory 18, such as the tables which are set forth below as examples.
  • the table used is selected based on the obtained image quality value as described in greater detail earlier.
  • the tables are useful in determining desirable channel spectral sensitivities for three-channel imaging devices. These tables provide manufacturing guidance on the choice of curves.
  • the ⁇ -factor used in deriving the tables is a color quality metric.
  • the tables describe tolerances on the specification of the "red” and "blue" channels in a three-channel system.
  • the tolerances are in terms of peak wavelength error which maintain the ⁇ -factor at or above the desired level.
  • the first table maintains a ⁇ - factor of at least 0.98
  • the second maintains at least a ⁇ -factor of 0.95.
  • step 106 a second pair of upper and lower tolerances on the full width half maximum is determined from the obtained spectral sensitivity curve for one of the multiple color channels.
  • tolerances may also be obtained through reference to the tables, such as the exemplary tables incorporated below in the same manner as described above in step 104.
  • the spectral sensitivity curve or curves are evaluated based on the determined first and second pair of tolerances.
  • the first and second pair of tolerances may provide an indication on the ease or difficulty in reproducing an imaging device with the same color rendering capability. If the tolerances are small, then it will be difficult to obtain imaging devices with the same color rendering capability.
  • Table I Peak wavelength tolerances based on single-peak symmetric or asymmetric channel sensitivities for three channel cameras with ⁇ -factor of .98 or larger
  • Table II Peak wavelength tolerances based on single-peak symmetric or asymmetric channel sensitivities for three channel cameras with ⁇ -factor of .95 or larger

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Spectrometry And Color Measurement (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Image Processing (AREA)

Abstract

A method and system for analyzing a color rendering capability of at least one color imaging device (14) with multiple color channels, including obtaining spectral sensitivity curves for two or more of the multiple color channels in the color imaging device (14) and determining an image quality value for the color imaging device from the spectral sensitivity curves for the two or more of the multiple color channels in the color imaging device (14).

Description

A SYSTEM AND METHOD FOR ANALYZING, OPTIMIZING AND/OR DESIGNING SPECTRAL SENSITIVITY CURVES FOR AN IMAGING DEVICE
This application claims the benefit of U.S. Provisional Patent Application Serial No. 60/191,800 filed on March 24, 2000 which is herein incorporated by reference.
FIELD OF THE INVENTION
The invention relates generally to imaging and, more particularly, to a method and system for evaluating, optimizing and/or designing one or more spectral sensitivity curves for an imaging device.
BACKGROUND OF THE INVENTION
The practice of capturing color images with digital imaging devices or systems, such as a digital camera or color scanner, is widely spreading. Currently, these digital devices comprise a charge-coupled device or complementary metal- oxide-semiconductor (CCD/CMOS) sensor array with a set of filters before it. Ideally, these digital imaging devices capture color images in a substantially accurate and aesthetically pleasing manner.
There are many criteria which are utilized in the design and production of color imaging devices. An important consideration is the ability of the device to deliver color signals which can be used to create high quality color reproductions. To quantify the color quality capability of such devices, it is important to determine how the device's response to color stimuli corresponds to that of a human. Through psychophysical experiments, the Commission Internationale de l'Eclairage (CIE) has generated a standard set of color matching functions for the standard observer, representing the average human visual response to color. As the human eye has three types of cones, each with a different spectral sensitivity signature, there are three standard function specified by the CIE. Accordingly, most color imaging devices are set up with three channels and the spectral sensitivities in these imaging devices are initially designed to attempt to mimic the human visual system.
The spectral sensitivity functions for color imaging device channels should satisfy the Luther condition, that is the channel spectral sensitivities need not be exact duplicates of the CIE color-matching functions described above, but need to be a nonsingular transformation of them. In practice, it is not always possible to manufacture filters for imaging devices that satisfy the Luther condition, often due to the physical limitations of fabricating process. Measurement noise also plays an important role and will degrade the color accuracy even when spectral sensitivity curves fulfill the Luther condition.
Accordingly, a measure of goodness or quality factor for evaluating, optimizing, and/or designing spectral sensitivity curves for color imaging devices is desirable. Unfortunately, developing methods and/or systems for obtaining a measure of goodness or a quality factor has been challenging.
One quality factor, known as the β-factor, for evaluating and designing spectral sensitivity functions is disclosed in H. E. J. Neugebauer, " Quality factor for filters whose spectral transmittances are different from color mixture curves, and its application to color photography," J. Opt. Soc. Am. Vol. 46, No.10, pg. 821-824 (1956), which is herein incorporated by reference. A major disadvantage of the Q-factor is that it is designed to evaluate only single spectral sensitivities. Thus, it is easily possible to design an imaging device where all channels associate with high Q-factors, and still the system delivers color signals which cannot be used in creating high quality color reproductions. The trivial example of such a system is a three-channel device where all three channels are made with small deviations from the same spectral sensitivity signature. Although all three show high O-factor, the result is a nearly monochrome image. Another quality factor, known as the μ-factor, for evaluating and designing spectral sensitivity functions is disclosed in P. L. Nora and H. J. Trussell, "Measure of goodness of a set of color-scanning filters", J. Opt. Soc. Am. A, Nol.10, Νo.7, pg. 1499-1503 (1993), which is herein incorporated by reference. The μ-factor is a quality factor which evaluates an arbitrary number of device channel sensitivity functions as an ensemble. More specifically, the μ-factor describes the difference between the orthonormal subspaces of the CIE color matching functions and the spectral sensitivity space. Generally, a μ-factor approximately equal to one is an indication of an imaging device expected to deliver high quality color reproduction. Unfortunately, some color imaging devices with a poor μ-factor can still generate a good image reproduction. Nora and Trussell have thus introduced a metric which does not have a straight forward correlation with expected image quality. Another problem with the μ-factor is that it does not penalize systems that by virtue of channel sensitivity choices tend to amplify system noise. Such noise is unavoidable in real systems and a system designer needs to carefully control it so as to avoid swamping the eventual color reproduction.
CIELAB color space is a non-linear transfromation of the CIE color matching functions used as an approximation to a perceptually uniform color space. A figure of merit for color scanners, based on locally-linearized CIELAB space, having an incorporated model for measurement of noise is present in G. Sharma et al. "Figure of merit for color scanners," IEEE Trans. Image Processing, Vol. 6, No. 7, pg. 990-1001 (1997) which is herein incorporated by reference. The new figure has a high degree of perceptual relevance and also accounts for noise performance of sets of channel sensitivities. The noise aspect of Sharma' s metric is, however completely independent of the input stimulus and thus is limited in its usefulness.
SUMMARY OF THE INVENTION A method for determining a color rendering capability of at least one color imaging device with multiple color channels in accordance with one embodiment of the present invention includes a few steps. Spectral sensitivity curves for two or more of the multiple color channels in the color imaging device are obtained. An image quality value for the color imaging device is determined from the spectral sensitivity curves for the two or more of the multiple color channels in the color imaging device. The color rendering capability of the color imaging device can be evaluated based on the determined image quality value.
A method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with another embodiment of the present invention includes selecting an image quality value and then determining a spectral sensitivity curve for at least one of the color channels of the color imaging device so that the spectral sensitivity curves for each of the color channels in the color imaging device results in the image quality value.
A method for determining the tolerances for one or more color channels in a color imaging device in accordance with another embodiment of the present invention includes a few steps. A spectral sensitivity curve for at least one of the multiple color channels in the color imaging device and an image quality value are obtained. Next, a first pair of upper and lower peak wavelength tolerances from the obtained spectral sensitivity for the at least one of the multiple color channels and the obtained image quality value. Additionally, a second pair of upper and lower tolerances on the width from the obtained spectral sensitivity curve for at least one of the multiple color channels and the obtained image quality value are determined.
An imaging device analyzing system in accordance with another embodiment of the present invention includes a source for spectral sensitivity curves for two or more of the multiple color channels in a color imaging device, an image quality processing system, and an evaluation system. The image quality processing system determines an image quality value for the color imaging device from the spectral sensitivity curves for the two or more of the multiple color channels in the color imaging device. An imaging device designing system in accordance with another embodimen of the present invention includes a selection system and a design processing system. The selection system obtains an image quality value. The design processing system determines a spectral sensitivity curve for at least one of the color channels of the color imaging device so that the spectral sensitivity curves for each of the color channels in the color imaging device results in the image quality value.
A system for determining the tolerances for one or more color channels in .*. a color imaging device in accordance with another embodiment of the present invention includes a source and a design processing system. The source provides a spectral sensitivity curve for at least one of the multiple color channels in the color imaging device. The design processing system determines a first, pair of upper and lower tolerances for the obtained spectral sensitivity for the at least one of the multiple color channels and determines a second pair of upper and lower tolerances on the full width half maximum for the obtained spectral sensitivity curve for at least one of the multiple color channels.
With the present invention, an objective evaluation of the quality of color images captured by the evaluated imaging device is now provided using an analysis of the spectral sensitivity curves of channels in the imaging device. The resulting evaluation also provides information on how much room for improvement there is for the evaluated imaging device. The image quality of different imaging devices can now be compared.
Additionally, with the present invention spectral sensitivity curves for an imaging device can be designed or optimized. As a result, an imaging device with a desired level of image quality can be produced. Additionally, with the present invention determinations of image quality versus the cost of obtaining that level of image quality can be made.
Further, with the present invention tolerances for spectral sensitivity curves for an imaging device can be determined. These determined tolerances provide an evaluation of the tolerance range of the imaging device. Additionally, these determined tolerances can be used to select other sets of spectral sensitivity curves that might also be used with the same resulting image quality.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram of a system for evaluating, optimizing and/or designing one or more spectral sensitivity curves for an imaging device in accordance with one embodiment of the present invention;
FIG. 2 is a block diagram of a color channel in an imaging device; FIG. 3 A is a flow chart of a method for determining a color rendering capability of at least one color imaging device with multiple color channels in accordance with one embodiment of the present invention;
FIG. 3B is a flow chart of a method for determining a color rendering capability of at least one color imaging device with multiple color channels in accordance with another embodiment of the present invention;
FIG. 4A is a flow chart of a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with another embodiment of the present invention;
FIG. 4B is a flow chart of a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with yet another embodiment of the present invention; and
FIG. 5 is a flow chart of a method for determining the tolerances for one or more color channels in a color imaging device in accordance with another embodiment of the present invention.
DETAILED DESCRIPTION
A system 10 and method for evaluating, optimizing and/or designing one or more spectral sensitivity curves for an imaging device in accordance with one embodiment of the present invention is illustrated in FIGS. 1, 3 A, 3B, 4A, 4B, and 5. The method in accordance with one embodiment includes determining an image quality value for the color imaging device from spectral sensitivity curves for two or more of the multiple color channels in the color imaging device and then evaluating the color rendering capability of the color imaging device based on the determined image quality value. Among other features, the present invention can provide an objective evaluation of an imaging device, one or more spectral sensitivity curve or curves for an optimized set of spectral sensitivity curves for the imaging device, and tolerances for one or more spectral sensitivity curves for an imaging device.
Referring to FIG. 1, in this particular embodiment the system 10 includes a spectral sensitivity ("SS") processing system 12 and an optional CCD camera 14, although system 10 may have other components, other numbers of the components, and other combinations of the components. The SS processing system 12 is operatively coupled to the camera 14. A variety of communication systems and/or methods can be used to operatively couple and communicate between the SS processing system 12 and the camera 14, including a direct connection, a local area network, a wide area network, the world wide web, modems and phone lines, or wireless communication technology each having communications protocols. Although one configuration for the system 10 is shown, other configurations are possible and envisioned.
SS processing system 12 includes at least one processor 16, at least one memory 18, at least one input/output interface 20, and a user input device 23 which are coupled together by a bus system 22 or other link, although the SS processing system 12 may comprise other components, other numbers of the components, and other combinations of the components. The processor 16 executes a program of stored instructions for at least a portion of the method for evaluating, optimizing and/or designing one or more spectral sensitivity curves for an imaging device in accordance with one embodiment of the present invention as described herein and set forth in FIGS. 3-5. A variety of different types of memory storage devices, such as a random access memory (RAM) or a read only memory (ROM) in the system or a floppy disk, hard disk, CD ROM, or other computer readable medium which is read from and/or written to by a magnetic, optical, or other reading and/or writing system that is coupled to the processor 16, can be used to store the programmed instructions described herein as well as other information. Although in his particular embodiment, the method in accordance with one embodiment of the invention is stored as programmed instructions in the SS processing system 12 for execution by the processor 16, some or all of the programmed instructions could be stored and executed elsewhere. The input/output interface 20 is used to operatively couple and communicate between the SS processing system 12 and the camera 14. The user input device 23 enables an operator to generate and transmit signals or commands to the processor 16, such as an image quality value, a set of tolerances for spectral sensitivity curves, or one or more selected spectral sensitivity curves for analysis. A variety of different types of user input devices can be used, such as a keyboard or computer mouse.
Referring to FIG. 2, a block diagram of a color channel in an imaging device, such as camera 14, is illustrated. In this particular embodiment, the color channel in the imaging device includes a filter 24, a detector 26, and an analog-to- digital converter 28, although the color channel in the imaging device can comprise other components and other combinations of components. Each component of an imaging device color channel has a certain response to its expected input. The color filter 24 has a spectral transmission wherein photons at different wavelengths from scene radiation hv have different probabilities of being passed through to the detector 26. Such transmission properties can be precisely determined. Likewise, the detector 26 has a spectral sensitivity wherein for any photon from scene radiation hv ' which passes through filter 24 is incident upon the detector 26. Based upon its wavelength, there is a precisely determinable probability that that photon will cause a change in voltage response in the detector 26. The measured voltage in detector 26 is passed to analog-to-digital converter 28 which coverts the analog voltage to a digital value. The spectral sensitivity of the imaging device 14 color channel is derived from the series combination of the filter transmission and the detector spectral sensitivity. Referring to FIG.3A, a flow chart for analyzing a color rendering capability of at least one color imaging device with multiple color channels in accordance with one embodiment of the present invention is illustrated. In step 50, this method starts.
Next, in step 52 spectral sensitivity curves or functions for two or more of the multiple color channels in the color imaging device are obtained. Spectral sensitivity of a color imaging device or system is defined as the product of the spectral sensitivity of the imaging detector and the transmittance of the filter. A useful simplified model assumes the spectral sensitivity to be a smooth single- peaked curve in visible range with nonnegative values, although real channel spectral sensitivities may be more complex. In this particular embodiment, the spectral sensitivity curves are retrieved from memory 18 from a prior measurement of an imaging device, although the spectral sensitivity curves can be obtained in a variety of other manners, such as, from another memory storage device, by generating the spectral sensitivity curves hypothetically or by operator input via user input device 23.
By way of example only, the spectral sensitivity curves can be generated hypothetically by SS processing system 12. More specifically, the spectral sensitivities for the simplified model can be simulated by a combination of smooth cubic spline functions. The cubic spline function for instance with peak position at λ=λ0 is written as:
where 2w is the width of the cubic spline function at one-fourth peak height (the corresponding width at half peak height is approximately V2w ). If we wish to describe a more complicated potential spectral sensitivity curve, one which may be non-symmetrical about its peak wavelength, then we can consider w; and w2 which represent the left half and right half widths, respectively. Now our cubic spline function becomes
{ w3 + 3w2(w- |λ - P ) + 3w(w- |λ - P )2 - 3(w- |λ - Pλ|)3
0 < λ - P < w,
6w3
For convenience we introduce w which is related to wi and w2 in the following ways:
w2 - wl = 2Aw so w, = w - Δw, χ>2 = w + Δw . and Aw = —
Next, in step 54 the obtained spectral sensitivity curves from step 52 are used by the SS processing system 12 to determine a μ-factor. In this particular embodiment, the μ-factor is calculated by summing the g-factors of the orthonormalized vectors of the obtained spectral sensitivity curves and dividing the summation by three, although other manners for determining a μ-factor can be used. Since the process of determining a μ-factor and {-/-factors are known, they will not be described in detail here.
Next, in step 58 a color difference metric value, in this case a delta E (" E") value, for the color imaging device is determined in SS processing system 12 from the μ-factor, although other combinations of the μ-factor and/or other quality factors could also be used to determine the color difference metric value. In this particular embodiment, a relationship between μ-factor and E stored in memory 18 is used by processor 16 to determine the color difference metric value. One example of such a derived relationship between μ-factor and E is set forth below:
Based on this relationship, the color difference metric value in this particular embodiment is obtained by averaging the minimum and maximum expected E value expected for the determined μ-factor. For example, a μ-factor of 0.98 would result in color difference metric value of 1.85.
Next, in step 60 the color rendering capability of the color imaging device is evaluated based on the determined image quality value. In this particular embodiment, image quality value is compared against a standard to provide an evaluation, e.g. a standard might state that an image quality value of zero is ideal, an image quality value of 0 to 2.0 is acceptable, and an image quality value above 2.0 is unacceptable, although other types of evaluations could be used. By way of example only, the image quality values of two different imaging devices could also be compared against each other to identify the imaging device which would produce color images with better quality.
Although in this particular embodiment a color difference metric value is determined, other types of image quality values could also be determined, such as a color quality and noise sensitivity metric value. An image quality value is a number which correlates how well an image fits associated quality criteria from the view point of a typical human observer. A color quality metric value is an image quality value based on the criteria of how well the channel sensitivities of a device correlate with the human visual system. A color difference metric value is an image quality value which correlates with the magnitude of change in color a typical human observer would detect between two images. A color quality and noise sensitivity metric value an image quality value based on color criteria and an image quality value based on quantifying how the amplification of noise in a system affects perceived quality to a human observer.
Referring to FIG. 3B, a flow chart for evaluating a color rendering capability of at least one color imaging device with multiple color channels in accordance with one embodiment of the present invention is illustrated. In step 62, this method starts.
Next, in step 64 spectral sensitivity curves or functions for two or more of the multiple color channels in the color imaging device are obtained. Since the process in step 64 is identical to that described earlier in step 52, it will not described again here.
Next, in step 66 the obtained spectral sensitivity curves from step 52 are used by the SS processing system 12 to determine a Universal Measure of Goodness (UMG) factor. UMG takes into account the total noise of the system, both shot noise which is signal dependent and dark noise which is signal independent, and an expected average color difference. Total noise is measured through the sum of the shot noise covariance and the dark current noise co variance, while the expectation of the noise is still zero. For a standard set of object spectra, τ is the information content which would be delivered by the system described by the spectral sensitivity curves. Thus, τ is a function of the total noise and the average E. For the same standard set of object spectra,α is the information content which a perfectly noise-free colorimetric system would deliver. UMG is the ratio of τ to α. Next, in step 70 a color quality and noise sensitivity metric value for the color imaging device is determined in SS processing system 12 from the UMG factor, although other combinations of the UMG factor and/or other quality factors could also be used to determine the color quality and noise sensitivity metric value. In this particular embodiment, a relationship between the UMG factor and E stored in memory 18 is used by processor 16 to determine the color difference metric value. Since the process in this step is the same as described earlier in step 58 except a color quality and noise sensitivity metric value is being determined here instead of a color difference metric value and a UMG factor is used here instead of a μ-factor, the process will not described again here.
One of the advantages of this method is the use of a noise sensitivity metric because it involves a consideration of image-dependent noise. Image dependent noise is noise dependent on the input signal level, rather than independent, white noise as described in greater detail in Gerald C. Hoist, "CCD Arrays Cameras and Displays", SPIE Optical Engineering Press 1998 which is herein incorporated by reference. By incorporating this practical noise model into the image quality metric value, this embodiment of the present invention generates an image quality metric value which is more coincident with what occurs in the real world.
Next, in step 72 the color rendering capability of the color imaging device is evaluated based on the determined color quality and noise sensitivity metric value. Since the process in step 68 is identical to that described earlier in step 56, except that the evaluation is based using a color quality and noise sensitivity metric value instead of a color difference metric value, it will not described again here.
Referring to FIG. 4A is a flow chart of a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with another embodiment of the present invention is illustrated. In step 74, this method starts. Next, in step 76, an image quality value is obtained. way of example only, user input device 23 can be used to select or input the image quality value or the value could be retrieved from a memory device. Again, depending upon the embodiment, a variety of different types of image quality metric values could be used, such as a color difference metric value or a color quality and noise sensitivity metric value.
Next, in step 78 the SS processing system 12 uses the obtained image quality value to obtain or retrieve one or more tables, sets, or enumerations of combinations of spectral sensitivity curves from memory 18. The one or more tables sets, or enumerations of combinations of spectral sensitivity curves can be obtained in a variety of different manners, such as based on the image quality value itself or on a portion of the image quality value, such as a μ-factor on which the image quality value is at least partially based or on other factors. Two illustrative examples of such tables set forth below. In this particular embodiment, the tables are stored in memory 18, although the tables could be stored elsewhere. The tables are accessed by processor 16 to determine the spectral sensitivity curve(s) which are unknown needed or desired for the particular application.
Next, in step 80 the known spectral sensitivity curves are used to identify a combination or combinations of spectral sensitivity curves in the obtained table that could be used for the particular application.
Next, in step 82 one of the identified combinations of spectral sensitivity curves is selected. A variety of factors could be used by SS processing system 12 to determine how this selection is made, such as which combination of spectral sensitivity curves would have the best color rendering capability or by an operator making a selection using user input device 23.
Next, in step 84 the missing and desired spectral sensitivity curve or curves are determined from the selected combination. The selected combination will contain the needed information and/or data on the missing and desired spectral sensitivity curve or curves. By way of example only, one example of this method is set forth below. If, for example, one chooses to design a third channel for a three-channel system where an image quality value is selected that is based at least partly on a μ-factor with a desired value of 0.98, then Table I would be selected. Next, if for this example, the spectral sensitivities of the first two channels in a three-channel system are already given where channel 1 has a peak sensitivity at 600nm, a full width half maximum of lOOn (wr = 50, described above) and a skewness of 5nm ( wr=5, described above) and channel 2 has a peak sensitivity at 540nm, a full width half maximum of 140nm (WG = 70) and a skewness of 5nm ( then consulting the table, one possible solution would be found on the following line:
As shown here for the aformentioned channels 1 and 2, there is a satisfactory third channel with peak wavelength sensitivity of 448nm, a full width half maximum of 80nm and a skewness of 5nm which would be determined to be the spectral sensitivity curve for this example. Although in this particular embodiment, the spectral sensitivity curve(s) is determined using tables, the selected image quality value, and the known spectral sensitivity curves, other methods for determining < the spectral sensitivity curve may also be used.
Referring to FIG. 4B is a flow chart of a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with another embodiment of the present invention is illustrated. In step 86, this method starts. Next, in step 88, an image quality value is obtained. Since the process in step 88 is identical to that described earlier in step 76, it will not described again here.
Next, in step 90 the SS processing system 12 uses the obtained image quality value to obtain or retrieve one or more tables, sets, or enumerations of combinations of spectral sensitivity curves from memory 18. Since the process in step 90 is identical to that described earlier in step 78, it will not described again here.
Next, in step 92 one or more characteristics are used by SS processing system 12 to identify a combination or combinations of spectral sensitivity curves in the obtained table that could be used for the particular application. A variety of different characteristics, numbers of characteristics (one or more than one, and a variety of different combinations can be used as needed or desired for the particular application. The characteristics can be obtained in a variety of different manners, such as from memory 18 or via operator input using user input device 23.
Next, in step 94 one of the identified combinations of spectral sensitivity curves is selected. A variety of factors could be used by SS processing system 12 to determine how this selection is made, such as which combination of spectral sensitivity curves would have the best color rendering capability or by an operator making a selection using user input device 23.
Next, in step 96 the desired spectral sensitivity curves are obtained from the selected combination. The selected combination will contain the needed information and/or data on these spectral sensitivity curves.
One example of this particular embodiment is discussed below. If, for example, one chooses to design three channels for a three-channel system where the image quality metric value is based on a μ-factor with a desired value of 0.98, then Table I would be selected in this example. For that table, every channel sensitivity combination described in that table is associated with a μ-factor of 0.98. One could search for a characteristic such as a green curve which is easily manufactured. For example, say a channel with a peak sensitivity at 540nm, a full width half maximum of 140nm (WQ = 70) and a skewness of 5nm ( WG=5) is easily made. Surveying Table I shows a possible second curve could have a peak sensitivity at 604nm, a full width half maximum of lOOnm (WR = 50) and a skewness of -5nm ( WR=-5). If the second curve with its negative skewness is considered difficult to manufacturer, the table can be further consulted by SS processing system 12 until a combination which meets all manufacturing criteria is met. For example, the following combination, also found in Table I, may be considered a good manufacturing candidate: the same first curve along with a second curve with peak sensitivity at 597nm, a full width half maximum of lOOnm (WR = 50) and a skewness of 5nm ( WR=5) and a third channel sensitivity with peak sensitivity at 448nm, a full width half maximum of 80nm (WB = 40) and a skewness of 5nm ( WB=-5) .
Accordingly, with this method once an image quality value is selected, then one or more spectral sensitivity curves can be determined.
In yet another embodiment, as discussed earlier the μ-factor for an image quality value can be used to select a set or table of spectral sensitivity curves. Next, to select a combination of spectral sensitivity curves an optimization approach can be used by SS processing system 12 to select one of the combinations of spectral sensitivity curves. For example, three or more spectral sensitivity curves could be optimized by maximizing the image quality metric within one or more constraints. By way of example only, these constraints can be:
(1) Non-negativity:
The transmittance of spectral sensitivity at each wavelength is non-negative.
(2) Smoothness: The second derivative of the physical sensitivity can be used as a measure of curvature and therefore as a measure of smoothness of the sensitivity. 2S(λ,) + = Al; where 2 ≤ i < 30 Δ < Δ
(3) Boundedness:
In general, the transmittance at each wavelength cannot exceed one, or a constant that is less than one. (4) Single Peak:
The transmittance of the filter has one global maximum, and without local maximum.
Although four constraints are discussed above, a variety of different types of constraints and combinations of them can be used depending upon the particular application and its requirements.
In FIG. 5 a flow chart of a method for determining the tolerances for one or more color channels in a color imaging device in accordance with another embodiment of the present invention is illustrated. In step 98, this method starts. Next, in step 100 a spectral sensitivity curve for at least one of the multiple color channels in the color imaging device is obtained in a manner as described in greater detail earlier. Meanwhile in step 102 an image quality value is obtained. Since methods and systems for obtaining spectral sensitivity curve(s) and/or image quality values are discussed earlier, they will not be described here again.
Next, in step 104 a first pair of upper and lower tolerances on the peak wavelength is determined for the obtained spectral sensitivity curves for one of the multiple color channels. These tolerances may be obtained by processor 16 through reference to the tables stored in memory 18, such as the tables which are set forth below as examples. The table used is selected based on the obtained image quality value as described in greater detail earlier. The tables are useful in determining desirable channel spectral sensitivities for three-channel imaging devices. These tables provide manufacturing guidance on the choice of curves. The μ-factor used in deriving the tables is a color quality metric. The tables describe tolerances on the specification of the "red" and "blue" channels in a three-channel system. The tolerances are in terms of peak wavelength error which maintain the μ-factor at or above the desired level. The first table maintains a μ- factor of at least 0.98, the second maintains at least a μ-factor of 0.95.
Next, in step 106 a second pair of upper and lower tolerances on the full width half maximum is determined from the obtained spectral sensitivity curve for one of the multiple color channels. These tolerances may also be obtained through reference to the tables, such as the exemplary tables incorporated below in the same manner as described above in step 104.
Next, in step 108 the spectral sensitivity curve or curves are evaluated based on the determined first and second pair of tolerances. For example, the first and second pair of tolerances may provide an indication on the ease or difficulty in reproducing an imaging device with the same color rendering capability. If the tolerances are small, then it will be difficult to obtain imaging devices with the same color rendering capability.
EXAMPLES OF TWO TABLES
Table I: Peak wavelength tolerances based on single-peak symmetric or asymmetric channel sensitivities for three channel cameras with μ-factor of .98 or larger
vι- t^60/ΪOSfl/13<I 8501*1/10 OΛV
92- tεt60/ΪOSfl/13<I 8S01- /Ϊ0 OΛV
Table II: Peak wavelength tolerances based on single-peak symmetric or asymmetric channel sensitivities for three channel cameras with μ-factor of .95 or larger
-Z9 tεt60/ΪOSfl/13<I 8S01- /Ϊ0 OΛV
-TJ- tεt60/ΪOSfl/13<I 8S01- /Ϊ0 OΛV
£8 tεt60/ΪOSfl/13<I 8S01- /Ϊ0 OΛV
-L2- tεt60/ΪOSfl/13<I 8S01- /Ϊ0 OΛV
88 tεt60/ΪOSfl/13<I 8S01- /Ϊ0 OΛV
06
1*^60/ΪOSfl/i3<I 8S01- /Ϊ0 OΛV
*6
P£P60/lOSΛ/lDd 8S01- /Ϊ0 OΛV
901 t£t60llOSΑJ13d 8501*1/10 OΛV
60 ϊ
P£P60/lOSl/13d 8S0H/Ϊ0 OΛV
-311 t£t60llOSΑJ13d sson/io OΛV
-επ- tεt60/ΪOSfl/13<I 8S011/Ϊ0 OΛV
HI tεt60/ΪOSfl/13<I 8S0H/Ϊ0 OΛV
Having thus described the basic concept of the invention, it will be rather apparent to those skilled in the art that the foregoing detailed disclosure is intended to be presented by way of example only, and is not limiting. Narious alterations, improvements, and modifications will occur and are intended to those skilled in the art, though not expressly stated herein. These alterations, improvements, and modifications are intended to be suggested hereby, and are within the spirit and scope of the invention. Accordingly, the invention is limited only by the following claims and equivalents thereto.

Claims

What is claimed is:
L A method for determining a color rendering capability of at least one color imaging device with multiple color channels, the method comprising: obtaining spectral sensitivity curves for two or more of the multiple color channels in the color imaging device; and determining an image quality value for the color imaging device from the spectral sensitivity curves for the two or more of the multiple color channels in the color imaging device.
2. The method as set forth in claim 1 wherein determining an image quality value further comprises determining a μ-factor based on the obtained spectral sensitivity curves, wherein the determining an image quality value is based on the μ-factor and at least one other quality factor.
3. The method as set forth in claim 2 wherein the determining an image quality value is based on a relationship between the determined μ-factor and the at least one other quality factor, the image quality value being a substantial average of a minimum and a maximum value for the quality factor associated with the determined μ-factor.
4. The method as set forth in claim 2 wherein the at least one other quality factor is a delta E factor.
5. The method as set forth in claim 2 wherein the image quality value is a color difference metric value.
6. The method as set forth in claim 1 wherein determining an image quality value further comprises determining a Universal Measure of Goodness factor based on the obtained spectral sensitivity curves, wherein the determining an image quality value is based on the Universal Measure of Goodness factor and at least one other quality factor.
7. The method as set forth in claim 6 wherein the at least one other quality factor is a delta E factor.
8. The method as set forth in claim 6 wherein the image quality value is a color quality and noise sensitivity metric value.
9. The method as set forth in claim 1 further comprising evaluating the color rendering capability of the color imaging device based on the determined image quality value.
10. The method as set forth in claim 7 wherein the evaluating further comprises comparing the image quality value of the color imaging device against an image quality standard.
11. The method as set forth in claim 7 wherein the evaluating further comprises comparing the image quality values of two or more of the color imaging devices against each other.
12. A method for designing a spectral sensitivity curve for one or more color channels of a color imaging device, the method comprising: selecting an image quality value; determining a spectral sensitivity curve for at least one of the color channels of the color imaging device so that the spectral sensitivity curves for each of the color channels in the color imaging device results in the image quality value.
13. The method as set forth in claim 12 further comprising obtaining a spectral sensitivity curve for at least one of the color channels of the color imaging device, wherein the determining comprises determining a spectral sensitivity curve for at least one of the other color channels of the color imaging device so that the obtained spectral sensitivity curve with the determined spectral sensitivity curve results in the selected image quality value.
14. The method as set forth in claim 12 wherein the determining further comprises determining spectral sensitivity curves for all of the color channels of the color imaging device so that the determined spectral sensitivity curves result in the image quality value.
15. The method as set forth in claim 12 wherein the determining further comprises: identifying one of a plurality of sets of combinations of spectral sensitivity curves based on the selected image quality value; identifying one or more of the combinations of spectral sensitivity curves based on one or more known spectral sensitivity curves; and selecting one of the one or more the combinations of spectral sensitivity curves based on one or more factors, wherein the determining a spectral sensitivity curve comprises obtaining the spectral sensitivity curve from the selected one of the one or more the combinations of spectral sensitivity curves.
16. The method as set forth in claim 12 wherein the determining further comprises: identifying one of a plurality of sets of combinations of spectral sensitivity curves based on the selected image quality value; identifying one or more of the combinations of spectral sensitivity curves based on one or more characteristics; and selecting one of the one or more the combinations of spectral sensitivity curves based on one or more factors, wherein the determining a spectral sensitivity curve comprises obtaining the spectral sensitivity curve from the selected one of the one or more the combinations of spectral sensitivity curves.
17. The method as set forth in claim 12 wherein the image quality value is a color difference metric value.
18. The method as set forth in claim 12 wherein the image quality value is a color quality and noise sensitivity metric value.
19. A method for determining the tolerances for one or more color channels in a color imaging device, the method comprising: obtaining a spectral sensitivity curve for at least one of the multiple color channels in the color imaging device; obtaining an image quality value; determining a first pair of upper and lower peak wavelength tolerances from the obtained spectral sensitivity for the at least one of the multiple color channels and the obtained image quality value; and determining a second pair of upper and lower tolerances on the width from the obtained spectral sensitivity curve for at least one of the multiple color channels and the obtained image quality value.
20. The method as set forth in claim 19 further comprising evaluating the spectral sensitivity curve based on the first and second pair of tolerances.
21. The method as set forth in claim 19 wherein the determining a first pair and the determining a second pair comprise: identifying one of a plurality of sets of combinations of spectral sensitivity curves based on the obtained image quality value; and identifying one or more of the combinations of spectral sensitivity curves within the identified one of a plurality of sets of combinations of spectral sensitivity curves based on the obtained spectral sensitivity curve; selecting one of the one or more the combinations of spectral sensitivity curves based on one or more factors, wherein the determining a first pair and the determining a second pair are determined from the selected one of the one or more the combinations of spectral sensitivity curves.
22. An imaging device analyzing system, the system comprising: a source for spectral sensitivity curves for two or more of the multiple color channels in a color imaging device; and an image quality processing system that determines an image quality value for the color imaging device from the spectral sensitivity curves for the two or more of the multiple color channels in the color imaging device.
23. The system as set forth in claim 22 wherein the image quality processing system further comprises a μ-factor processing system that determines a μ-factor based on the obtained spectral sensitivity curves, wherein the image quality value is based on the μ-factor and at least one other quality factor.
24. The system as set forth in claim 23 wherein the image quality processing system determines an image quality value based on a relationship between the determined μ-factor and the at least one other quality factor, the image quality value being a substantial average of a minimum and a maximum value for the quality factor associated with the determined μ-factor.
25. The system as set forth in claim 23 wherein the at least one other quality factor is a delta E factor.
26. The system as set forth in claim 26 wherein the image quality value is a color difference metric value.
27. The system as set forth in claim 22 wherein the image quality processing system determines a Universal Measure of Goodness factor based on the obtained spectral sensitivity curves, wherein the image quality value is based on the Universal Measure of Goodness factor and at least one other quality factor.
28. The system as set forth in claim 27 wherein the at least one other quality factor is a delta E factor.
29. The system as set forth in claim 27 wherein the image quality value is a color quality and noise sensitivity metric value.
30. The system as set forth in claim 22 further comprising an evaluation system that evaluates the color rendering capability of the color imaging device based on the determined image quality value.
31. The system as set forth in claim 30 wherein the evaluation system further comprises a comparison system that compares the image quality value of the color imaging device against an image quality standard.
32. The system as set forth in claim 30 wherein the evaluation system further comprises a comparison system that compares the image quality values of two or more of the color imaging devices against each other.
33. An imaging device designing system, the system comprising: a selection system that obtains an image quality value; a design processing system that determines a spectral sensitivity curve for at least one of the color channels of the color imaging device so that the spectral sensitivity curves for each of the color channels in the color imaging device results in the image quality value.
34. The system as set forth in claim 33 further comprising a source for a spectral sensitivity curve for at least one of the color channels of the color imaging device, wherein the determining comprises determining a spectral sensitivity curve for at least one of the other color channels of the color imaging device so that the obtained spectral sensitivity curve with the determined spectral sensitivity curve results in the selected image quality value.
35. The system as set forth in claim 33 wherein the design processing system determines spectral sensitivity curves for all of the color channels of the color imaging device so that the determined spectral sensitivity curves result in the image quality value.
36. The system as set forth in claim 33 wherein the design processing system further comprises: an identification processing system that identifies one of a plurality of sets of combinations of spectral sensitivity curves based on the selected image quality value and identifyies one or more of the combinations of spectral sensitivity curves based on one or more known spectral sensitivity curves; and a selection processing system that selects one of the one or more the combinations of spectral sensitivity curves based on one or more factors, wherein the design processing system obtains the spectral sensitivity curve from the selected one of the one or more the combinations of spectral sensitivity curves.
37. The system as set forth in claim 33 wherein the design processing system further comprises: an identification processing system that identifies one of a plurality of sets of combinations of spectral sensitivity curves based on the selected image quality value and identifies one or more of the combinations of spectral sensitivity curves based on one or more characteristics; and a selection processing system that selects one of the one or more the combinations of spectral sensitivity curves based on one or more factors, wherein the design processing system obtains the spectral sensitivity curve from the selected one of the one or more the combinations of spectral sensitivity curves.
38. The system as set forth in claim 33 wherein the image quality value is a color difference metric value.
39. The system as set forth in claim 33 wherein the image quality value is a color quality and noise sensitivity metric value.
40. A system for determining the tolerances for one or more color channels in a color imaging device, the system comprising: a first source for a spectral sensitivity curve for at least one of the multiple color channels in the color imaging device; a second source for an image quality value; and a design processing system that determines a first pair of upper and lower peak wavelength tolerances from the obtained spectral sensitivity for the at least one of the multiple color channels and the obtained image quality value and determines a second pair of upper and lower tolerances on the width from the obtained spectral sensitivity curve for at least one of the multiple color channels and the obtained image quality value.
41. The system as set forth in claim 40 further comprising an evaluation system that evaluates the spectral sensitivity curve based on the first and second pair of tolerances.
42. The system as set forth in claim 40 wherein the design processing system further comprises: an identification processing system that identifies one of a plurality of sets of combinations of spectral sensitivity curves based on the obtained image quality value and identifies one or more of the combinations of spectral sensitivity curves within the identified one of a plurality of sets of combinations of spectral sensitivity curves based on the obtained spectral sensitivity curve; and a selection processing system that selects one of the one or more the combinations of spectral sensitivity curves based on one or more factors, wherein the determining a first pair and the determining a second pair are determined from the selected one of the one or more the combinations of spectral sensitivity curves.
EP01922637A 2000-03-24 2001-03-23 A system and method for analyzing, optimizing and/or designing spectral sensitivity curves for an imaging device Withdrawn EP1287685A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US19180000P 2000-03-24 2000-03-24
US191800P 2000-03-24
PCT/US2001/009434 WO2001074058A1 (en) 2000-03-24 2001-03-23 A system and method for analyzing, optimizing and/or designing spectral sensitivity curves for an imaging device

Publications (1)

Publication Number Publication Date
EP1287685A1 true EP1287685A1 (en) 2003-03-05

Family

ID=22706980

Family Applications (1)

Application Number Title Priority Date Filing Date
EP01922637A Withdrawn EP1287685A1 (en) 2000-03-24 2001-03-23 A system and method for analyzing, optimizing and/or designing spectral sensitivity curves for an imaging device

Country Status (5)

Country Link
US (1) US7173657B2 (en)
EP (1) EP1287685A1 (en)
KR (1) KR100799950B1 (en)
TW (1) TWI226195B (en)
WO (1) WO2001074058A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003041390A2 (en) * 2001-11-06 2003-05-15 Rochester Institute Of Technology Method and system for optimizing a selection of spectral sensitivities
US7760253B2 (en) * 2005-02-08 2010-07-20 Hewlett-Packard Development Company, L.P. Imaging device analysis methods, imaging device analysis systems, and articles of manufacture
US20080012856A1 (en) * 2006-07-14 2008-01-17 Daphne Yu Perception-based quality metrics for volume rendering
US8108211B2 (en) 2007-03-29 2012-01-31 Sony Corporation Method of and apparatus for analyzing noise in a signal processing system
US8711249B2 (en) 2007-03-29 2014-04-29 Sony Corporation Method of and apparatus for image denoising
US7830429B1 (en) * 2007-07-27 2010-11-09 Hewlett-Packard Development Company, L.P. Optimizing characterization values of image capture apparatus components
JP6354796B2 (en) * 2016-06-23 2018-07-11 カシオ計算機株式会社 Robot, robot control method and program

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2685111B2 (en) * 1992-02-14 1997-12-03 富士写真フイルム株式会社 Image forming method
DE69319979T2 (en) * 1992-09-08 1998-12-10 Fuji Photo Film Co., Ltd., Minami-Ashigara, Kanagawa Image processing system and method for faithful reproduction of the colors of objects on negative film
US5609978A (en) * 1995-06-06 1997-03-11 Eastman Kodak Company Method for producing an electronic image from a photographic element
US6184925B1 (en) * 1996-04-11 2001-02-06 Asahi Kogaku Kogyo Kabushiki Kaisha Lens having color correction data
JP3829363B2 (en) * 1996-06-14 2006-10-04 コニカミノルタホールディングス株式会社 Electronic camera
JP3624604B2 (en) * 1996-12-28 2005-03-02 株式会社ニコン Color reproduction correction apparatus and correction method for imaging apparatus
US5857063A (en) * 1997-03-27 1999-01-05 Eastman Kodak Company Multicolorant process control
US6023525A (en) * 1997-10-23 2000-02-08 Xerox Corporation Determining an optimal color space direction for selecting color modulations
US6331899B1 (en) * 1998-10-14 2001-12-18 Electronics For Imaging, Inc. Method and apparatus for automatically generating single-channel critical color transformations

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO0174058A1 *

Also Published As

Publication number Publication date
US7173657B2 (en) 2007-02-06
WO2001074058A1 (en) 2001-10-04
KR20030007471A (en) 2003-01-23
US20020018128A1 (en) 2002-02-14
TWI226195B (en) 2005-01-01
KR100799950B1 (en) 2008-02-01

Similar Documents

Publication Publication Date Title
US7715050B2 (en) Tonescales for geographically localized digital rendition of people
US7236195B2 (en) Method and system for optimizing a selection of spectral sensitivities
US20010009590A1 (en) Pictorial digital image processing incorporating image and output device modifications
JP4133052B2 (en) Digital imaging system
JP4950544B2 (en) Method for determining color filter parameters of a multiband imaging device
JP2005509167A6 (en) Method and apparatus for optimizing spectral sensitivity selection
JP5464982B2 (en) Imaging apparatus and image processing method
JP4677699B2 (en) Image processing method, image processing device, photographing device evaluation method, image information storage method, and image processing system
US7173657B2 (en) System and method for analyzing, optimizing and/or designing spectral sensitivity curves for an imaging device
US8026954B2 (en) System and computer-readable medium for automatic white balancing
US8654210B2 (en) Adaptive color imaging
Quan et al. Unified measure of goodness and optimal design of spectral sensitivity functions
US7760253B2 (en) Imaging device analysis methods, imaging device analysis systems, and articles of manufacture
Kuniba et al. Spectral sensitivity optimization of color image sensors considering photon shot noise
Cohen A color balancing algorithm for cameras
Quan et al. Optimization of camera spectral sensitivities
JP2008534951A (en) Illuminant estimation
JP2010193380A (en) Photographing apparatus, color conversion processing device, server information processor, client information processor, method of image data processing in server information processor, and method of color conversion processing in client information processor
Quan et al. Optimal design of camera spectral sensitivity functions based on practical filter components
JP2008085975A (en) Imaging element characteristic evaluating method and imaging element characteristics evaluating apparatus
JP4267220B2 (en) Light source discrimination method and apparatus, subject identification method and apparatus, and program
Quan et al. Hierarchical approach to the optimal design of camera spectral sensitivities for colorimetric and spectral performance
Kuniba et al. Spectral sensitivity optimization of color image sensor considering photon shot noise
JP2010055192A (en) Image processor, processing method and program
Lucas et al. Digital Cameras: Definitions and Principles

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20021024

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SONY CORPORATION

Owner name: ROCHESTER INSTITUTE OF TECHNOLOGY

RBV Designated contracting states (corrected)

Designated state(s): AT BE CH DE FR GB LI

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20081001