EP1287685A1 - A system and method for analyzing, optimizing and/or designing spectral sensitivity curves for an imaging device - Google Patents
A system and method for analyzing, optimizing and/or designing spectral sensitivity curves for an imaging deviceInfo
- Publication number
- EP1287685A1 EP1287685A1 EP01922637A EP01922637A EP1287685A1 EP 1287685 A1 EP1287685 A1 EP 1287685A1 EP 01922637 A EP01922637 A EP 01922637A EP 01922637 A EP01922637 A EP 01922637A EP 1287685 A1 EP1287685 A1 EP 1287685A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- spectral sensitivity
- image quality
- color
- imaging device
- set forth
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 230000035945 sensitivity Effects 0.000 title claims abstract description 199
- 230000003595 spectral effect Effects 0.000 title claims abstract description 171
- 238000003384 imaging method Methods 0.000 title claims abstract description 116
- 238000000034 method Methods 0.000 title claims abstract description 63
- 238000009877 rendering Methods 0.000 claims abstract description 17
- 238000012545 processing Methods 0.000 claims description 45
- 238000013461 design Methods 0.000 claims description 16
- 238000011156 evaluation Methods 0.000 claims description 12
- XOFYZVNMUHMLCC-ZPOLXVRWSA-N prednisone Chemical group O=C1C=C[C@]2(C)[C@H]3C(=O)C[C@](C)([C@@](CC4)(O)C(=O)CO)[C@@H]4[C@@H]3CCC2=C1 XOFYZVNMUHMLCC-ZPOLXVRWSA-N 0.000 claims description 5
- 230000006870 function Effects 0.000 description 16
- 230000008569 process Effects 0.000 description 8
- 238000013442 quality metrics Methods 0.000 description 7
- 238000004519 manufacturing process Methods 0.000 description 5
- 230000033458 reproduction Effects 0.000 description 5
- 238000002834 transmittance Methods 0.000 description 5
- 230000001419 dependent effect Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000005055 memory storage Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000003278 mimic effect Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 238000003892 spreading Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/02—Diagnosis, testing or measuring for television systems or their details for colour television signals
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
- G01J3/50—Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
- G01J3/52—Measurement of colour; Colour measuring devices, e.g. colorimeters using colour charts
- G01J3/524—Calibration of colorimeters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
- G01J2003/466—Coded colour; Recognition of predetermined colour; Determining proximity to predetermined colour
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
- G01J3/462—Computing operations in or between colour spaces; Colour management systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
- G01J3/465—Measurement of colour; Colour measuring devices, e.g. colorimeters taking into account the colour perception of the eye; using tristimulus detection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
- G01J3/50—Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors
- G01J3/51—Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors using colour filters
Definitions
- the invention relates generally to imaging and, more particularly, to a method and system for evaluating, optimizing and/or designing one or more spectral sensitivity curves for an imaging device.
- digital imaging devices or systems such as a digital camera or color scanner
- these digital devices comprise a charge-coupled device or complementary metal- oxide-semiconductor (CCD/CMOS) sensor array with a set of filters before it.
- CCD/CMOS complementary metal- oxide-semiconductor
- these digital imaging devices capture color images in a substantially accurate and aesthetically pleasing manner.
- CIE Commission Internationale de l'Eclairage
- the spectral sensitivity functions for color imaging device channels should satisfy the Luther condition, that is the channel spectral sensitivities need not be exact duplicates of the CIE color-matching functions described above, but need to be a nonsingular transformation of them.
- the channel spectral sensitivities need not be exact duplicates of the CIE color-matching functions described above, but need to be a nonsingular transformation of them.
- Measurement noise also plays an important role and will degrade the color accuracy even when spectral sensitivity curves fulfill the Luther condition.
- a measure of goodness or quality factor for evaluating, optimizing, and/or designing spectral sensitivity curves for color imaging devices is desirable.
- developing methods and/or systems for obtaining a measure of goodness or a quality factor has been challenging.
- ⁇ -factor Quality factor for filters whose spectral transmittances are different from color mixture curves, and its application to color photography
- J. Opt. Soc. Am. Vol. 46, No.10, pg. 821-824 (1956) which is herein incorporated by reference.
- a major disadvantage of the Q-factor is that it is designed to evaluate only single spectral sensitivities. Thus, it is easily possible to design an imaging device where all channels associate with high Q-factors, and still the system delivers color signals which cannot be used in creating high quality color reproductions.
- the trivial example of such a system is a three-channel device where all three channels are made with small deviations from the same spectral sensitivity signature. Although all three show high O-factor, the result is a nearly monochrome image.
- Another quality factor, known as the ⁇ -factor, for evaluating and designing spectral sensitivity functions is disclosed in P. L. Nora and H. J. Trussell, "Measure of goodness of a set of color-scanning filters", J. Opt. Soc. Am. A, Nol.10, ⁇ o.7, pg. 1499-1503 (1993), which is herein incorporated by reference.
- the ⁇ -factor is a quality factor which evaluates an arbitrary number of device channel sensitivity functions as an ensemble.
- the ⁇ -factor describes the difference between the orthonormal subspaces of the CIE color matching functions and the spectral sensitivity space.
- a ⁇ -factor approximately equal to one is an indication of an imaging device expected to deliver high quality color reproduction.
- some color imaging devices with a poor ⁇ -factor can still generate a good image reproduction.
- Nora and Trussell have thus introduced a metric which does not have a straight forward correlation with expected image quality.
- Another problem with the ⁇ -factor is that it does not penalize systems that by virtue of channel sensitivity choices tend to amplify system noise. Such noise is unavoidable in real systems and a system designer needs to carefully control it so as to avoid swamping the eventual color reproduction.
- CIELAB color space is a non-linear transfromation of the CIE color matching functions used as an approximation to a perceptually uniform color space.
- a figure of merit for color scanners, based on locally-linearized CIELAB space, having an incorporated model for measurement of noise is present in G. Sharma et al. "Figure of merit for color scanners," IEEE Trans. Image Processing, Vol. 6, No. 7, pg. 990-1001 (1997) which is herein incorporated by reference.
- the new figure has a high degree of perceptual relevance and also accounts for noise performance of sets of channel sensitivities.
- the noise aspect of Sharma' s metric is, however completely independent of the input stimulus and thus is limited in its usefulness.
- a method for determining a color rendering capability of at least one color imaging device with multiple color channels in accordance with one embodiment of the present invention includes a few steps. Spectral sensitivity curves for two or more of the multiple color channels in the color imaging device are obtained. An image quality value for the color imaging device is determined from the spectral sensitivity curves for the two or more of the multiple color channels in the color imaging device. The color rendering capability of the color imaging device can be evaluated based on the determined image quality value.
- a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with another embodiment of the present invention includes selecting an image quality value and then determining a spectral sensitivity curve for at least one of the color channels of the color imaging device so that the spectral sensitivity curves for each of the color channels in the color imaging device results in the image quality value.
- a method for determining the tolerances for one or more color channels in a color imaging device in accordance with another embodiment of the present invention includes a few steps.
- a spectral sensitivity curve for at least one of the multiple color channels in the color imaging device and an image quality value are obtained.
- a first pair of upper and lower peak wavelength tolerances from the obtained spectral sensitivity for the at least one of the multiple color channels and the obtained image quality value are determined.
- a second pair of upper and lower tolerances on the width from the obtained spectral sensitivity curve for at least one of the multiple color channels and the obtained image quality value are determined.
- An imaging device analyzing system in accordance with another embodiment of the present invention includes a source for spectral sensitivity curves for two or more of the multiple color channels in a color imaging device, an image quality processing system, and an evaluation system.
- the image quality processing system determines an image quality value for the color imaging device from the spectral sensitivity curves for the two or more of the multiple color channels in the color imaging device.
- An imaging device designing system in accordance with another embodimen of the present invention includes a selection system and a design processing system.
- the selection system obtains an image quality value.
- the design processing system determines a spectral sensitivity curve for at least one of the color channels of the color imaging device so that the spectral sensitivity curves for each of the color channels in the color imaging device results in the image quality value.
- a system for determining the tolerances for one or more color channels in . * . a color imaging device in accordance with another embodiment of the present invention includes a source and a design processing system.
- the source provides a spectral sensitivity curve for at least one of the multiple color channels in the color imaging device.
- the design processing system determines a first, pair of upper and lower tolerances for the obtained spectral sensitivity for the at least one of the multiple color channels and determines a second pair of upper and lower tolerances on the full width half maximum for the obtained spectral sensitivity curve for at least one of the multiple color channels.
- an objective evaluation of the quality of color images captured by the evaluated imaging device is now provided using an analysis of the spectral sensitivity curves of channels in the imaging device.
- the resulting evaluation also provides information on how much room for improvement there is for the evaluated imaging device.
- the image quality of different imaging devices can now be compared.
- spectral sensitivity curves for an imaging device can be designed or optimized. As a result, an imaging device with a desired level of image quality can be produced. Additionally, with the present invention determinations of image quality versus the cost of obtaining that level of image quality can be made.
- tolerances for spectral sensitivity curves for an imaging device can be determined. These determined tolerances provide an evaluation of the tolerance range of the imaging device. Additionally, these determined tolerances can be used to select other sets of spectral sensitivity curves that might also be used with the same resulting image quality.
- FIG. 1 is a block diagram of a system for evaluating, optimizing and/or designing one or more spectral sensitivity curves for an imaging device in accordance with one embodiment of the present invention
- FIG. 2 is a block diagram of a color channel in an imaging device
- FIG. 3 A is a flow chart of a method for determining a color rendering capability of at least one color imaging device with multiple color channels in accordance with one embodiment of the present invention
- FIG. 3B is a flow chart of a method for determining a color rendering capability of at least one color imaging device with multiple color channels in accordance with another embodiment of the present invention
- FIG. 4A is a flow chart of a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with another embodiment of the present invention
- FIG. 4B is a flow chart of a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with yet another embodiment of the present invention.
- FIG. 5 is a flow chart of a method for determining the tolerances for one or more color channels in a color imaging device in accordance with another embodiment of the present invention.
- FIGS. 1, 3 A, 3B, 4A, 4B, and 5 A system 10 and method for evaluating, optimizing and/or designing one or more spectral sensitivity curves for an imaging device in accordance with one embodiment of the present invention is illustrated in FIGS. 1, 3 A, 3B, 4A, 4B, and 5.
- the method in accordance with one embodiment includes determining an image quality value for the color imaging device from spectral sensitivity curves for two or more of the multiple color channels in the color imaging device and then evaluating the color rendering capability of the color imaging device based on the determined image quality value.
- the present invention can provide an objective evaluation of an imaging device, one or more spectral sensitivity curve or curves for an optimized set of spectral sensitivity curves for the imaging device, and tolerances for one or more spectral sensitivity curves for an imaging device.
- the system 10 includes a spectral sensitivity ("SS") processing system 12 and an optional CCD camera 14, although system 10 may have other components, other numbers of the components, and other combinations of the components.
- the SS processing system 12 is operatively coupled to the camera 14.
- a variety of communication systems and/or methods can be used to operatively couple and communicate between the SS processing system 12 and the camera 14, including a direct connection, a local area network, a wide area network, the world wide web, modems and phone lines, or wireless communication technology each having communications protocols.
- a direct connection a local area network, a wide area network, the world wide web, modems and phone lines, or wireless communication technology each having communications protocols.
- SS processing system 12 includes at least one processor 16, at least one memory 18, at least one input/output interface 20, and a user input device 23 which are coupled together by a bus system 22 or other link, although the SS processing system 12 may comprise other components, other numbers of the components, and other combinations of the components.
- the processor 16 executes a program of stored instructions for at least a portion of the method for evaluating, optimizing and/or designing one or more spectral sensitivity curves for an imaging device in accordance with one embodiment of the present invention as described herein and set forth in FIGS. 3-5.
- a variety of different types of memory storage devices such as a random access memory (RAM) or a read only memory (ROM) in the system or a floppy disk, hard disk, CD ROM, or other computer readable medium which is read from and/or written to by a magnetic, optical, or other reading and/or writing system that is coupled to the processor 16, can be used to store the programmed instructions described herein as well as other information.
- RAM random access memory
- ROM read only memory
- a floppy disk hard disk
- CD ROM or other computer readable medium which is read from and/or written to by a magnetic, optical, or other reading and/or writing system that is coupled to the processor 16
- the input/output interface 20 is used to operatively couple and communicate between the SS processing system 12 and the camera 14.
- the user input device 23 enables an operator to generate and transmit signals or commands to the processor 16, such as an image quality value, a set of tolerances for spectral sensitivity curves, or one or more selected spectral sensitivity curves for analysis.
- signals or commands such as an image quality value, a set of tolerances for spectral sensitivity curves, or one or more selected spectral sensitivity curves for analysis.
- a variety of different types of user input devices can be used, such as a keyboard or computer mouse.
- the color channel in the imaging device includes a filter 24, a detector 26, and an analog-to- digital converter 28, although the color channel in the imaging device can comprise other components and other combinations of components.
- Each component of an imaging device color channel has a certain response to its expected input.
- the color filter 24 has a spectral transmission wherein photons at different wavelengths from scene radiation hv have different probabilities of being passed through to the detector 26. Such transmission properties can be precisely determined.
- the detector 26 has a spectral sensitivity wherein for any photon from scene radiation hv ' which passes through filter 24 is incident upon the detector 26.
- step 50 a flow chart for analyzing a color rendering capability of at least one color imaging device with multiple color channels in accordance with one embodiment of the present invention is illustrated. In step 50, this method starts.
- spectral sensitivity curves or functions for two or more of the multiple color channels in the color imaging device are obtained.
- Spectral sensitivity of a color imaging device or system is defined as the product of the spectral sensitivity of the imaging detector and the transmittance of the filter.
- a useful simplified model assumes the spectral sensitivity to be a smooth single- peaked curve in visible range with nonnegative values, although real channel spectral sensitivities may be more complex.
- the spectral sensitivity curves are retrieved from memory 18 from a prior measurement of an imaging device, although the spectral sensitivity curves can be obtained in a variety of other manners, such as, from another memory storage device, by generating the spectral sensitivity curves hypothetically or by operator input via user input device 23.
- the spectral sensitivity curves can be generated hypothetically by SS processing system 12. More specifically, the spectral sensitivities for the simplified model can be simulated by a combination of smooth cubic spline functions.
- step 54 the obtained spectral sensitivity curves from step 52 are used by the SS processing system 12 to determine a ⁇ -factor.
- the ⁇ -factor is calculated by summing the g-factors of the orthonormalized vectors of the obtained spectral sensitivity curves and dividing the summation by three, although other manners for determining a ⁇ -factor can be used. Since the process of determining a ⁇ -factor and ⁇ -/-factors are known, they will not be described in detail here.
- a color difference metric value in this case a delta E (“ E") value, for the color imaging device is determined in SS processing system 12 from the ⁇ -factor, although other combinations of the ⁇ -factor and/or other quality factors could also be used to determine the color difference metric value.
- E delta E
- a relationship between ⁇ -factor and E stored in memory 18 is used by processor 16 to determine the color difference metric value.
- One example of such a derived relationship between ⁇ -factor and E is set forth below:
- the color difference metric value in this particular embodiment is obtained by averaging the minimum and maximum expected E value expected for the determined ⁇ -factor. For example, a ⁇ -factor of 0.98 would result in color difference metric value of 1.85.
- step 60 the color rendering capability of the color imaging device is evaluated based on the determined image quality value.
- image quality value is compared against a standard to provide an evaluation, e.g. a standard might state that an image quality value of zero is ideal, an image quality value of 0 to 2.0 is acceptable, and an image quality value above 2.0 is unacceptable, although other types of evaluations could be used.
- a standard might state that an image quality value of zero is ideal, an image quality value of 0 to 2.0 is acceptable, and an image quality value above 2.0 is unacceptable, although other types of evaluations could be used.
- the image quality values of two different imaging devices could also be compared against each other to identify the imaging device which would produce color images with better quality.
- a color difference metric value is determined, other types of image quality values could also be determined, such as a color quality and noise sensitivity metric value.
- An image quality value is a number which correlates how well an image fits associated quality criteria from the view point of a typical human observer.
- a color quality metric value is an image quality value based on the criteria of how well the channel sensitivities of a device correlate with the human visual system.
- a color difference metric value is an image quality value which correlates with the magnitude of change in color a typical human observer would detect between two images.
- a color quality and noise sensitivity metric value an image quality value based on color criteria and an image quality value based on quantifying how the amplification of noise in a system affects perceived quality to a human observer.
- step 62 this method starts.
- step 64 spectral sensitivity curves or functions for two or more of the multiple color channels in the color imaging device are obtained. Since the process in step 64 is identical to that described earlier in step 52, it will not described again here.
- step 66 the obtained spectral sensitivity curves from step 52 are used by the SS processing system 12 to determine a Universal Measure of Goodness (UMG) factor.
- UMG takes into account the total noise of the system, both shot noise which is signal dependent and dark noise which is signal independent, and an expected average color difference. Total noise is measured through the sum of the shot noise covariance and the dark current noise co variance, while the expectation of the noise is still zero.
- ⁇ is the information content which would be delivered by the system described by the spectral sensitivity curves.
- ⁇ is a function of the total noise and the average E.
- ⁇ is the information content which a perfectly noise-free colorimetric system would deliver.
- UMG is the ratio of ⁇ to ⁇ .
- a color quality and noise sensitivity metric value for the color imaging device is determined in SS processing system 12 from the UMG factor, although other combinations of the UMG factor and/or other quality factors could also be used to determine the color quality and noise sensitivity metric value.
- a relationship between the UMG factor and E stored in memory 18 is used by processor 16 to determine the color difference metric value. Since the process in this step is the same as described earlier in step 58 except a color quality and noise sensitivity metric value is being determined here instead of a color difference metric value and a UMG factor is used here instead of a ⁇ -factor, the process will not described again here.
- One of the advantages of this method is the use of a noise sensitivity metric because it involves a consideration of image-dependent noise.
- Image dependent noise is noise dependent on the input signal level, rather than independent, white noise as described in greater detail in Gerald C. Hoist, "CCD Arrays Cameras and Displays", SPIE Optical Engineering Press 1998 which is herein incorporated by reference.
- this embodiment of the present invention generates an image quality metric value which is more coincident with what occurs in the real world.
- step 72 the color rendering capability of the color imaging device is evaluated based on the determined color quality and noise sensitivity metric value. Since the process in step 68 is identical to that described earlier in step 56, except that the evaluation is based using a color quality and noise sensitivity metric value instead of a color difference metric value, it will not described again here.
- FIG. 4A is a flow chart of a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with another embodiment of the present invention is illustrated.
- this method starts.
- an image quality value is obtained.
- user input device 23 can be used to select or input the image quality value or the value could be retrieved from a memory device.
- image quality metric values could be used, such as a color difference metric value or a color quality and noise sensitivity metric value.
- the SS processing system 12 uses the obtained image quality value to obtain or retrieve one or more tables, sets, or enumerations of combinations of spectral sensitivity curves from memory 18.
- the one or more tables sets, or enumerations of combinations of spectral sensitivity curves can be obtained in a variety of different manners, such as based on the image quality value itself or on a portion of the image quality value, such as a ⁇ -factor on which the image quality value is at least partially based or on other factors. Two illustrative examples of such tables set forth below.
- the tables are stored in memory 18, although the tables could be stored elsewhere.
- the tables are accessed by processor 16 to determine the spectral sensitivity curve(s) which are unknown needed or desired for the particular application.
- step 80 the known spectral sensitivity curves are used to identify a combination or combinations of spectral sensitivity curves in the obtained table that could be used for the particular application.
- step 82 one of the identified combinations of spectral sensitivity curves is selected.
- factors could be used by SS processing system 12 to determine how this selection is made, such as which combination of spectral sensitivity curves would have the best color rendering capability or by an operator making a selection using user input device 23.
- step 84 the missing and desired spectral sensitivity curve or curves are determined from the selected combination.
- the selected combination will contain the needed information and/or data on the missing and desired spectral sensitivity curve or curves.
- this method is set forth below. If, for example, one chooses to design a third channel for a three-channel system where an image quality value is selected that is based at least partly on a ⁇ -factor with a desired value of 0.98, then Table I would be selected.
- the spectral sensitivity curve(s) is determined using tables, the selected image quality value, and the known spectral sensitivity curves, other methods for determining ⁇ the spectral sensitivity curve may also be used.
- FIG. 4B is a flow chart of a method for designing a spectral sensitivity curve for one or more color channels of a color imaging device in accordance with another embodiment of the present invention is illustrated.
- this method starts.
- step 88 an image quality value is obtained. Since the process in step 88 is identical to that described earlier in step 76, it will not described again here.
- step 90 the SS processing system 12 uses the obtained image quality value to obtain or retrieve one or more tables, sets, or enumerations of combinations of spectral sensitivity curves from memory 18. Since the process in step 90 is identical to that described earlier in step 78, it will not described again here.
- one or more characteristics are used by SS processing system 12 to identify a combination or combinations of spectral sensitivity curves in the obtained table that could be used for the particular application.
- a variety of different characteristics, numbers of characteristics (one or more than one, and a variety of different combinations can be used as needed or desired for the particular application.
- the characteristics can be obtained in a variety of different manners, such as from memory 18 or via operator input using user input device 23.
- step 94 one of the identified combinations of spectral sensitivity curves is selected.
- factors could be used by SS processing system 12 to determine how this selection is made, such as which combination of spectral sensitivity curves would have the best color rendering capability or by an operator making a selection using user input device 23.
- step 96 the desired spectral sensitivity curves are obtained from the selected combination.
- the selected combination will contain the needed information and/or data on these spectral sensitivity curves.
- Table I would be selected in this example. For that table, every channel sensitivity combination described in that table is associated with a ⁇ -factor of 0.98.
- the ⁇ -factor for an image quality value can be used to select a set or table of spectral sensitivity curves.
- an optimization approach can be used by SS processing system 12 to select one of the combinations of spectral sensitivity curves.
- three or more spectral sensitivity curves could be optimized by maximizing the image quality metric within one or more constraints.
- these constraints can be:
- the transmittance of spectral sensitivity at each wavelength is non-negative.
- the transmittance at each wavelength cannot exceed one, or a constant that is less than one.
- the transmittance of the filter has one global maximum, and without local maximum.
- constraints are discussed above, a variety of different types of constraints and combinations of them can be used depending upon the particular application and its requirements.
- FIG. 5 a flow chart of a method for determining the tolerances for one or more color channels in a color imaging device in accordance with another embodiment of the present invention is illustrated.
- this method starts.
- step 100 a spectral sensitivity curve for at least one of the multiple color channels in the color imaging device is obtained in a manner as described in greater detail earlier.
- step 102 an image quality value is obtained. Since methods and systems for obtaining spectral sensitivity curve(s) and/or image quality values are discussed earlier, they will not be described here again.
- a first pair of upper and lower tolerances on the peak wavelength is determined for the obtained spectral sensitivity curves for one of the multiple color channels.
- These tolerances may be obtained by processor 16 through reference to the tables stored in memory 18, such as the tables which are set forth below as examples.
- the table used is selected based on the obtained image quality value as described in greater detail earlier.
- the tables are useful in determining desirable channel spectral sensitivities for three-channel imaging devices. These tables provide manufacturing guidance on the choice of curves.
- the ⁇ -factor used in deriving the tables is a color quality metric.
- the tables describe tolerances on the specification of the "red” and "blue" channels in a three-channel system.
- the tolerances are in terms of peak wavelength error which maintain the ⁇ -factor at or above the desired level.
- the first table maintains a ⁇ - factor of at least 0.98
- the second maintains at least a ⁇ -factor of 0.95.
- step 106 a second pair of upper and lower tolerances on the full width half maximum is determined from the obtained spectral sensitivity curve for one of the multiple color channels.
- tolerances may also be obtained through reference to the tables, such as the exemplary tables incorporated below in the same manner as described above in step 104.
- the spectral sensitivity curve or curves are evaluated based on the determined first and second pair of tolerances.
- the first and second pair of tolerances may provide an indication on the ease or difficulty in reproducing an imaging device with the same color rendering capability. If the tolerances are small, then it will be difficult to obtain imaging devices with the same color rendering capability.
- Table I Peak wavelength tolerances based on single-peak symmetric or asymmetric channel sensitivities for three channel cameras with ⁇ -factor of .98 or larger
- Table II Peak wavelength tolerances based on single-peak symmetric or asymmetric channel sensitivities for three channel cameras with ⁇ -factor of .95 or larger
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Spectrometry And Color Measurement (AREA)
- Facsimile Image Signal Circuits (AREA)
- Image Processing (AREA)
Abstract
Description
Claims
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US19180000P | 2000-03-24 | 2000-03-24 | |
US191800P | 2000-03-24 | ||
PCT/US2001/009434 WO2001074058A1 (en) | 2000-03-24 | 2001-03-23 | A system and method for analyzing, optimizing and/or designing spectral sensitivity curves for an imaging device |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1287685A1 true EP1287685A1 (en) | 2003-03-05 |
Family
ID=22706980
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP01922637A Withdrawn EP1287685A1 (en) | 2000-03-24 | 2001-03-23 | A system and method for analyzing, optimizing and/or designing spectral sensitivity curves for an imaging device |
Country Status (5)
Country | Link |
---|---|
US (1) | US7173657B2 (en) |
EP (1) | EP1287685A1 (en) |
KR (1) | KR100799950B1 (en) |
TW (1) | TWI226195B (en) |
WO (1) | WO2001074058A1 (en) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2003041390A2 (en) * | 2001-11-06 | 2003-05-15 | Rochester Institute Of Technology | Method and system for optimizing a selection of spectral sensitivities |
US7760253B2 (en) * | 2005-02-08 | 2010-07-20 | Hewlett-Packard Development Company, L.P. | Imaging device analysis methods, imaging device analysis systems, and articles of manufacture |
US20080012856A1 (en) * | 2006-07-14 | 2008-01-17 | Daphne Yu | Perception-based quality metrics for volume rendering |
US8108211B2 (en) | 2007-03-29 | 2012-01-31 | Sony Corporation | Method of and apparatus for analyzing noise in a signal processing system |
US8711249B2 (en) | 2007-03-29 | 2014-04-29 | Sony Corporation | Method of and apparatus for image denoising |
US7830429B1 (en) * | 2007-07-27 | 2010-11-09 | Hewlett-Packard Development Company, L.P. | Optimizing characterization values of image capture apparatus components |
JP6354796B2 (en) * | 2016-06-23 | 2018-07-11 | カシオ計算機株式会社 | Robot, robot control method and program |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2685111B2 (en) * | 1992-02-14 | 1997-12-03 | 富士写真フイルム株式会社 | Image forming method |
DE69319979T2 (en) * | 1992-09-08 | 1998-12-10 | Fuji Photo Film Co., Ltd., Minami-Ashigara, Kanagawa | Image processing system and method for faithful reproduction of the colors of objects on negative film |
US5609978A (en) * | 1995-06-06 | 1997-03-11 | Eastman Kodak Company | Method for producing an electronic image from a photographic element |
US6184925B1 (en) * | 1996-04-11 | 2001-02-06 | Asahi Kogaku Kogyo Kabushiki Kaisha | Lens having color correction data |
JP3829363B2 (en) * | 1996-06-14 | 2006-10-04 | コニカミノルタホールディングス株式会社 | Electronic camera |
JP3624604B2 (en) * | 1996-12-28 | 2005-03-02 | 株式会社ニコン | Color reproduction correction apparatus and correction method for imaging apparatus |
US5857063A (en) * | 1997-03-27 | 1999-01-05 | Eastman Kodak Company | Multicolorant process control |
US6023525A (en) * | 1997-10-23 | 2000-02-08 | Xerox Corporation | Determining an optimal color space direction for selecting color modulations |
US6331899B1 (en) * | 1998-10-14 | 2001-12-18 | Electronics For Imaging, Inc. | Method and apparatus for automatically generating single-channel critical color transformations |
-
2001
- 2001-03-22 US US09/814,634 patent/US7173657B2/en not_active Expired - Fee Related
- 2001-03-23 EP EP01922637A patent/EP1287685A1/en not_active Withdrawn
- 2001-03-23 WO PCT/US2001/009434 patent/WO2001074058A1/en active Application Filing
- 2001-03-23 KR KR1020027012368A patent/KR100799950B1/en not_active IP Right Cessation
- 2001-05-18 TW TW090107054A patent/TWI226195B/en not_active IP Right Cessation
Non-Patent Citations (1)
Title |
---|
See references of WO0174058A1 * |
Also Published As
Publication number | Publication date |
---|---|
US7173657B2 (en) | 2007-02-06 |
WO2001074058A1 (en) | 2001-10-04 |
KR20030007471A (en) | 2003-01-23 |
US20020018128A1 (en) | 2002-02-14 |
TWI226195B (en) | 2005-01-01 |
KR100799950B1 (en) | 2008-02-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7715050B2 (en) | Tonescales for geographically localized digital rendition of people | |
US7236195B2 (en) | Method and system for optimizing a selection of spectral sensitivities | |
US20010009590A1 (en) | Pictorial digital image processing incorporating image and output device modifications | |
JP4133052B2 (en) | Digital imaging system | |
JP4950544B2 (en) | Method for determining color filter parameters of a multiband imaging device | |
JP2005509167A6 (en) | Method and apparatus for optimizing spectral sensitivity selection | |
JP5464982B2 (en) | Imaging apparatus and image processing method | |
JP4677699B2 (en) | Image processing method, image processing device, photographing device evaluation method, image information storage method, and image processing system | |
US7173657B2 (en) | System and method for analyzing, optimizing and/or designing spectral sensitivity curves for an imaging device | |
US8026954B2 (en) | System and computer-readable medium for automatic white balancing | |
US8654210B2 (en) | Adaptive color imaging | |
Quan et al. | Unified measure of goodness and optimal design of spectral sensitivity functions | |
US7760253B2 (en) | Imaging device analysis methods, imaging device analysis systems, and articles of manufacture | |
Kuniba et al. | Spectral sensitivity optimization of color image sensors considering photon shot noise | |
Cohen | A color balancing algorithm for cameras | |
Quan et al. | Optimization of camera spectral sensitivities | |
JP2008534951A (en) | Illuminant estimation | |
JP2010193380A (en) | Photographing apparatus, color conversion processing device, server information processor, client information processor, method of image data processing in server information processor, and method of color conversion processing in client information processor | |
Quan et al. | Optimal design of camera spectral sensitivity functions based on practical filter components | |
JP2008085975A (en) | Imaging element characteristic evaluating method and imaging element characteristics evaluating apparatus | |
JP4267220B2 (en) | Light source discrimination method and apparatus, subject identification method and apparatus, and program | |
Quan et al. | Hierarchical approach to the optimal design of camera spectral sensitivities for colorimetric and spectral performance | |
Kuniba et al. | Spectral sensitivity optimization of color image sensor considering photon shot noise | |
JP2010055192A (en) | Image processor, processing method and program | |
Lucas et al. | Digital Cameras: Definitions and Principles |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20021024 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: SONY CORPORATION Owner name: ROCHESTER INSTITUTE OF TECHNOLOGY |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AT BE CH DE FR GB LI |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20081001 |