US6373532B1 - Method and apparatus for processing image data - Google Patents
Method and apparatus for processing image data Download PDFInfo
- Publication number
- US6373532B1 US6373532B1 US09/457,159 US45715999A US6373532B1 US 6373532 B1 US6373532 B1 US 6373532B1 US 45715999 A US45715999 A US 45715999A US 6373532 B1 US6373532 B1 US 6373532B1
- Authority
- US
- United States
- Prior art keywords
- data
- complementary color
- generate
- difference
- color data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
- 238000000034 method Methods 0.000 title claims description 24
- 230000000295 complement effect Effects 0.000 claims abstract description 120
- 239000003086 colorant Substances 0.000 claims abstract description 24
- 239000011159 matrix material Substances 0.000 claims abstract description 16
- 238000000605 extraction Methods 0.000 claims description 6
- 230000002194 synthesizing effect Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 12
- 230000003595 spectral effect Effects 0.000 description 7
- 238000002834 transmittance Methods 0.000 description 5
- 239000000284 extract Substances 0.000 description 4
- 230000015654 memory Effects 0.000 description 4
- 230000035945 sensitivity Effects 0.000 description 3
- 238000003672 processing method Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000002542 deteriorative effect Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/646—Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/135—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements
- H04N25/136—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements using complementary colours
Definitions
- the present invention relates to a method and an apparatus for processing image data, and more particularly, to an image data processing method which generates color difference data from complementary color data representing complementary color components.
- FIG. 1 is a block diagram showing the configuration of a conventional image sensing device which uses a CCD image sensor 1
- FIG. 2 is a plan view showing an example of a conventional mosaic color filter attached to the CCD image sensor 1 .
- the CCD image sensor 1 has a plurality of light-receiving pixels, a plurality of vertical shift registers and usually a horizontal shift register.
- the light-receiving pixels are arranged in a matrix form on a light-receiving surface at regular intervals and produce and store information charges corresponding to the image of a sensed object.
- the vertical shift registers are arranged to correspond to the columns of the light-receiving pixels and sequentially shift the information charges stored in the light-receiving pixels in the vertical direction.
- the horizontal shift register is arranged on the output side of the vertical shift registers and receives the information charges output from the vertical shift registers, and then transfers the information charges row by row. This allows the horizontal shift register to output an image signal I 0 in accordance with the information charges stored in the light-receiving pixels.
- An analog processing circuit 2 performs a process, such as sampling and holding or level clamping, on the image signal I 0 input from the CCD image sensor 1 to produce an image signal I 1 which conforms to a predetermined format. For example, in the sample and hold process, only an image signal having a certain-signal level is extracted from the image signal I 0 having reset levels and signal levels which are alternately repeated in synchronism with the output operation of the CCD image sensor 1 . In the level clamping process, the black reference level set at the end of the horizontal scanning period of the image signal I 0 is clamped to a predetermined level every horizontal scanning period. An A/D converter circuit 3 quantizes the image signal I 1 received from the analog processing circuit 2 to generate image data D which represents the information with a digital value corresponding to each light-receiving pixel of the CCD image sensor 1 .
- a process such as sampling and holding or level clamping
- a digital processing circuit 4 performs a process, such as color distribution or a matrix operation, on the image data D received from the A/D converter circuit 3 and generates luminance data Y and color difference data U and V.
- a process such as color distribution or a matrix operation
- the image data D is distributed in accordance with the color arrangement of a color filter attached to the light-receiving surface of the CCD image sensor 1 , generating a plurality of color component data.
- the matrix operation process primary color data corresponding to the three primary colors of light are generated from the individually distributed color component data, and are then combined at a predetermined ratio, thereby generating the color difference data U, V.
- a driver 5 responds to various timing signals from a timing control circuit 6 and supplies a multi-phase drive clock to the shift registers of the CCD image sensor 1 .
- a 4-phase vertical transfer clock ⁇ v is supplied to the vertical shift registers
- a 2-phase horizontal transfer clock ⁇ h is supplied to the horizontal shift register.
- the timing control circuit 6 produces a vertical timing signal VT, which determines the vertical scan timing of the CCD image sensor 1
- a horizontal timing signal HT which determines the horizontal scan timing
- the timing control circuit 6 supplies a timing clock CT to the analog processing circuit 2 , the A/D converter circuit 3 , and the digital processing circuit 4 in order to synchronize the operations of the circuits 2 , 3 , 4 with the output operation of the CCD image sensor 1 .
- a color filter for color distribution is attached to the light-receiving surface in order to associate the individual light-receiving pixels of the CCD 1 with predetermined color components.
- a stripe type filter having a plurality of segments connected in the vertical direction or a mosaic type filter having a plurality of segments associated with the light-receiving pixels may be used as the color filter.
- the mosaic type color filter shown in FIG. 2, is split into a plurality of segments corresponding to each pixel of the light-receiving section of the CCD image sensor 1 and color components of Ye (yellow), Cy (cyan), W (white) and G (green) are cyclically assigned to each segment.
- the W and G components are alternately arranged in odd rows and the Ye and Cy components are alternately arranged in even rows.
- the W and G components are repeated when reading odd rows and the Ye and Cy components are repeated when reading even rows.
- FIG. 3 is a block diagram showing the configuration of the digital signal processing circuit 4
- FIG. 4 is a timing diagram for describing the operation of the processing circuit 4 .
- FIG. 4 corresponds to the case where the mosaic type color filter shown in FIG. 2 is attached to the CCD image sensor 1 .
- a color distribution circuit 11 separates the image data D in which each color component continues in the arrangement order of the segments of the color filter. The distribution circuit 11 then generates color component data C[Ye], C[Cy], C[G] and C[W]. For the image data D input from the A/D converter circuit 3 , as shown in FIG. 4, the G and W components continue alternately when reading odd rows (ODD) and the Ye and Cy components continue alternately when reading even rows (EVEN). Accordingly, the color distribution circuit 11 retains at least one row of the image data D to allow the output of all the color component data C[Ye], C[Cy], C[G] and C[W] at the time of reading each row.
- the color distribution circuit 11 separates the image data D for the odd row and outputs the color component data C[G] and C[W]. At the same time, the color distribution circuit 11 separates the image data D for the previously read even row and outputs the color component data C[Ye] and C[Cy]. Further, this scheme causes the color component data C[Ye], C[Cy], C[G] and C[W] to be output intermittently when the image data D is output serially. The intermittent portions of the color component data are then interpolated by outputting the same color component data twice in succession.
- a color calculation circuit 12 performs a color computation process according to, for example, the following equations on the color component data C[Ye], C[Cy], C[G] and C[W] input from the color distribution circuit 11 , to generate primary color data P[R], P[G] and P[B] corresponding to the three primary colors (R: red, G: green and B: blue) of light.
- a white balance control circuit 13 assigns specific gains to each of the primary color data P[R], P[G] and P[B] input from the color calculation circuit 12 to adjust the balance of each color. In other words, in the white balance control circuit 13 , because this adjustment compensates for differences in the sensitivities of the light-receiving pixels of the CCD image sensor 1 which depend on each color component, the gains of the primary color data P[R], P[G] and P[B] are individually set to improve the color reproduction of a reproduced image.
- a color difference matrix circuit 14 generates the color difference data U and V from the primary color data P[R], P[G] and P[B] input from the white balance control circuit 13 .
- the color difference matrix circuit 14 combines the respective primary color data P[R], P[G] and P[B] at a ratio of 3:6:1 to generate luminance information. Then, the color difference matrix circuit 14 subtracts the luminance information from the primary color data P[B] corresponding to the B component to generate the color difference data U. Further, the color difference matrix circuit 14 subtracts the luminance information from the primary color data P[R] corresponding to the R component to generate the color difference data V.
- An aperture circuit 16 enhances a specific frequency component included in the luminance data to generate aperture data, and adds the aperture data to the luminance data to generate a luminance data signal Y.
- the aperture circuit 16 performs a filtering process on the image data D to generate aperture data such that the frequency component of one fourth the sampling frequency, which is used to obtain the image data D from the image signal, is enhanced.
- the luminance data signal Y generated in this manner is supplied to an external display device or recording device together with the color difference data U and V.
- the R or B component may show a negative value because of the unevenness of spectral characteristics of the color filter.
- the Ye or Cy component has a slightly higher value than the G component, and the R or B component show a positive value close to “0”.
- the R or B component has a negative value as a result of the color computation process.
- Such negative values are not original color components, and thus produce false signals, thereby deteriorating the image quality of the reproduced image.
- the present invention provides a method for generating a first color difference data and a second color difference data by processing a first complementary color data, a second complementary color data, and a third complementary color data, each representing a respective complementary color of one of the three primary colors.
- the method includes the steps of multiplying the first complementary color data and the second complementary color data to generate a first product, multiplying the first complementary color data and the third complementary color data to generate a second product, multiplying the second complementary color data and the third complementary color data to generate a third product, subtracting the second product from the first product to generate a first difference, subtracting the second product from the third product to generate a second difference, extracting the square root of an absolute value of the first difference to generate a first root, extracting the square root of an absolute value of the second difference to generate a second root, adding a polarity indication code of the first difference to the first root, adding a polarity indication code of the second difference to the second root, and synthesizing the first and second roots, to which the polarity indication codes have been added, to generate the first and second color difference data.
- a further aspect of the present invention provides an apparatus for generating a first color difference data and a second color difference data by processing image data including a first complementary color data, a second complementary color data, and a third complementary color data, each representing a respective complementary color of one of the three primary colors.
- the apparatus includes a distribution circuit for distributing the image data into the first complementary color data, the second complementary color data, and the third complementary color data.
- a multiplication circuit multiplies the first complementary color data and the second complementary color data to generate a first product, the first complementary color data and the third complementary color data to generate a second product, and the second complementary color data and the third complementary color data to generate a third product.
- a subtraction circuit subtracts the second product from the first product to generate a first difference, and the second product from the third product to generate a second difference.
- a square root extraction circuit extracts a square root of an absolute value of the first difference to generate a first root, and a square root of an absolute value of the second difference to generate a second root.
- a polarity adding circuit adds a polarity indicating code of the first difference to the first root, and a polarity indicating code of the second difference to the second root to generate first and second polarized roots.
- a color difference matrix circuit synthesizes the first and second polarized roots to generate the first and second color difference data.
- Another aspect of the present invention provides an apparatus for generating first and second color difference data by processing image data including a first complementary color data, a second complementary color data, and a third complementary color data, each of the first to third complementary color data representing a respective complementary color of the three primary colors of light.
- the apparatus includes a distribution circuit for distributing the image data into the first complementary color data, the second complementary color data, and the third complementary color data.
- a color balance control circuit is connected to the distribution circuit to apply a gain to each of the first to third complementary color data and generate first to third gain adjusted complementary color data.
- a multiplication circuit is connected to the color balance control circuit to multiply the first gain adjusted complementary color data and the second gain adjusted complementary color data to generate a first product, the first gain adjusted complementary color data and the third gain adjusted complementary color data to generate a second product, and the second gain adjusted complementary color data and the third gain adjusted complementary color data to generate a third product.
- a subtraction circuit subtracts the second product from the first product to generate a first difference, and the second product from the third product to generate a second difference.
- a square root extraction circuit extracts a square root of an absolute value of the first difference to generate a first root, and a square root of an absolute value of the second difference to generate a second root.
- a polarity adding circuit adds a polarity indicating code of the first difference to the first root, and a polarity indicating code of the second difference to the second root to generate first and second polarized roots.
- a color difference matrix circuit synthesizes the first and second polarized roots to generate the first and second color difference data.
- FIG. 1 is a schematic block diagram showing the configuration of a conventional solid-state image sensor
- FIG. 2 is a diagram showing an example of a conventional mosaic type color filter
- FIG. 3 is a schematic block diagram of a digital processing circuit of the image sensor of FIG. 1;
- FIG. 4 is a timing chart for describing the operation of the conventional image data processing circuit of FIG. 3;
- FIG. 5 is a block diagram of an image data processing apparatus according to a first embodiment of the present invention.
- FIG. 6 is a timing chart for describing the operation of the image data processing apparatus of FIG. 5;
- FIG. 7 is a graph illustrating the spectral characteristic of a color filter
- FIG. 8 is a diagram showing an example of a mosaic type color filter in accordance with the present invention.
- FIG. 9 is a block diagram of a color distribution section of the present invention associated with the mosaic filter of FIG. 8 .
- FIG. 5 is a block diagram showing the configuration of an image data processing apparatus according to the present invention
- FIG. 6 is a timing chart for describing the operation of the apparatus. It is assumed in this case that the image data D input to the apparatus, for example, is obtained from an image sensor to which a stripe type color filter is attached.
- the stripe type color filter comprises the complementary colors of light (Ye: yellow, Mg: magenta and Cy: cyan), and the image data D repeats the three complementary color components.
- a color distribution circuit 21 separates the image data D, which is input per pixel, for each color component and generates complementary color data C[Ye], C[Mg], and C[Cy] corresponding to Ye, Mg, and Cy.
- the complementary color data C[Ye], C[Mg], and C[Cy] representing the complementary color components are generated by distributing the image data D into three parts in a given order.
- First to third latch circuits 22 a to 22 c are connected in parallel to the color distribution circuit 21 and latch the complementary color data C[Ye], C[Mg] and C[Cy] provided by the color distribution circuit 21 , respectively, and output the latched data until the next data is provided from the color distribution circuit 21 . Since each of the complementary color data C[Ye], C[Mg] and C[Cy] is one third the image data D and the image data D is updated once every three pixels, three consecutive pixels are represented using the same data.
- a color balance circuit 23 applies an inherent gain, which is set for each color, to each of the complementary data C[Ye], C[Mg], C[Cy] sent from the corresponding first to third latch circuits 22 a - 22 c in order to adjust the balance of each color.
- the gain of each color is determined by integrating the complementary color data C[Ye], C[Mg], C[Cy] by a predetermined period and equalizing the integral values.
- a first multiplication circuit 24 a multiplies the balance adjusted complementary data C[Ye] and C[Mg] from the color balance circuit 23 to generate a first product P[r].
- a second multiplication circuit 24 b multiplies the balance adjusted complementary data C[Ye] and C[Cy] to generate a second product P[g].
- a third multiplication circuit 24 c multiplies the balance adjusted complementary data C[Mg] and C[Cy] to generate a third product P[b].
- a first subtraction circuit 25 a is connected to the first and second multiplication circuits 24 a, 24 b and subtracts the second product P[g], which is sent from the second multiplication circuit 24 b, from the first product P[r], which is sent from the first multiplication circuit 24 a, to generate a first difference S[r].
- a second subtraction circuit 25 b is connected to the second and third multiplication circuits 24 b, 24 c and subtracts the second product P[g], which is sent from the second multiplication circuit 24 b, from the third product P[b], which is sent from the third multiplication circuit 24 c to generate a second difference S[b].
- a first absolute value circuit 26 a is connected to the first subtraction circuit 25 a to generate a first absolute value A[r] of the first difference S[r].
- the first absolute value circuit 26 a also extracts a first code Q[r], which indicates whether the value of the first difference S[r] is positive or negative, and sends the code Q[r] to a polarity adding circuit 28 a (described later).
- a second absolute value circuit 26 b is connected to the second subtraction circuit 25 b to generate a second absolute value A[b] of the second difference S[b].
- the second absolute value circuit 26 b also extracts a second code Q[b], which indicates whether the value of the second difference S[b] is positive or negative, and sends the code Q[b] to a polarity adding circuit 28 b (described later).
- a first square root extraction circuit 27 a is connected to the first absolute value circuit 26 a to calculate the square root of the first absolute value A[r] and generate a first root R 1 [r].
- a second square root extraction circuit 27 b is connected to the second absolute value circuit 26 b to calculate the square root of the second absolute value A[b] and generate a second root R 1 [b].
- the first polarity adding circuit 28 a adds the first code Q[r], sent from the first absolute value circuit 26 a, to the first root R 1 [r] to generate a polarized first root R 2 [r].
- the second polarity adding circuit 28 b adds the second code Q[b], sent from the second absolute value circuit 26 b, to the second root R 1 [b] to generate a polarized second root R 2 [b].
- a color difference matrix circuit 29 is connected to the first and second polarity adding circuits 28 a, 28 b to synthesize the polarized first and second roots R 2 [r], R 2 [b] and generate color difference data U, V.
- the color difference matrix circuit 29 is formed so that, for example, the second polarized root R 2 [b] is multiplied by a first predetermined multiplier and the product is added to the first polarized root R 2 [r] to generate the color difference data V, and the first polarized root R 2 [r] is multiplied by a second predetermined multiplier and the product is added to the second polarized root R 2 [g] to generate the color difference data U.
- FIG. 7 is a diagram showing spectral characteristics of a color filter associated with the three primary colors of light and their complementary colors.
- color filters corresponding to the three primary colors of light have spectral characteristics shown by the dashed lines of FIG. 7 .
- the transmittance of the R filter is maximal at the portion corresponding to the red light, which wavelength is long, and low at the portion where the wavelength is shorter than the red light.
- the transmittance of the B filter is maximal at the portion corresponding to the blue light, wavelength is short, and low at the portion where the wavelength is longer than blue.
- the characteristic of the G filter comes between the R filter and the B filter.
- filters corresponding to the complementary colors (Ye, Mg and Cy) of R, G and B have spectral characteristics shown by the solid lines of FIG. 7 . That is, the Cy filter, which is the complementary color of R, has a characteristic contrary to that of the R filter. The transmittance of the Cy filter increases where the wavelength is short and the portion corresponding to the red light is not included.
- the Ye filter which is the complementary color of B, has a characteristic contrary to that of the B filter. The transmittance of the Ye filter increases where the wavelength is long and the portion corresponding to the blue right is not included.
- the transmittance of the Mg filter which is the complementary color of G, increases where the portion corresponding to the green light is not included.
- Multiplication of the Cy component, which is produced in accordance with the light transmitted through the Cy filter, and the Mg component, which is produced in accordance with the light transmitted through the Mg filter enhances the B component included in both Cy and Mg components and attenuates the G component and R component included in only one of the Cy and Mg components.
- multiplication of the Mg component, which is produced in accordance with the light transmitted through the Mg filter, and the Ye component, which is produced in accordance with the light transmitted through the Ye filter enhances the R component included in both Mg and Ye components and attenuates the B component and G component included in only one of the Mg and Ye components.
- Multiplication of the Cy component, which is produced in accordance with the light transmitted through the Cy filter, and the Ye component, which is produced in accordance with the light transmitted through the Ye filter, enhances the G component included in both Cy and Ye components and attenuates the R component and B component included in only one of the Cy and Ye components.
- the products of each of the complementary color components are associated with specific primary color components.
- P[r], P[g], P[b], which are obtained by the respective first to third multiplication circuits 24 a - 24 c, are each associated with the square of each primary color component (R 2 , G 2 , B 2 ).
- the first and second differences S[r], S[b], which are obtained by the respective first and second subtraction circuits 25 a, 25 b, are associated with the difference between the squares of the primary color components (R 2 -G 2 , B 2 -G 2 ).
- the differences between the main color components (R-G, B-G) are approximated by the square roots of the first and second differences S[r], S[b].
- the negative/positive codes Q[r], Q[b] of the first and second differences S[r], S[b] are respectively added to the differences between the main color components (R-G, B-G).
- the square roots of the first and second absolute values A[r], A[b] of the respective first and second differences S[r], S[b] are computed.
- the negative/positive codes Q[r], Q[b] of the first and second differences S[r], S[b] are added to the computed first and second roots R 1 [r], R 1 [b], respectively. This prevents an imaginary number from being obtained during computation of the square root.
- the first and second roots R 2 [r], R 2 [b] calculated by the computation-process described above are associated with the difference between the primary color components (R-G, B-C).
- the information amount of the R component is represented by k, the G component and the B component are both zero.
- the information amount of each of the complementary colors are represented as listed below.
- the information amount of the R and G components are represented by k, the B component is zero.
- the information amount of each of the complementary colors are represented as listed below.
- the R, G, and B components are equal to each other.
- the information amount of the R, G and B components are represented by k
- the information amount of each of the complementary colors are represented as listed below.
- a subtraction process is not performed when calculating the primary color information from the complementary color information. Therefore, negative values are not produced during the color computation process even if the spectral sensitivity of each color filter is not the same.
- a certain amount of error may occur during the computation process with regard to lights of colors other than the three primary colors, the complementary colors, and the white color. However, such colors are not visually noticeable on a reproduction display device and thus do not cause problems.
- FIG. 8 is a plan view showing the configuration of a mosaic type color filter 50 optimal for the application of the processing method of the present invention.
- FIG. 9 is a schematic block diagram showing the configuration of a distribution section 300 which separates the image signal D, obtained from an image sensor to which the color filter 50 is attached, into the complementary color components.
- the distribution section 300 replaces the color distribution circuit 21 and the first to third latch circuits 22 a to 22 c in the processing apparatus shown in FIG. 5 .
- the color filter 50 has segments corresponding to each of the components of Ye, Mg, Cy and G.
- the Mg and G components are alternately arranged in odd rows, and the Ye and Cy components are arranged alternately in even rows. Then, each component of Ye, Mg and Cy is used for producing luminance information in addition to the color information, and the G component is used only for producing the luminance information.
- the Mg and G components continue alternately in an image signal generated from the odd rows and the Ye and Cy components continue alternately in the image signal generated from the even rows.
- the distribution section 300 includes first to third line memories 31 a to 31 c, a filter calculation circuit 32 , and a selector circuit 33 .
- the first to third line memories 31 a - 31 c are connected in series and store three rows of image data D. Further, the first to third line memories 31 a - 31 c read the image data D[L 1 ], D[L 2 ] and D[L 3 ] of each row simultaneously and send the image data D[L 1 ], D[L 2 ] and D[L 3 ] to the filter calculation circuit 32 .
- the filter calculation circuit 32 receives three columns of the image data D[L 1 ], D[L 2 ] and D[L 3 ] from the first to third line memories 31 a - 31 c and generates the color component data C[ 1 ], C[ 2 ], C[ 3 ] and C[ 4 ] corresponding to each segment of the color filter.
- the center pixel is specified as a target pixel for the nine pixels enclosed within the broken lines and the Mg component of the target pixel is output as the color component data C[ 1 ].
- the mean value of the two G component pixels located on the right and left of the target pixel is output as the color component data C[ 2 ]
- the mean value of the two Ye component pixels located above and below the target pixel is output as the color component data C[ 3 ].
- the mean value of the four Cy component pixels located at the four corners is output as the color component data C[ 4 ].
- the interrelationship between the color component data C[ 1 ], C[ 2 ], C[ 3 ] and C[ 4 ] and the color components Ye, Mg, Cy and G are switched every time the target pixel is shifted.
- the selector circuit 33 selects the color component data C[ 1 ], C[ 2 ], C[ 3 ] and C[ 4 ] representing each component Ye, Mg and Cy and outputs the selected data as the complementary color data C[Ye], C[Mg] and C[Cy].
- the selection operation is switched between four patterns in accordance with the color component of the target pixel. Accordingly, in the same manner as the first to third latch circuits 22 a to 22 c shown in FIG. 5, the selector circuit 33 provides three types of the complementary color data C[Ye], C[Mg], C[Cy], which always exist, to the first to third multiplication circuits 23 a to 23 c of FIG. 5 .
- the mosaic type color filter 50 can be used in the processing apparatus of the present invention.
- a CCD image sensor is illustrated, a MOS sensor can be used as the image sensor.
- a color filter needs only at least the three types of complementary colors (Ye, Mg and Cy) for application of the present invention and the complementary colors may be combined with other color components.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Color Television Image Signal Generators (AREA)
- Processing Of Color Television Signals (AREA)
- Facsimile Image Signal Circuits (AREA)
- Image Processing (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP10-361130 | 1998-12-18 | ||
JP36113098A JP3443344B2 (ja) | 1998-12-18 | 1998-12-18 | 画像データの処理方法及び画像データ処理装置 |
Publications (1)
Publication Number | Publication Date |
---|---|
US6373532B1 true US6373532B1 (en) | 2002-04-16 |
Family
ID=18472326
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/457,159 Expired - Lifetime US6373532B1 (en) | 1998-12-18 | 1999-12-08 | Method and apparatus for processing image data |
Country Status (4)
Country | Link |
---|---|
US (1) | US6373532B1 (ja) |
JP (1) | JP3443344B2 (ja) |
KR (1) | KR100376958B1 (ja) |
TW (1) | TW453123B (ja) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6674465B1 (en) * | 1998-11-25 | 2004-01-06 | Sanyo Electric Co., Ltd. | Image processing apparatus which does not generate a false signal even if unevenness of spectral sensitivities of the color filter occurs |
US7365798B2 (en) * | 2003-12-03 | 2008-04-29 | Seiko Epson Corporation | Video signal identification device and video signal identification method |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3808357A (en) * | 1971-12-18 | 1974-04-30 | Victor Company Of Japan | Single tube color camera |
US4245239A (en) * | 1977-07-01 | 1981-01-13 | Quadricolor Technology L.P. | Color television receiving system utilizing inferred high frequency signal components to reduce color infidelities in regions of high color saturation |
US4926247A (en) * | 1986-10-15 | 1990-05-15 | Olympus Optical Co., Ltd. | Color imaging apparatus including a means for electronically non-linearly expanding and compressing dynamic range of an image signal |
US5130786A (en) * | 1989-09-12 | 1992-07-14 | Image Data Corporation | Color image compression processing with compensation |
US5150206A (en) * | 1990-01-22 | 1992-09-22 | British Broadcasting Corporation | Video display system using an improved color signal technique |
US6275261B1 (en) * | 1996-06-12 | 2001-08-14 | Canon Kabushiki Kaisha | Method and apparatus for operating an image sensing device |
-
1998
- 1998-12-18 JP JP36113098A patent/JP3443344B2/ja not_active Expired - Fee Related
-
1999
- 1999-09-29 TW TW088116707A patent/TW453123B/zh not_active IP Right Cessation
- 1999-12-08 US US09/457,159 patent/US6373532B1/en not_active Expired - Lifetime
- 1999-12-16 KR KR10-1999-0058115A patent/KR100376958B1/ko not_active IP Right Cessation
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3808357A (en) * | 1971-12-18 | 1974-04-30 | Victor Company Of Japan | Single tube color camera |
US4245239A (en) * | 1977-07-01 | 1981-01-13 | Quadricolor Technology L.P. | Color television receiving system utilizing inferred high frequency signal components to reduce color infidelities in regions of high color saturation |
US4926247A (en) * | 1986-10-15 | 1990-05-15 | Olympus Optical Co., Ltd. | Color imaging apparatus including a means for electronically non-linearly expanding and compressing dynamic range of an image signal |
US5130786A (en) * | 1989-09-12 | 1992-07-14 | Image Data Corporation | Color image compression processing with compensation |
US5150206A (en) * | 1990-01-22 | 1992-09-22 | British Broadcasting Corporation | Video display system using an improved color signal technique |
US6275261B1 (en) * | 1996-06-12 | 2001-08-14 | Canon Kabushiki Kaisha | Method and apparatus for operating an image sensing device |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6674465B1 (en) * | 1998-11-25 | 2004-01-06 | Sanyo Electric Co., Ltd. | Image processing apparatus which does not generate a false signal even if unevenness of spectral sensitivities of the color filter occurs |
US7365798B2 (en) * | 2003-12-03 | 2008-04-29 | Seiko Epson Corporation | Video signal identification device and video signal identification method |
Also Published As
Publication number | Publication date |
---|---|
JP3443344B2 (ja) | 2003-09-02 |
JP2000184392A (ja) | 2000-06-30 |
KR20000052488A (ko) | 2000-08-25 |
KR100376958B1 (ko) | 2003-03-26 |
TW453123B (en) | 2001-09-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US5990950A (en) | Method and system for color filter array multifactor interpolation | |
US7072509B2 (en) | Electronic image color plane reconstruction | |
US6226034B1 (en) | Spatial non-uniformity correction of a color sensor | |
CN101494795B (zh) | 使用绿色光谱范围重叠的单位像素群的图像传感器及方法 | |
JP2005136766A (ja) | 画像処理装置および画像処理方法 | |
JP4212134B2 (ja) | 画像信号処理装置 | |
JP2000023174A (ja) | 画像処理装置及び画像処理方法 | |
JP2007235591A (ja) | カメラ装置の制御方法及びこれを用いたカメラ装置 | |
US20020060743A1 (en) | Image processing apparatus and method | |
JPH06343179A (ja) | カラー撮像装置 | |
US7746519B2 (en) | Method and device for scanning images | |
EP1173029B1 (en) | Color image pickup device | |
US6373532B1 (en) | Method and apparatus for processing image data | |
JPH11262022A (ja) | 単板式カラーカメラ | |
US6674465B1 (en) | Image processing apparatus which does not generate a false signal even if unevenness of spectral sensitivities of the color filter occurs | |
US5109273A (en) | Signal processing circuit for performing a pipelined matrix multiplication upon signals from several linear sensors | |
JPH0823541A (ja) | カラー撮像装置 | |
JP3895878B2 (ja) | 画像データ処理装置 | |
JP2744260B2 (ja) | カラー信号処理装置 | |
JP2744261B2 (ja) | 色信号処理装置 | |
JP3459538B2 (ja) | 単板式カラーカメラの色信号処理回路 | |
JPH0242875A (ja) | カラー画像読取り装置 | |
JP2650062B2 (ja) | カラー撮像装置 | |
JP3039653B2 (ja) | 撮像装置 | |
JP2000102024A (ja) | 画像信号処理装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SANYO ELECTRIC CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NAKAKUKI, TOSHIO;REEL/FRAME:010445/0176 Effective date: 19991203 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC, ARIZONA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SANYO ELECTRIC CO., LTD.;REEL/FRAME:026594/0385 Effective date: 20110101 |
|
FPAY | Fee payment |
Year of fee payment: 12 |
|
AS | Assignment |
Owner name: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC, ARIZONA Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT #12/577882 PREVIOUSLY RECORDED ON REEL 026594 FRAME 0385. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:SANYO ELECTRIC CO., LTD;REEL/FRAME:032836/0342 Effective date: 20110101 |
|
AS | Assignment |
Owner name: DEUTSCHE BANK AG NEW YORK BRANCH, NEW YORK Free format text: SECURITY INTEREST;ASSIGNOR:SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC;REEL/FRAME:038620/0087 Effective date: 20160415 |
|
AS | Assignment |
Owner name: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AG Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER 5859768 AND TO RECITE COLLATERAL AGENT ROLE OF RECEIVING PARTY IN THE SECURITY INTEREST PREVIOUSLY RECORDED ON REEL 038620 FRAME 0087. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST;ASSIGNOR:SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC;REEL/FRAME:039853/0001 Effective date: 20160415 Owner name: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT, NEW YORK Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT PATENT NUMBER 5859768 AND TO RECITE COLLATERAL AGENT ROLE OF RECEIVING PARTY IN THE SECURITY INTEREST PREVIOUSLY RECORDED ON REEL 038620 FRAME 0087. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST;ASSIGNOR:SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC;REEL/FRAME:039853/0001 Effective date: 20160415 |
|
AS | Assignment |
Owner name: FAIRCHILD SEMICONDUCTOR CORPORATION, ARIZONA Free format text: RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT REEL 038620, FRAME 0087;ASSIGNOR:DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT;REEL/FRAME:064070/0001 Effective date: 20230622 Owner name: SEMICONDUCTOR COMPONENTS INDUSTRIES, LLC, ARIZONA Free format text: RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT REEL 038620, FRAME 0087;ASSIGNOR:DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT;REEL/FRAME:064070/0001 Effective date: 20230622 |