WO1999059345A1 - Imageur couleur transistorise - Google Patents

Imageur couleur transistorise Download PDF

Info

Publication number
WO1999059345A1
WO1999059345A1 PCT/JP1999/002385 JP9902385W WO9959345A1 WO 1999059345 A1 WO1999059345 A1 WO 1999059345A1 JP 9902385 W JP9902385 W JP 9902385W WO 9959345 A1 WO9959345 A1 WO 9959345A1
Authority
WO
WIPO (PCT)
Prior art keywords
color
solid
pixel
state
imaging device
Prior art date
Application number
PCT/JP1999/002385
Other languages
English (en)
Japanese (ja)
Inventor
Hiromasa Mizuki
Masaaki Yamashita
Yasushi Kiyoshige
Hidehiko Watanabe
Original Assignee
Matsushita Electric Industrial Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Industrial Co., Ltd. filed Critical Matsushita Electric Industrial Co., Ltd.
Publication of WO1999059345A1 publication Critical patent/WO1999059345A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/843—Demosaicing, e.g. interpolating colour pixel values
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/133—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing panchromatic light, e.g. filters passing white light
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2209/00—Details of colour television systems
    • H04N2209/04—Picture signal generators
    • H04N2209/041—Picture signal generators using solid-state devices
    • H04N2209/042—Picture signal generators using solid-state devices having a single pick-up sensor
    • H04N2209/045—Picture signal generators using solid-state devices having a single pick-up sensor using mosaic colour filter
    • H04N2209/046—Colour interpolation to calculate the missing colour values

Definitions

  • the present invention relates to an all-pixel readout solid-state imaging device, and more particularly to a method of arranging a color separation filter for reducing the degradation of the resolution of a luminance signal that occurs when a matrix calculation is performed on information from the color separation filter, and a matte. Rix calculation method.
  • the present invention relates to a signal processing method of a solid-state color imaging device that obtains a high resolution by performing an interpolation process between pixels.
  • a color difference signal is synthesized from a color signal output from a solid-state imaging device, each color signal is processed.
  • the frequency characteristic is adjusted for each color of the color separation filter, thereby reducing the frequency components including aliasing that causes a false color.
  • Video signals are usually represented by the three primary colors of red (R), green (G), and blue (B) light, as well as a luminance signal (Y) and two types of color difference signals (R— ⁇ ). , ⁇ - ⁇ ).
  • the three primary colors of R GB are usually in the form of input signals to a monitor for viewing, and the luminance and color difference are
  • Video signals of solid-state imaging devices are used not only for image display, but also for digital recording and video communication between devices.
  • Video signals have a large amount of information, and are usually subjected to image compression processing due to limitations in recording capacity and communication capacity.
  • the format of the video signal used at that time is called 4: 2: 0 or 4: 1: 1 format, and the color information is halved compared to the 4: 2: 2 format conventionally used. There are many.
  • FIG. 2 (a) shows a conventional solid-state color image pickup device, wherein 1 is an optical system for forming an image of a subject on the surface of a solid-state image pickup device, and 2 is an image of the formed object (optical image).
  • 3 is an AD converter that converts the image signal converted by the solid-state image sensor into a digital image signal
  • 4 is luminance from a digital image signal.
  • This is an image signal processing circuit that converts a signal into a color difference signal.
  • the color separation filter formed on the surface of the solid-state imaging device 2 is composed of magenta (Mg), green (G), cyan (Cy), and yellow (Ye).
  • Mg magenta
  • G green
  • Cy cyan
  • Ye yellow
  • a subject image (optical image) is formed on a fixed-state image sensor 2 by an optical system 1.
  • the solid-state imaging device 2 outputs the formed subject image as a ghost image signal obtained by color separation by a color separation filter.
  • the image signal is converted into a digital signal by the AD converter 3, supplied to the signal processing circuit 4, and converted into a luminance signal Y and various kinds of color difference signals to be a color video signal.
  • the image signal processing circuit generates a luminance signal (Y) for one pixel and a pair of color difference signals (R-—, ⁇ - ⁇ ) from four pixels of the complementary color system of Mg, G, Cy, and Ye. create.
  • Y (0,0) Mg (0 3 0) + G (l, 0) + Cy (0, l) + Ye (l, l)
  • Y (1,0) G (l, 0) + Mg (2,0) + Ye (l 1 l) + Cy (2, l)
  • Y (0,1) Cy (0, l) + Ye (l, l) + G (0,2) + Mg (l, 2)
  • Y (l, l) Ye (l, l) + Cy (2, l) + Mg (l, 2) + G (2,2)
  • the color difference signal R—Y (h, v) is
  • R-Y (0,0) Mg (0,0)-G (l, 0) -Cy (0, l) + Ye (l, l)
  • R-Y (O.l) -G (l, 0) + Mg (2,0) + Ye (l, l) -Cy (2, l)
  • RY (1,0) -Cy (0, l) + Ye (], l)-G (0,2) + Mg (l, 2)
  • RY (l, l) Ye (l, l) -Cy (2 J l) + Mg (l, 2) -G (2,2)
  • ⁇ - ⁇ ( ⁇ , ⁇ ) Mg (0 J 0) -G (l, O) + Cy (0, l) -Ye (l J l)
  • ⁇ - ⁇ ( ⁇ , ⁇ ) -G (l, 0) + Mg (2,0)-Ye (l, l) + Cy (2, l)
  • ⁇ - ⁇ ( ⁇ , ⁇ ) Cy (0, l)-Ye (l, l)-G (0,2) + MgU, 2)
  • the output luminance and a pair of color difference signals have the same number as the number of pixels of the solid-state imaging device, and have a 4: 4: 4 format. Conversion to 4: 2: 2 format, 4: 2: 0, and 4: 1: 1 format is performed according to the target output device. In addition, since a false color is generated at the edge portion of the luminance, an edge is determined from the edge signal of the synthesized luminance signal, and the false color is reduced by lowering the gain of the color difference signal corresponding to the pixel determined to be the edge. Color suppression was being performed.
  • the color separation filter is assumed to output in 4: 4: 4 format, and to output in 4: 2: 0 format,
  • 3/4 information is unnecessary for color information.
  • the luminance signal is averaged over four pixels. For example, when Y (0,0) and Y (0,1) in FIG. 2 (b) are to be formed, G (1,0) and Ye ( Since the luminance signal is not used as sampling information purely, since it passes through the low-pass filter in both the vertical and horizontal directions, the pixel signal is used purely in pixel units.
  • the resolution is lower than that of a two-chip solid-state image sensor that performs sampling.
  • the chrominance signal is also converted from four adjacent pixels, and it passes through low-pass filters in both the vertical and horizontal directions instead of pure sampling information, and the resolution is similarly degraded.
  • the color separation filters on the solid-state imaging element surface are provided by two all-color transmission filters, one cyan color transmission filter, and one yellow transmission filter. ,
  • the four elements into one As an arrangement pattern, the arrangement pattern is repeated, so that four pieces of luminance information and one kind of two kinds of color information are output from the arrangement pattern, and further, at the time of conversion into a luminance signal and a color difference signal,
  • the correlation detection process determines the relationship between the pixels on which the subject is imaged and the surrounding pixels, and converts the pixels present in the direction with the highest correlation into luminance signals and color difference signals using arithmetic operations. Things.
  • a plurality of color signals are output by the plurality of color transmission filters.
  • This color signal is independent for each color, and when a particular color signal is received, its sampling rate is lower than the sampling rate of all the signals. For this reason, each color signal may be aliased, and may contain aliased frequency components.
  • Fig. 15 shows how aliasing distortion occurs when a particular color signal is interpolated.
  • the horizontal axis indicates frequency
  • 27 ° indicates the sampling frequency of all signals
  • the vertical axis indicates signal amplitude.
  • the solid line represents the color signal
  • the broken line represents the aliasing component.
  • a fixed-color image pickup device is characterized in that a frequency characteristic adjusting unit outputs an output from a solid-state image pickup device using all-color transmission, cyan transmission, and yellow transmission color separation filters.
  • the frequency characteristic of each color signal to be adjusted is adjusted, and the color difference signal is interpolated and synthesized using the color signal whose characteristic has been adjusted.
  • an edge determination function is provided in the correlation detection processing, a gain to be applied to the color difference signal is determined, and the false color is suppressed by applying the gain to the corresponding color difference signal.
  • the deterioration of the luminance resolution is small, It is possible to provide a fixed holiday color image pickup apparatus with a small number of images. Disclosure of the invention
  • a solid color image pickup device has a color separation filter in which four pixels arranged vertically and horizontally are arranged as one arrangement pattern.
  • the color separation filter has a configuration in which two pixels are a blue color transmission filter, one pixel is a cyan color transmission filter, and one pixel is a yellow color transmission filter, and the arrangement pattern of the four pixels is repeated both vertically and horizontally.
  • a solid-state imaging device having means for individually extracting information for each pixel of the color separation filter; and four luminances for one of the array patterns among image information individually extracted from the solid-state imaging device.
  • the information extracted from the array pattern creates a total of six signals consisting of four luminance signals and two types of color difference signals, one for each pixel. It is output to equipment. This has the effect of improving the luminance resolution in a 4: 2: 0 system device.
  • the solid-state color imaging device according to claim 3 of the present invention is the solid-state color imaging device according to claim 1, which is vertically and horizontally adjacent.
  • the color separation filter having four pixels as one array pattern has one pixel vertically and four pixels horizontally. Based on information extracted from the array pattern, four luminance signals and two A total of six signals consisting of one type of color difference signal and one color difference signal are created and output to a 4: 1: 1 system device. This has the effect of improving the luminance resolution in a 4: 1: 1 system device.
  • the solid color imaging device is the solid color imaging device according to claim 1, wherein four pixels vertically and horizontally adjacent to each other are defined as one array pattern.
  • the upper two pixels of the color separation filter are, in order from the left, an all-color transmission filter, a cyan transmission filter, and the lower two images are, in order from the left, a yellow transmission filter, an all-color transmission filter, and the like.
  • Storage means for taking in and storing the color signal output by each pixel of the solid-state imaging device, and a cyan signal pixel and a yellow signal pixel stored in the storage means.
  • Correlation degree calculating means for calculating the degree of correlation of each interpolated pixel with respect to a plurality of pixels around each interpolated pixel, as a pyrene to be interpolated, and a direction in which the calculated degree of correlation is large Pixel at Performs interpolation, is characterized in that and a interpolation processing means for calculating the full-color transmittable signal of the position of the object to be interpolated pixels.
  • the solid-state color imaging device is the solid-state color imaging device according to claim 4, wherein the correlation degree calculating means includes: Calculating the degree of correlation in the horizontal or vertical direction, including the pixel to be interpolated, with neighboring pixels. This has the effect of reducing deterioration of luminance resolution in the vertical and horizontal // directions.
  • the solid-state color imaging device is the solid-state color imaging device according to claim 4, wherein the correlation degree calculation is performed.
  • the output means calculates a horizontal or vertical correlation and a diagonal correlation between the pixel to be interpolated and pixels in the vicinity thereof, including the pixel to be interpolated. It is. This has the effect of reducing the deterioration of the luminance resolution in the vertical, horizontal, and oblique directions.
  • the solid-state color imaging device is the solid-state imaging device according to claim 4, wherein the correlation degree calculating means includes: The horizontal or vertical correlation, including the pixel to be interpolated, with the surrounding lii elements, and, further, right and up, or right and down, or left and up, or Calculates the degree of correlation between leftward and downward. This has the effect of reducing the deterioration of the luminance resolution in the vertical direction, the horizontal direction, and the upper right L-shaped direction, the lower right L-shaped direction, the upper left L-shaped direction, and the lower left L-shaped direction.
  • the fixed color imaging device is the solid color imaging device according to claim 4, wherein the correlation degree calculating means includes the interpolated pixel and its surroundings.
  • the horizontal or vertical correlation including the pixel to be interpolated, with the pixel at, and also the diagonal correlation, and, further, right and up, or right and down, or The degree of correlation between left and upward or between left and downward is calculated. This has the effect of reducing the deterioration of the luminance resolution in the vertical direction, the horizontal direction, the oblique direction, and the upper right L-shaped direction, the lower right L-shaped direction, the upper left L-shaped direction, and the lower left L-shaped force direction.
  • the solid-state color imaging device is the solid-state color imaging device according to claim 4, wherein the correlation degree calculating means includes: The degree of correlation is calculated by calculating signals of the same color between neighboring pixels. As a result, by calculating the degree of correlation with the same color signal, the calculation accuracy of the degree of correlation is improved.
  • the solid color image pickup device is the solid color image pickup device according to claim 4, wherein the interpolation processing means is provided by the correlation degree calculation means. Interpolating using only a signal of the same color as the color signal to be generated around the pixel to be interpolated without using the color signal of the pixel to be interpolated in the direction of the calculated degree of correlation that is large. It is characterized by the following. Thereby, the interpolation accuracy is improved, and the luminance resolution is improved.
  • the solid color image pickup device is the solid color image pickup device according to claim 4, wherein the interpolation processing means is provided by the correlation degree calculation means.
  • the interpolation processing means is provided by the correlation degree calculation means. Using the color signal of the pixel to be interpolated in the direction in which the degree of correlation is large, calculating the shortage of the color signal to be generated from the pixels around the pixel to be interpolated, and performing interpolation processing. It is characterized by the following. As a result, only the missing color components are interpolated, and the other components are interpolated. [J]
  • the interpolation processing is performed by using the color signal components of the elementary points, so that the interpolation accuracy is improved and the luminance resolution is degraded. It has the effect of being difficult to perform.
  • the solid-state color imaging device is the solid-state color imaging device according to any one of claims 5 to 10, wherein the interpolation processing means is If the degree of correlation calculated by the degree-of-correlation calculating means is smaller than a given threshold value, a process of reducing the gain of the color difference signal corresponding to the pixel is performed. This is intended to reduce false colors that occur at the edge of the luminance signal. It has a function.
  • the solid color imaging device according to claim 14 of the present invention is the solid color imaging device according to any one of claims 5 to 10, wherein the interpolation processing If the correlation calculated by the correlation calculator is smaller than a given threshold, the means performs a process of stepwise decreasing the gain of the color difference signal corresponding to the pixel in accordance with the correlation. It is characterized by the following. This has the effect of adaptively reducing false colors occurring at the edge of the luminance signal.
  • the solid-state color imaging device according to claim 15 of the present invention is the solid-state color imaging device according to claim 4, wherein the interpolation processing means is output from the solid-state imaging device. It is provided with frequency characteristic adjusting means for adjusting the frequency characteristic of each color signal, and interpolating and synthesizing a color difference signal using the color signal subjected to the frequency characteristic adjustment. This has the effect of reducing false color signals that appear when color difference signals are interpolated and synthesized by interpolation using color signals containing high frequency components.
  • the solid-state color imaging device according to claim 16 of the present invention is the solid-state color imaging device according to claim 15, wherein the interpolation processing means includes an output from the solid-state imaging device.
  • Frequency characteristic adjusting means for adjusting the frequency characteristics of each color signal to be applied.
  • the R-Y color difference signal is placed at the cyan transmission filter position and the yellow color It interpolates and synthesizes the B-Y color difference signals. This has the effect of reducing false color signals that appear when color difference signals are interpolated and synthesized by interpolation using color signals containing high frequency components.
  • the solid-state color imaging device according to claim 17 of the present invention is the solid-state color imaging device according to claim 15, wherein the interpolation processing means is the correlation degree calculation means.
  • the correlation direction is determined from the degree of correlation calculated by the above, and if there is a direction with a large correlation, the frequency characteristics are adjusted. If there is no direction with a large correlation, frequency characteristic adjustment is not performed. This has the effect of preserving frequency components and maintaining color reproducibility of an image in interpolation synthesis of color differences using color signals having no correlation direction.
  • the solid color imaging device according to claim 18 of the present invention is the solid color imaging device according to claim 16, wherein the interrogation processing is performed by the correlation processing.
  • the correlation direction is determined from the correlation degree calculated by the degree calculation means, and the frequency characteristic adjustment is performed when there is a direction with a large correlation, and the frequency characteristic adjustment is not performed when there is no direction with a large correlation. Things. This has the effect of preserving the frequency component and maintaining the color reproducibility of the image in color difference interpolation and synthesis using color signals having no correlation direction.
  • two all-color transmissive filters, one cyan transmissive filter, and one yellow transmissive filter are arranged in four pixels vertically and horizontally adjacent to the color separation filter on the surface of the solid-state imaging device. It has a pattern that repeats the four pixels, and has a circuit that extracts four pieces of luminance information and two pieces of color information from the four pixels that are the repeated pattern. Therefore, it is possible to realize an excellent same-body color image pickup device without deterioration even in the case of.
  • Correlation degree calculating means for calculating a correlation degree for a plurality of pixels around the pixel, and means for performing interpolation in a direction of the large correlation degree and calculating an all-color transmission signal at the position of the pixel to be interpolated.
  • a solid-state color imaging device that can reduce the degradation of the luminance resolution and suppress the false color that occurs at the edge of the luminance f symbol without adding a large processing circuit, Can be provided.
  • FIG. 1 (a) is a block diagram of a solid color image pickup device of the present invention.
  • FIG. 1 (b) is a pattern diagram of a color separation filter arranged on the solid-state imaging device of FIG. 1 (a).
  • FIG. 1 (c) is a diagram of a color separation filter arranged on the solid-state imaging device of FIG. 1 (a).
  • FIG. 2 (a) is a block diagram of a conventional solid color imaging device.
  • FIG. 2 (b) is a pattern diagram of a color separation filter arranged on the solid-state imaging device of FIG. 2 (a).
  • FIG. 3 (a) is a diagram showing a position of a luminance / color difference signal in a 4: 2: 0 format of the solid-state color imaging device according to the first embodiment of the present invention.
  • FIG. 3 (b) is a diagram showing a position of a luminance / color difference signal in a 4: 1: 1 format of the solid-state color imaging device according to the second embodiment of the present invention.
  • FIG. 4 is an example of a color separation filter array pattern diagram suitable for outputting in 4: 2: 0 format according to the first embodiment of the present invention.
  • FIG. 5 is an example of a color separation filter array pattern diagram suitable for outputting in a 4: 1: 1 format according to the second embodiment of the present invention.
  • FIGS. 6A and 6B are explanatory diagrams of a solid-state solid-state color imaging device according to Embodiments 3 to 7 of the present invention.
  • FIG. 6A is a configuration diagram of a solid-state color imaging device
  • FIG. It is a block diagram of a color separation filter.
  • FIG. 7 is a diagram illustrating a correlation degree calculation, a correlation direction (vertical direction, horizontal direction), and an interpolation process according to the sixth embodiment of the present invention.
  • FIG. 8 is a diagram for explaining a correlation degree calculation, a correlation direction (diagonally lower right direction, diagonally lower left direction), and an interpolation process according to the eighth embodiment of the present invention.
  • the 911st is a diagram illustrating the correlation degree calculation, the correlation direction (the four L-shaped directions), and the interpolation processing according to the fifth embodiment of the present invention.
  • FIG. 10 is a diagram illustrating the relationship between the degree of correlation and the gain applied to the color difference signal according to Embodiment 9 of the present invention.
  • FIG. 11 is a diagram for explaining the relationship between the degree of correlation and the gain applied to the color difference signal in Embodiment 9 of the present invention.
  • FIG. 12 is a configuration diagram of a solid-state solid-state imaging device according to Embodiment 10 of the present invention.
  • FIG. 13 is a diagram illustrating a frequency characteristic adjusting operation in the tenth embodiment of the present invention.
  • FIG. 14 is a diagram illustrating a frequency characteristic adjustment operation according to Embodiment 10 of the present invention.
  • FIG. 15 is a diagram illustrating a frequency characteristic adjustment operation according to Embodiment 10 of the present invention.
  • the sixteenth embodiment is a configuration diagram of the solid-state solid-state imaging device according to Embodiment 11 of the present invention.
  • FIG. 1 (a) shows a solid color imaging apparatus according to Embodiment 1 of the present invention.
  • reference numeral 1 denotes an optical system which performs an operation of forming an image of a subject on the surface of a solid-state imaging device, and includes a lens and the like.
  • Numeral 2 converts the formed subject image (optical image) into an image signal (electric signal), and is composed of a solid-state image sensor with a color separation filter.
  • Reference numeral 3 denotes an operation for converting an image signal obtained from a solid-state imaging device into a digital image signal, and is constituted by an AD converter.
  • FIG. 1 (b) shows a color separation filter of a solid-state color image sensor attached to the surface of the solid-state image sensor 2 in FIG. 1 (a), and is an example in which two vertical pixels and two horizontal pixels are repeated.
  • the top two pixels are all-color transmissive filter, cyan transmissive filter, and
  • the lower two pixels consist of a yellow transmission filter and an all-color transmission filter in order from the left.
  • FIG. 3A shows the input / output signals of the image signal processing circuit 4 in FIG. 1A of the first embodiment.
  • FIG. 1 (a) a subject is imaged on the surface of a solid-state image sensor through an optical system 1, and an object image (optical image) formed by a solid-state image sensor 2 with a color separation filter is converted into an image signal (electrical signal).
  • Signal converts the image signal obtained from the solid-state image sensor into a digital image signal by the AD converter 3
  • the arrangement of the color separation filters attached to the solid-state image forming element 2 repeats a pattern of 2 pixels vertically and 2 pixels horizontally as shown in Fig. 1 (b).
  • the upper two pixels are all-color transmission filter and cyan transmission filter from left, and the lower two pixels are yellow transmission filter and all-color transmission filter from left.
  • the image signal obtained from the solid-state image sensor has a total of 4 mm, which is two pieces of total color information, one piece of cyan color information, and one piece of yellow information.
  • Route 4 outputs four luminance signals, one R-Y color difference signal, and one B-Y color difference signal.
  • the luminance information consists of all of the R, G, and B components, and the luminance signal Y at the position where the all-color transmission filter is located is created only from the signal from the all-color transmission filter that becomes pure sampling information.
  • the brightness fg No. Y at the position where there is no all-color transmission filter is created using the information of the peripheral position.
  • Y (h, v) ax ((W (hl J v) + W (h + l J v) + W (h, vl) + W (h, v + l))- ⁇ 4)
  • a is a coefficient for adjusting the dynamic range
  • h + v is always an odd number in the example of FIG. 3 (a).
  • R (h, v) ax (w (h-l, v) + w (h + l, v) + w (h, v-l) + w (h, v + 1)) ⁇ 4
  • b and c are coefficients for adjusting the dynamic range, h + v is always an odd number in the example of FIG. 3 (a), h at a position where the cyan color filter is located is an odd number, and V is H is an even number, and h at a position with a yellow filter is even, and V is an odd number.
  • the luminance signal Y obtained from the C y pixel and Y e pixel is created by interpolation using the information of peripheral pixels for the R and B components, and is obtained from pure sampling information by the solid-state image sensor. It does not become.
  • the G + B component for the Cy pixel and the R + G component for the Ye pixel remain as pure sampling information, and the R and B components to be interpolated are the luminance signal Y Among them, the maximum is one-third, the effect is small, and the luminance signal Y keeps high resolution.
  • each piece of information is extracted, and the two pixels vertically and horizontally two pixels of the luminance signal are converted into R, G, and B by a simple measurement method as one pattern.
  • the R and B components for color difference signal conversion are
  • R (h, v) axW ((h div 2) * 2, (v div 2) * 2) -bxCy ((h div 2) * 2 + l, (v div 2) * 2)
  • B (h, v) axW ((h div 2) * 2 + l, (v div 2) * 2 + l) -cxYe ((h div 2) lines 2, (v div 2) * 2 + l).
  • G (h, v) ax (W ((h div 2) * 2, (v div 2) * 2) + W ((h div 2) * 2 + l, (v div 2) * 2 ⁇ 1) ) ⁇ 2-R (b, v) -B (h, v)
  • a, b, and c are coefficients for adjusting the dynamic range
  • div is a calculation that takes only the quotient of integer division and truncates the remainder
  • * represents multiplication.
  • the output of the solid-state imaging device is not overlapped with other adjacent color difference signals, and the color resolution is improved.
  • Each transmission filter used in the first embodiment adjusts the transmittance
  • the luminance signal Y at the position where the all-color transmission filter is located is formed only from the signal from the all-color transmission filter which is pure sampling information.
  • a is a coefficient for adjusting the dynamic range
  • h + v is always an even number in the example of FIG. 3 (a).
  • the luminance signal Y at the position where there is no all-color transmission filter is created using information on the surrounding position.
  • Y (h ) v) ax (((hl, v) + W (h ⁇ l, v) + W (h, vl) + W (h, v + l)) ⁇ 4)
  • Y (h, v) ax (((hl, v) + W (h + l, v) + W (h, vl) ⁇ W (h ) v + l)) ⁇ 4)
  • b and c are coefficients for adjusting the dynamic range, h + v is always an odd number in the example of Fig. 3 (a), h at a position where the cyan filter is located is an odd number, V is even, h at the position where the yellow filter is located is even, and V is odd.
  • Embodiment 1 except for the all-color transmission filter, the cyan transmission filter and the yellow transmission filter are used. However, other than the all-color transmission filter, the red transmission filter and the blue transmission filter are used. It may be a Phil evening.
  • the advantage is that the R and B components do not need to be extracted from the filter, and the calculation can be simplified.
  • the disadvantage is that the green component G is not included in the red and blue filters, so the G component is also supplemented from the surrounding pixels, so the resolution of the luminance information is reduced.
  • the color separation filter of 2 pixels in the vertical direction and ⁇ 2 pixels is the upper two pixels in the order from the left, the all-color transmission filter, the cyan color transmission filter, and the lower two pixels are the yellow in the order from the left.
  • a transparent filter and an all-color transparent filter were used.However, the other transparent colors were kept as they were, the arrangement was changed, or two full-color transparent filters were used.
  • the configuration in which the transmission color of cyan and yellow transmission filters is changed to cyan and magenta, or magenta and yellow, or red and blue, red and blue, and blue and blue, It can be implemented similarly.
  • Embodiment 2 Embodiment 2
  • Fig. 1 (c) shows the color separation filter of the solid-state color image sensor attached to the surface of the solid-state image sensor 2 in Fig. 1 (a), which is repeated with one vertical pixel and four horizontal lines.
  • An example pattern is shown, and the arrangement of filters is composed of an all-color transmission filter, a cyan transmission filter, an all-color transmission filter, and a yellow transmission filter in order from the left.
  • FIG. 3 (b) shows input / output signals of the image signal processing circuit 4 of FIG. 1 (a) in the second embodiment.
  • Fig. 1 (a) the subject is imaged on the surface of the solid-state image sensor through the optical system 1, and the image formed by the solid-state image sensor 2 with a color separation filter is formed.
  • the body image optical image
  • the image signal electric signal
  • the image IG obtained from the solid-state imaging device is converted to a digital image signal by the AD converter 3
  • the AD signal is processed by the image signal processing circuit 4
  • the digital image signal obtained from the converter is converted into a luminance signal and a color difference signal.
  • the arrangement of the color separation filters attached to the solid-state imaging device 2 is a configuration in which the pattern of one vertical pixel and four horizontal pixels is repeated.
  • the image signals obtained from the solid-state imaging device are two total color information, one cyan color information, and one yellow information, for a total of four signals.
  • the processing circuit 4 outputs four luminance signals, one R-Y color difference signal, and one B-Y color difference signal.
  • each transmission filter is represented by the primary color components of light (red, green, blue, and R, G, and B, respectively).
  • W 2 R + G + B, Cy 2 G + B, and Y e R + G
  • the luminance information consists of all of the R, G, and B components, and the luminance signal Y at the position where the all-color transmission filter is located is created only from the signal from the all-color transmission filter that becomes pure sampling information.
  • a is a coefficient for adjusting the dynamic range
  • h is always an even number in the example of FIG. 3 (b).
  • the luminance signal Y at the position where there is no all-color transmission filter is created using the information of the peripheral position.
  • a is a coefficient for adjusting the dynamic range
  • h is always an odd number in the example of FIG. 3 (b).
  • the R and B components necessary for obtaining the luminance signal Y from the C y pixel and the Y ej element are created by interpolation using information of peripheral pixels. Therefore, the luminance signal Y is a solid This is not something that was determined from pure sampling information from the image sensor. However, the G + B component for the Cy pixel and the R + G component for the Y e pixel remain as pure sampling information, and the R and B components to be interpolated have a maximum of 3 in the luminance signal Y.
  • the luminance signal Y is one-half and has little effect and maintains a high resolution.
  • RGB, B-Y For the color difference signals (R-Y, B-Y), one piece of information is extracted for each of the four luminance signals, and one pixel in the vertical direction and four pixels in the horizontal direction of the luminance signal are used as one pattern, and a simple calculation method is used. Then, first convert to R, G, B.
  • R (h, v) axW ((h div 4) * 4, v) -bxCy ((h div 4) * 4 + l, v)
  • G G (h, v) ax (((h div 4) * 4, v) + W ((h div 4) * 4 + 2, v)) ⁇ 2-R (h, v) -B (h, v). From this R GB, the color difference signal is approximately
  • R-Y (h, v) 2xR (h, v) -G (h, v)
  • a, b, and c are coefficients for adjusting the dynamic range.
  • the output of the solid-state imaging device is not overlapped with other adjacent color difference signals, and the color resolution is improved.
  • the transmittance of the all-color transmission filter is set to a ratio of 0.3 for R, 0.39 for B, and 0.11 for G. Since the transmittance ratio of the all-color transmission filter is equal to the primary color mixing ratio of the luminance signal Y, a pure luminance signal can be obtained, and the resolution can be further improved. This can be calculated in the same way as in the first embodiment, although the matrix changes.
  • the color resolution is reduced at the time of color difference signal conversion, but the R, G, and B components can be arranged at any position depending on the use of peripheral pixels. It is possible to output not only 4: 1: 1 but also 4: 4: 4, 4: 2: 2, and 4: 2: 0.
  • the arrangement of the all-color filter is different from the arrangement of Figs. 1 (c) and 3 (a), as shown in Fig. 5 (a).
  • the oblique resolution of the luminance signal bow can be increased by i0J.
  • (C) Repeated arrangement of 8-pixel patterns in which the arrangement of the blue color transmissive filters and the transmissive filters other than all colors are switched, and the cyan and yellow transmissive filters are switched.
  • the color separation filters of one pixel vertically and four pixels horizontally are all-color transmission filters, cyan transmission filters, all-color transmission filters, and yellow transmission filters in order from the left.
  • the transmission color of the color filter is kept as it is, the arrangement is changed, or the two color transmission files are kept as it is, and the transmission color of cyan and yellow is changed.
  • the same can be applied to a configuration in which the transmission color of the evening is changed to cyan and magenta, or magenta and yellow, or red and blue, red and green, or green and blue. is there.
  • the same effect can be obtained by arranging two all-color transmission filters and two filters each of which transmits a color that is not all colors, with four pixels as the repetition pattern in the transmission pattern.
  • four patterns of color separation filters of one pixel vertically and ⁇ 4 pixels are prepared in the vertical direction, and the arrangement of the four patterns of color separation filters may be different from each other. is there.
  • reference numeral 1 denotes an optical system, which functions to form a subject image into a solid-state image sensor, and is composed of a lens and the like.
  • Reference numeral 2 denotes a solid-state imaging device with a color separation filter, which functions to change the formed subject image (optical image) into an image signal (electric signal).
  • Reference numeral 3 denotes an AD converter, which converts an image signal obtained from the solid-state imaging device 2 into a digital image signal.
  • Reference numeral 5 denotes a storage circuit which stores the digital image signal converted by the AD converter 3 for one screen.
  • Reference numeral 6 denotes a correlation degree calculation path. The degree of correlation between the arbitrary pixel of the digital image signal stored in the path 5 and the surrounding pixels is calculated.
  • Reference numeral 7 denotes an interpolation processing circuit that performs an interpolation process based on the degree of correlation calculated by the correlation calculation circuit 6 and outputs a luminance signal and a color difference signal.
  • the circuits of the optical system 1, the solid-state imaging device with a color separation filter 2, the AD converter 3, the storage circuit 5, the correlation calculation circuit 6, and the interpolation processing circuit 7 generate a luminance signal and a color difference signal.
  • FIG. 6 (b) shows the configuration of the color separation filter on the solid-state imaging device 2.
  • Four pixels adjacent vertically and horizontally are taken as one array unit, and the arrangement of the filters is such that the upper two pixels are all-color transmission filter, cyan color transmission filter from left to right, and the lower two pixels are left to right It consists of a yellow transmission filter and an all-color transmission filter.
  • This array unit is arranged continuously and vertically and horizontally.
  • the output signal of the W pixel can be expressed as it is as a luminance signal.
  • the luminance component can be expressed by obtaining the R and B components by interpolation and adding them to the Cy and Y e pixels.
  • the signals of the peripheral pixels are used for the interpolation, and the peripheral pixels used for the interpolation are determined by calculating the degree of correlation with the pixel to be interpolated by the correlation degree calculation circuit 6.
  • FIG. 7 shows the arrangement of the peripheral pixels when the cyan pixel Cyn is set as the pixel to be interpolated.
  • the marks and ⁇ ⁇ indicate the Ye pixels which are not required for the interpolation processing of the pixel Cyn, and W pixels.
  • the degree of correlation in the vertical direction, which is the direction of ⁇ circle around (1) ⁇ shown in 71 ⁇ , is Vc
  • the degree of correlation in the horizontal direction, which is the direction of ⁇ circle around (2) ⁇ 2 is He.
  • Vc I Wu-Wd I + I Cyu-Cyn I + I Cyd-Cyn I (1)
  • Th is a threshold value and is a specific constant.
  • the correlation direction is determined to be vertical when equation (3) holds, and horizontal when equation (4) holds. If neither equation (3) nor equation (4) holds, it is determined that there is no correlation direction.
  • the pixel used for the interpolation process uses the peripheral pixels only in the vertical direction with respect to the interpolated pixel Cyn, and calculates the missing component RCy using the following equation.
  • the pixel used for the interpolation process uses the peripheral pixels only in the horizontal direction with respect to the interpolated pixel Cyn, and calculates the missing component RCy using the following equation.
  • the missing component RCy is calculated for the interpolated element Cyn using the peripheral pixels in both the horizontal direction and the vertical direction using the following equation.
  • W ′ is calculated for all the interpolated pixels Cyn by the same operation as above.
  • the luminance W ′ at the Cy pixel and the Ye pixel is obtained. Is obtained, and all luminance signals can be obtained.
  • the signal of the W pixel is used as it is, and the interpolation of peripheral pixels having a high correlation with each of the Cy pixel and the Ye pixel can reduce reduction in resolution.
  • the vertical and horizontal correlations, including the pixel to be interpolated, between the pixel to be interpolated and the peripheral pixels are detected and interpolation is performed.
  • a high-precision luminance signal can be obtained, and a decrease in resolution can be prevented.
  • the configuration of the fourth embodiment is basically the same as the configuration of the third embodiment.
  • the correlation calculation circuit 6 further calculates the correlation in an oblique direction.
  • a process for calculating the degree of correlation is also added, and the interpolation processing circuit 7 is provided with an interpolation process for oblique correlation.
  • Fig. 8 shows the arrangement of peripheral pixels when the cyan pixel Cyn is used as the interpolated image.
  • the marks and triangles indicate the Ye pixels that are not required for the interpolation processing of the i-element Cyn. , W pixels.
  • Nr I (Wu + l) / 2- (Wd + Wr) / 2
  • Nl I (Wu + Wr) / 2- (Wd + l) / 2
  • Th is a threshold, a specific constant, and min is a function that takes the minimum value of each element in Kakko.
  • the correlation direction is the vertical direction when Equation (10) is satisfied, the horizontal direction when Equation (11) is satisfied, the diagonally downward right when Equation (12) is satisfied, and the equation (13) If the condition is satisfied, it is determined that the left diagonally downward direction. If none of Equations (10) to (13) holds, it is determined that there is no correlation direction.
  • the missing component RCy is calculated using the following formula using the peripheral pixels in the diagonally lower left direction only for the interpolated pixel Cyn.
  • interpolation processing is performed in the same manner as in the third embodiment to obtain all luminance signals.
  • the configuration of the fifth embodiment is basically the same as the configuration of the third embodiment.
  • processing for calculating the degree of correlation in the L-shaped direction is also added to the calculation of the degree of correlation in the degree of correlation calculation circuit 6. Interpolation processing at the time of correlation is added.
  • Fig. 9 shows the arrangement of peripheral pixels when the cyan pixel Cyn is set as the pixel to be interpolated.
  • the marks and triangles indicate the Ye pixel and W, which are not required for the interpolation processing of this pixel Cyn. Pixel.
  • the correlation in the upper left L-shape which is the direction of 5—5 'shown in FIG. 9, is Lul
  • the correlation in the upper right L-shape which is the direction of 6—6'
  • Lur 7-7
  • the correlation in the lower left L-shape, which is the direction of, is Ldl
  • the correlation in the lower right L-shape, which is the direction of 8 is Ldr, and is calculated using the following formula.
  • Th is a threshold, a specific constant, and min is a function that takes the minimum value of each element of Katsuko II.
  • the correlation direction is the vertical direction when equation (20) is satisfied, the horizontal direction when equation (21) is satisfied, and the upper left L-shape direction when equation (22) is satisfied. Holds, ⁇ in the upper L direction, Equation (24) holds. If it stands, it is determined to be in the lower left L-shape, and if equation (25) holds, it is determined to be in the lower right L-shape. If none of Equations (20) to (25) holds, it is determined that there is no correlation direction.
  • Embodiment 3 describes the interpolation processing when the correlation direction is determined to be vertical and horizontal and when it is determined that there is no correlation direction.Here, furthermore, when the correlation direction is determined to be the L direction, Is added.
  • the missing component Rcy is calculated using the following formula for the pixel to be interpolated Cyn using the neighboring pixels only in the L-shaped direction.
  • the missing component HCy is calculated using the neighboring pixels in the upper right L direction only for the interpolated pixel Cyn using the following formula.
  • the missing component RCy is calculated using the following formula using the peripheral pixels in the lower left L-shape only for the interpolated pixel Cyn.
  • the missing component RCy is calculated using the following formula using the surrounding pixels in the lower right L-shape only for the interpolated pixel Cyn.
  • interpolation processing is performed in the same manner as in Embodiment 3 to obtain all luminance signals.
  • the configuration of the sixth embodiment is basically the same as that of the third embodiment, except that processing for calculating the degree of correlation in the oblique direction and the L-shaped direction is added to the calculation of the degree of correlation in the degree of correlation calculation circuit 6.
  • the interpolation processing circuit 7 adds interpolation processing for oblique direction correlation and L-shaped direction correlation.
  • the correlation direction is determined by the following conditional expression.
  • Nr + Th ku min Hc, Vc, Nl, Lul, Lur, Ldl, Ldr
  • the correlation direction is the vertical direction when equation (30) is satisfied, the horizontal direction when equation (31) is satisfied, the diagonally downward direction when equation (32) is satisfied, and the equation (33) If it holds, the diagonally downward direction to the left, if equation (34) holds, the upper left L-shape if equation (34) holds, and if equation (35) holds, the upper right L-shape If Expression (36) holds, it is determined to be the lower left L-shaped direction, and if Expression (37) holds, it is determined to be the lower right L-direction. If none of Equations (30) to (37) holds, it is determined that there is no correlation direction.
  • the missing component RCy is calculated using Equation (14) using the peripheral pixels only in the diagonally lower right direction with respect to the interpolated pixel Cyn. If it is determined to be in the diagonally lower left direction, the missing component RCy is calculated using Equation (15) using the peripheral pixels of only the diagonally lower left I to J with respect to the interpolated pixel Cyn. If the correlation direction is determined to be the upper left L-shaped direction, the missing component RCy is calculated using Equation (26) using the peripheral pixels of the interpolated pixel Cyn only in the upper left L-shaped direction.
  • the missing component RCy is calculated using equation (27) using only the peripheral pixels in the upper right L-shape direction for the interpolated pixel Cyn. If it is determined to be in the lower left L-shape direction, the missing component RCy is calculated using equation (28) using peripheral pixels only in the lower left L-shape direction with respect to the interpolated pixel Cyn. If it is determined to be in the lower right L-direction, the missing component RCy is calculated using Equation (29) using the peripheral pixels of only the lower right L-direction for the interpolated pixel Cyn.
  • interpolation processing is performed in the same manner as in the third embodiment, and all luminance signals are obtained.
  • the correlation is detected not only in the vertical and horizontal directions but also in the diagonal direction and the L-shaped direction, and interpolation is performed.
  • the reduction in resolution can also be reduced.
  • the configuration of the seventh embodiment is the same as the configurations of the above-described third to sixth embodiments, and the only difference is a method of calculating the degree of correlation on the lei road 6.
  • Vertical correlation Vc horizontal correlation He, right diagonal down correlation Nr, left diagonal down correlation Nl, upper left L-shaped correlation Lul obtained in Embodiments 3 to 6 above
  • upper right L-shape correlation Lur the lower left L-shape correlation Ldl, and the lower right L-shape correlation Ldr
  • calculations were performed between pixels of the same color. Then, it is obtained using the following equation.
  • Nr
  • the configuration of the eighth embodiment is the same as the configurations of the third to sixth embodiments, except that the interpolation processing method in the interpolation processing circuit 7 is different therefrom.
  • the interpolated pixel Cyn obtained in the third to sixth embodiments is used.
  • interpolation process when calculating the luminance W 'of the pixel to be interpolated Cyn, interpolation is performed as in the following equation using only surrounding W pixels without using Cyn itself.
  • the interpolation accuracy is improved, and a high-resolution image without luminance unevenness can be obtained.
  • FIG. 10 a ninth embodiment corresponding to Claims 13 and 14 of the present invention will be described with reference to FIGS. 10 and 11.
  • FIG. 10 a ninth embodiment corresponding to Claims 13 and 14 of the present invention
  • the position of the interpolated pixel is determined regardless of the correlation degree. It is processed so that a gain of 1 or more is applied to the color difference signal (RY, BY).
  • FIG. 10 shows the relationship between the degree of correlation in the direction determined to have the strongest correlation and the gain applied to the color difference signal. False color signals are likely to appear in the edge portion of the luminance.However, by providing the interpolation processing circuit 7 with a process of applying a gain of 1 or less to the above, it is possible to suppress the false color generated in the edge portion of the luminance. it can. Further, since the correlation degree detection circuit 6 can also have an edge detection function, it is possible to perform a false color suppression process without adding a separate luminance edge detection circuit.
  • the gain applied to the color difference signal may be changed according to the degree of correlation in the direction determined to have the strongest correlation.
  • FIG. 11 shows an example of the relationship between the degree of correlation of the force direction determined to have the strongest correlation and the gain applied to the color difference signal in this case.
  • the stronger the correlation the smaller the degree of correlation.
  • a certain width Thl is given to the degree of correlation, and the gain applied to the color difference is gradually reduced for each width.
  • an edge portion having a large luminance step has a darker false color.
  • the correlation disappears, the possibility that a dark false color appears is greater. Therefore, the level of the color difference signal can be reduced according to the possibility, and the false color can be suppressed efficiently.
  • FIG. 12 shows the configuration of a solid-state color imaging device according to the present embodiment 10, which is basically the same as the configuration shown in FIG. 6, except that the frequency characteristic adjusting circuit 10 This is the configuration added to the configuration in Fig. 6.
  • the interpolation processing circuit 7 in FIG. 6 is separated into a luminance signal interpolation processing circuit 8 and a chrominance signal interpolation processing circuit 9, and a frequency is provided before the chrominance signal interpolation processing circuit 9.
  • the configuration is such that the characteristic adjustment circuit 10 is inserted.
  • the image signal stored in IEJ path 5 The characteristics are adjusted in the frequency characteristic adjustment circuit 10 and input to the color difference signal interpolation processing circuit 9.
  • Cy23 ' is represented as in equation (53).
  • Cy23 ' (Cy03 + Cy21 + Cy23 f Cy25 + Cy43) / 5 (56) This frequency characteristic adjustment operation is performed for all color signals necessary to interpolate and synthesize color difference signals.
  • a BY color difference signal can be output by performing the above-described frequency characteristic adjustment and color difference signal interpolation processing in the same positional relationship.
  • Fig. 14 shows the torsional width characteristic 11 when three-point averaging is used as the frequency characteristic adjustment of the color signal, and the amplitude characteristic 12 when linear interpolation is used as the color difference signal interpolation processing.
  • the combination is shown by a solid line.
  • the horizontal axis is frequency, and the sampling frequency of each color signal is represented by 7 ⁇ .
  • the aliasing distortion included in the vicinity of / 2 of the color signal indicated by the broken line in FIG. 15 is obtained. Are reduced and interpolated.
  • the frequency characteristic adjustment circuit when the color signal stored in the storage circuit 5 contains a high-frequency component, the frequency characteristic adjustment circuit
  • the frequency component including aliasing is reduced by 10 and the color difference 5 signal is interpolated and synthesized by the color difference signal interpolation processing circuit 9 using the color signal whose frequency characteristics have been adjusted. Reduced.
  • Embodiment 11 1.
  • FIG. 16 shows a configuration of a solid-state color imaging device according to the present embodiment 11, which is basically the same as the configuration shown in FIG. 12, except that the frequency characteristic adjusting circuit 10 It is configured to be controlled by the output of the correlation degree detection circuit 6.
  • the frequency characteristic of the color signal of the pixel to be interpolated is adjusted by the frequency characteristic adjustment circuit 10. Further, the color difference signal is calculated by the color difference signal interpolation processing circuit 9 using the color ig of the pixel to be interpolated whose frequency characteristic has been adjusted.
  • the processing in this case is the same as that of the above-described Embodiment 10.
  • the frequency characteristic adjustment circuit 10 does not perform any processing on the color signals of the two elements to be interpolated.
  • the color difference signal is complemented by using the luminance signal output from the luminance signal interpolation processing circuit 8 and output to the circuit 9.
  • Embodiment 11 of the present invention the frequency characteristics of a color signal containing a high-frequency component and having a correlation direction are adjusted by the frequency characteristic adjustment circuit 10, and the frequency characteristics shown in Embodiment 10 described above are used. As in the case of, the generation of a false color signal is reduced. On the other hand, a color signal having no correlation direction does not originally include a false color component, so there is no need to adjust the frequency characteristics, and the frequency of the color signal Since the components are not attenuated by adjusting the frequency characteristics, color reproducibility is maintained. Industrial applicability
  • the solid-state color imaging device provides a luminance resolution by extracting four pieces of luminance information and two pieces of color information from four pixels vertically and horizontally adjacent to the color separation file on the surface of the solid-state image sensor. It has a high feeling and can reduce deterioration even in color resolution, and is useful as a signal processing method for a solid-state color imaging device that obtains high resolution by performing interpolation processing between pixels.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Color Television Image Signal Generators (AREA)
  • Image Processing (AREA)

Abstract

L'invention se rapporte à un imageur couleur transistorisé comportant un élément d'imagerie couleur transistorisé (2) doté d'un filtre de sélection de couleur dans lequel sont disposés de façon répétée des motifs de structure. Chaque motif de structure comporte quatre pixels adjacents les uns aux autres, verticalement et horizontalement. Les deux pixels supérieurs sont constitués d'un filtre laissant passer toutes les couleurs et d'un filtre laissant passer le cyan, disposés à partir de la gauche, et les deux pixels inférieurs sont constitués d'un filtre laissant passer le jaune et d'un filtre laissant passer toutes les couleurs, disposés à partir de la gauche. Ledit imageur comprend également un organe de mémorisation (5) conçu pour recevoir les signaux de couleurs en provenance des pixels et pour les mémoriser, un organe de calcul de corrélation (6) conçu pour calculer les corrélations de pixels autour de pixels d'objets d'interpolation composés des pixels du signal cyan et des pixels du signal jaune mémorisés dans l'organe de mémorisation, et un organe d'interpolation (7) conçu pour effectuer une interpolation dans la direction où la corrélation augmente et pour calculer les signaux de transmission pleine couleur aux positions des pixels objets d'interpolation.
PCT/JP1999/002385 1998-05-08 1999-05-07 Imageur couleur transistorise WO1999059345A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP10/125677 1998-05-08
JP12567798 1998-05-08
JP11/67003 1999-03-12
JP6700399 1999-03-12

Publications (1)

Publication Number Publication Date
WO1999059345A1 true WO1999059345A1 (fr) 1999-11-18

Family

ID=26408208

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP1999/002385 WO1999059345A1 (fr) 1998-05-08 1999-05-07 Imageur couleur transistorise

Country Status (5)

Country Link
KR (1) KR100398564B1 (fr)
CN (1) CN1171462C (fr)
ID (1) ID28202A (fr)
TW (1) TW420956B (fr)
WO (1) WO1999059345A1 (fr)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001030087A1 (fr) * 1999-10-19 2001-04-26 Matsushita Electric Industrial Co., Ltd. Appareil de captage d'image couleur
WO2002071761A1 (fr) * 2001-03-05 2002-09-12 Nikon Corporation Programme et dispositif de traitement d'images
US7146042B2 (en) 2000-09-07 2006-12-05 Nikon Corporation Image processing apparatus and colorimetric system conversion method
JP2008219598A (ja) * 2007-03-06 2008-09-18 Sony Corp 固体撮像装置、撮像装置
US7710437B2 (en) 2004-12-30 2010-05-04 Lg Electronics Inc. Color interpolation algorithm
US7911507B2 (en) 2007-01-05 2011-03-22 Kabushiki Kaisha Toshiba Solid-state image pickup device in which the saturated signal quantity of a W pixel is controlled
JP2011078092A (ja) * 2010-09-08 2011-04-14 Toshiba Corp 色差信号フォーマット変換装置及び方法
US8068173B2 (en) 2009-09-30 2011-11-29 Kabushiki Kaisha Toshiba Color difference signal format conversion device and method
CN1610412B (zh) * 2003-10-23 2012-05-30 索尼株式会社 图像处理装置和图像处理方法
US8274715B2 (en) 2005-07-28 2012-09-25 Omnivision Technologies, Inc. Processing color and panchromatic pixels

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1326088C (zh) * 2004-02-10 2007-07-11 华晶科技股份有限公司 补足像素色彩的内插法
KR20050096018A (ko) 2004-03-29 2005-10-05 주식회사 팬택앤큐리텔 이미지 왜곡 보상 기능을 구비한 카메라 내장형 이동통신단말기
CN100399834C (zh) * 2004-05-17 2008-07-02 华晶科技股份有限公司 一种决定一感兴趣像素的边缘趋势的方法与装置
US7830430B2 (en) * 2005-07-28 2010-11-09 Eastman Kodak Company Interpolation of panchromatic and color pixels
JP4389865B2 (ja) * 2005-11-17 2009-12-24 ソニー株式会社 固体撮像素子の信号処理装置および信号処理方法並びに撮像装置
JP5507362B2 (ja) 2010-06-30 2014-05-28 パナソニック株式会社 ３次元撮像装置および光透過板
CN108476309A (zh) * 2016-01-08 2018-08-31 奥林巴斯株式会社 图像处理装置、图像处理方法以及程序
CN106162110B (zh) * 2016-07-29 2018-02-06 广东欧珀移动通信有限公司 图像色彩处理方法、装置及终端设备

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0488782A (ja) * 1990-07-31 1992-03-23 Canon Inc 撮像装置
JPH10108209A (ja) * 1996-10-02 1998-04-24 Matsushita Electric Ind Co Ltd 色信号補間方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5305096A (en) * 1990-07-31 1994-04-19 Canon Kabushiki Kaisha Image signal processing apparatus using color filters and an image pick-up device providing, interlaced field signals

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0488782A (ja) * 1990-07-31 1992-03-23 Canon Inc 撮像装置
JPH10108209A (ja) * 1996-10-02 1998-04-24 Matsushita Electric Ind Co Ltd 色信号補間方法

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001030087A1 (fr) * 1999-10-19 2001-04-26 Matsushita Electric Industrial Co., Ltd. Appareil de captage d'image couleur
US6967748B1 (en) 1999-10-19 2005-11-22 Matsushita Electric Industrial Co., Ltd. Color image pickup device
US7146042B2 (en) 2000-09-07 2006-12-05 Nikon Corporation Image processing apparatus and colorimetric system conversion method
WO2002071761A1 (fr) * 2001-03-05 2002-09-12 Nikon Corporation Programme et dispositif de traitement d'images
US7289665B2 (en) 2001-03-05 2007-10-30 Nikon Corporation Image processing device and image processing program
CN1610412B (zh) * 2003-10-23 2012-05-30 索尼株式会社 图像处理装置和图像处理方法
US7710437B2 (en) 2004-12-30 2010-05-04 Lg Electronics Inc. Color interpolation algorithm
US8274715B2 (en) 2005-07-28 2012-09-25 Omnivision Technologies, Inc. Processing color and panchromatic pixels
US8711452B2 (en) 2005-07-28 2014-04-29 Omnivision Technologies, Inc. Processing color and panchromatic pixels
US7911507B2 (en) 2007-01-05 2011-03-22 Kabushiki Kaisha Toshiba Solid-state image pickup device in which the saturated signal quantity of a W pixel is controlled
US8125543B2 (en) 2007-03-06 2012-02-28 Sony Corporation Solid-state imaging device and imaging apparatus with color correction based on light sensitivity detection
JP2008219598A (ja) * 2007-03-06 2008-09-18 Sony Corp 固体撮像装置、撮像装置
US8068173B2 (en) 2009-09-30 2011-11-29 Kabushiki Kaisha Toshiba Color difference signal format conversion device and method
JP2011078092A (ja) * 2010-09-08 2011-04-14 Toshiba Corp 色差信号フォーマット変換装置及び方法

Also Published As

Publication number Publication date
TW420956B (en) 2001-02-01
KR100398564B1 (ko) 2003-09-19
ID28202A (id) 2001-05-10
KR20010043406A (ko) 2001-05-25
CN1300505A (zh) 2001-06-20
CN1171462C (zh) 2004-10-13

Similar Documents

Publication Publication Date Title
US7973831B2 (en) Solid-state image sensor and imaging apparatus using the same
WO1999059345A1 (fr) Imageur couleur transistorise
JP4066484B2 (ja) 画像処理装置および画像処理方法、並びにカメラ
JP5451782B2 (ja) 画像処理装置および画像処理方法
KR101391161B1 (ko) 화상처리장치
JP4265546B2 (ja) 撮像装置、画像処理装置および画像処理方法
US7065246B2 (en) Image processing apparatus
US8144221B2 (en) Image sensor apparatus and methods employing unit pixel groups with overlapping green spectral content
EP2152010B1 (fr) Appareil de génération de signaux de luminance, procédé de génération de signaux de luminance et appareil de capture d'images
JP3458080B2 (ja) カラー撮像装置
JP2005109991A (ja) 信号処理方法及び装置、撮像装置
US20020101434A1 (en) Image interpolating device
EP1173029A2 (fr) Appareil de prise de vues en couleurs
JP4285587B2 (ja) 撮像素子
JP2005260908A (ja) 画像処理方法、及び画像処理装置、半導体装置、電子機器、画像処理プログラム、並びにコンピュータ読み取り可能な記録媒体
JP3576600B2 (ja) カラー撮像装置
JP4086572B2 (ja) 映像信号処理装置
JP2006303774A (ja) 撮像装置
JP4178571B2 (ja) 画像処理装置および画像処理方法、並びにカメラ
JP3968480B2 (ja) 相関値算出回路およびその算出方法
JP2009171196A (ja) 画像処理装置、画像処理方法及び画像処理プログラム
JP2000341710A (ja) 撮像装置
JP3452712B2 (ja) 単板カラービデオカメラ
JP3422027B2 (ja) カラーカメラ及びその信号処理回路における輝度バランス回路
JPH089395A (ja) カラー撮像装置

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 99805935.8

Country of ref document: CN

AK Designated states

Kind code of ref document: A1

Designated state(s): CN ID JP KR SG US

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 1020007012440

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 09674933

Country of ref document: US

WWP Wipo information: published in national office

Ref document number: 1020007012440

Country of ref document: KR

WWG Wipo information: grant in national office

Ref document number: 1020007012440

Country of ref document: KR