JP4249909B2 - Signal processing apparatus and signal processing method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a signal processing apparatus and a signal processing method thereof, and more particularly, to a signal processing which is applied to an image input apparatus such as a digital camera and reads out a signal in consideration of a color arrangement, a signal processing for high speed printing, and the like. And suitable.
[0002]
[Prior art]
When a single-plate digital camera outputs a color image pickup signal, a method of assigning one color separation filter segment to the image pickup device and obtaining color information at the same time is used. Various color filter arrays have been proposed and used depending on the arrangement of the color separation filter segments.
[0003]
In consideration of good color tone, a color filter array of a primary color type Bayer array is often used for a single-plate digital camera in general. In the Bayer array, colors G and R are alternately arranged first, and colors B and G are alternately arranged on the next line. As a result, the data of the three primary color RGB signals are not obtained until two lines are read out. In order to realize the three primary colors RGB, it is preferable to store one line of the read signal charges. Therefore, at least one line memory is used for the circuit.
[0004]
When a digital camera takes a still image, there is no restriction on the processing time. Therefore, in this case, there is no problem even if a line memory is used so that two lines are read together. The digital camera uses, for example, a dynamic RAM (Random Access Memory) as a line memory.
[0005]
On the other hand, when shooting a moving image with a digital camera, the moving image display becomes unnatural if the number of frames handled within a unit time is small. For this reason, in order to satisfy the moving image display, the number of frames handled is increased and the number of pixels handled by one frame is limited. Specifically, when an LSI (Large-Scale Integrated circuit) is used, the moving image line memory size is limited according to a display request.
[0006]
[Problems to be solved by the invention]
Incidentally, a solid-state imaging device disclosed in Japanese Patent No. 2587225 has been proposed mainly for the purpose of improving dynamic resolution. In this apparatus, P is a natural number from the image sensor driving means, and an image sensor drive signal is supplied to the image sensor every 1 / P horizontal period to read out the signal charge. At this time, the pixel data obtained by the memory drive means is 1 / P Writes sequentially to multiple memory units in the horizontal period, simultaneously reads P horizontal lines from this memory unit for each horizontal period, and combines the video data from the image sensor with the combining means, reducing the number of horizontal lines Even when signals are read out row by row, the horizontal resolution is improved by utilizing the correlation of a plurality of lines as in the case of simultaneous reading out of a plurality of rows. In addition, the solid-state imaging device can be a field storage type regardless of the type of color filter, and the dynamic resolution can be improved.
[0007]
Further, in the signal processing apparatus disclosed in Japanese Patent Application Laid-Open No. 2000-50291, the control unit applies timing control to the sampling of the signal supplied based on the Bayer pattern to the block sampling unit, and each pixel corresponding to the block by the block sampling unit The position data is sampled, and pixel values of three colors or luminance signals and color difference signals are generated by the display data generation means to suppress false colors generated in the vertical and horizontal directions, thereby improving color reproducibility. In addition, this apparatus reduces the power consumption in the movie mode by operating at a sampling frequency reduced to half that of the prior art.
[0008]
However, these two proposals merely perform processing for generating individual color signals based on the arrangement relationship of the color filter patterns, and no consideration is given to the increment of the number of pixels for supplying pixel data.
[0009]
It is an object of the present invention to provide a signal processing apparatus and a signal processing method for solving the drawbacks of the prior art and adjusting the number of input pixels to a displayable number according to the capacity of the line memory and outputting the adjusted number of pixels. And
[0010]
[Means for Solving the Problems]
In order to solve the above-mentioned problem, the present invention supplies basic pixel data corresponding to one color to a pixel, and considers a color arrangement pattern created by the color of the supplied pixel data to use a basic color used for image generation In this signal processing apparatus, the apparatus includes a data supply control means for controlling the supply of the pixel data of each line in units of the number of lines of the basic pattern in which the basic color is repeated in the color arrangement pattern. Filter means for performing filter processing in consideration of causing a plurality of pixel data supplied according to control to be displayed together, and pixel data of each line supplied through this filter processing for each line The same color combining means for combining a plurality of pixel data of the same color and combining the combined pixel data of the same color in a basic pattern, Output switching means for switching the output of the pixel data, selection control means for controlling the selection timing of the output switching means, and interpolation means for performing pixel interpolation using the pixel data of each selected color, To do.
[0011]
For example, when the color arrangement pattern is a basic Bayer pattern, the signal processing apparatus of the present invention controls the supply of pixel data line by line in units of two lines by the data supply control means, and the filter means. Apply filtering to suit the display grouped together, combine the same color pixel data in the line at the same timing with the same color composition means, output the basic color from the basic pattern to the output switching means, and according to the control of the selection control means Output pixel data from the output switching means, and by interpolating the pixel data with the interpolation means, the same processing is performed as thinning out pixels in different positional relationships for each color in the horizontal direction, and the basic colors are aligned, Processing within the prescribed time of the moving image is completed, and generation of false colors and false signals is suppressed by filter processing and interpolation processing.
[0012]
In order to solve the above-described problem, the present invention is used when image data is generated in consideration of a color arrangement pattern created by the color of the pixel data supplied with pixel data corresponding to one color for each pixel. In the signal processing method for generating a basic color, this method includes a first step of controlling the supply of pixel data of each line in units of the number of lines of the basic pattern in which the basic color is repeated in the color arrangement pattern. A second step of performing a filter process considering that a plurality of pixel data supplied in accordance with this control are displayed together, and out of the pixel data of each line supplied through this filter process A third step of collecting a plurality of pixel data of the same color for each line, and further combining the combined pixel data of the same color in a basic pattern; A fourth step of controlling the output timing of the data, a fifth step of switching and outputting the pixel data of each color in accordance with the control of the output timing, and pixel interpolation using the pixel data of each selected color And a sixth step to be applied.
[0013]
The signal processing method of the present invention controls the supply of pixel data of each line in units of the number of lines of the basic pattern in which the basic color is repeated in the color arrangement pattern, performs the filter process according to this control, and performs the filter process. Among the pixel data of each line supplied after that, a plurality of pixel data of the same color are combined and combined within the basic pattern, and then the output timing of the combined pixel data of each color is controlled. In response, the pixel data of each color is switched and output, and by performing pixel interpolation on this output, the same processing is performed as if the pixels having different positional relationships for each color are thinned in the horizontal direction, and the basic colors are aligned. While outputting, processing within the prescribed time of the moving image is completed, and generation of false colors and false signals is suppressed by filter processing and interpolation processing.
[0014]
DETAILED DESCRIPTION OF THE INVENTION
Next, embodiments of a signal processing apparatus according to the present invention will be described in detail with reference to the accompanying drawings.
[0015]
In the present embodiment, illustration and description of portions not directly related to the present invention are omitted. Here, the reference number of the signal is represented by the reference number of the connecting line that appears.
[0016]
In this embodiment, when the number of image pickup devices (= pixels) is increased from the time of design, the signal processing apparatus 10 eliminates the possibility of being forced to change the circuit configuration to a configuration corresponding to the increase, and has a high expandability. Providing a configuration. In this provision, the signal processing apparatus 10 is particularly problematic in moving image processing that requires completion of moving image display processing within a predetermined time. FIG. 1 shows the configuration of the signal processing apparatus 10 in consideration of this problem.
[0017]
As shown in FIG. 1, the signal processing apparatus 10 includes a data correction unit 10a, a moving image signal processing unit 10b, a still image signal processing unit 10c, and a color difference matrix unit 10d.
[0018]
The data correction unit 10a includes a frame memory function and various correction functions. Examples of the correction function include adjustment functions such as gamma correction and white balance. The gamma correction here also makes it possible to reduce the number of bits for signal processing by reducing power consumption and circuit scale. For example, pixel data 12 having color information is supplied to the data correction unit 10a by transmitting the color filter segment of the color filter and performing photoelectric conversion. When the supplied pixel data is stored in the data correction unit 10a and this pixel data is repeatedly read, a nondestructive memory may be used.
[0019]
Further, writing / reading with respect to the data correction unit 10a may be controlled by a control signal from a system control unit (not shown) of a device to which the moving image signal processing unit 10b or the signal processing device 10 described later is applied. The data correction unit 10a supplies the corrected pixel data 14 to the moving image signal processing unit 10b and the still image signal processing unit 10c, respectively.
[0020]
The moving image signal processing unit 10b includes a low-pass filter (hereinafter referred to as LPF) 100, a same color synthesis unit 10B, a selector 106, a data input / output control unit 108, and a pixel interpolation processing unit 110. The LPF 100 is composed of a digital filter and has a function of performing filtering according to the number of pixels by thinning processing described later. The LPF 100 supplies the filtered pixel data 16 to the line memory unit 102 and the thinning processing unit 104 of the same color synthesis unit 10B.
[0021]
The same color composition unit 10B includes a line memory unit 102 and a thinning processing unit 104. Although not shown in FIG. 1, the line memory unit 102 takes into account the repeated basic pattern of the color arrangement pattern used for the color filter, and the number of line memories obtained by subtracting one line from the number of lines for representing this basic pattern. Have The line memory unit 102 is provided so that pixels of a plurality of lines sequentially supplied from the start of supplying the basic pattern to be read are supplied to the thinning processing unit 104 at the same timing. The same timing is the timing of the last supplied line in the basic pattern supply. In addition, pixel data of one line among the lines is supplied to the thinning processing unit 104 as it is without passing through the line memory unit 102. The line memory unit 102 outputs the pixel data 18 to the thinning processing unit 104 with a delay for each line.
[0022]
When the basic pattern is composed of three or more lines, the line memory unit 102 connects the line memories in cascade and also connects each line memory and the thinning processing unit 104 in a line.
[0023]
The thinning processing unit 104 includes a plurality of delay elements and adders (not shown). The thinning processing unit 104 arranges delay elements according to the number of pixels to be combined in consideration of the arrangement relationship of the colors of the pixel data in each line in the horizontal direction. The thinning processing unit 104 connects the output terminal of the delay element to the input terminal of the adder so that pixel data of the same color in the line can be obtained at the same timing. With this connection, the adder outputs mixed pixel data or pixel data of the same color. The thinning processing unit 104 reduces the number of pixels by adding pixel data regardless of the mixed color or the same color.
[0024]
Furthermore, pixel data of the same color from the same line or other lines may be added. The thinning processing unit 104 supplies the pixel data 20a, 20b, and 20c of the three primary colors used for supply to the monitor as display image data to the selector 106.
[0025]
The selector 106 controls the output in consideration of the timing obtained in the same relationship (that is, the same color) among the supplied pixel data 20a, 20b, and 20c. This output control is performed in accordance with a control signal 108a from the data input / output control unit 108. The selector 106 outputs only the pixel data of the same color from the selected pixel data 22a, 22b, 22c to the pixel interpolation processing unit 110. Further, the selector 106 is not limited to the simultaneous output, and may be controlled so as to output without mixing when the three primary colors RGB are obtained even at different timings.
[0026]
The data input / output control unit 108 adjusts the timing and outputs the control signal 108b related to the selection control of the selector 106 and the write / read enable signal of the data correction unit 10a. The data input / output control unit 108 may have this function in the system control unit of the mounted device.
[0027]
The pixel interpolation processing unit 110 has a function of interpolating and generating new three primary color RGB data in pixels at or near the intermediate position using the supplied pixel data 22a, 22b, and 22c. This interpolation is performed by averaging the respective colors of the three primary color RGB data obtained in the horizontal direction. Similarly, new pixel data can be generated by averaging in the vertical direction. At this time, considering horizontal and vertical interpolation, pixels are generated between the lines at the position to be interpolated. Interpolation in this case results in pixel generation at a virtual pixel shift position. The pixel interpolation processing unit 110 outputs the supplied pixel data 22a, 22b, 22c and the pixel data 24a, 24b, 24c including the interpolation-generated pixel data to the monitor and also supplies them to the color difference matrix unit 10d.
[0028]
The still image signal processing unit 10c generates the three primary colors RGB for each pixel by repeatedly performing horizontal interpolation using the three primary color RGB pixel data of each line using the pixel data 14 that is supplied (not shown). . Thereby, plain pixel data 26a, 26b, and 26c are generated for each color as in the case of using a three-plate color filter.
[0029]
When the pixel data 14 to be supplied is, for example, pixel data shifted in a so-called honeycomb shape, the still image signal processing unit 10c supplies not only the above-described generation of plain pixel data but also the supplied pixel data. The high-frequency luminance data is generated using the pixel data 14, and the broadband processing is performed on the virtual pixels generated at the positions surrounded by the existing pixels and the pixels that do not actually exist, and output.
[0030]
The chrominance matrix unit 10d is configured to output the three primary color data 26a, 26b, 26c or pixel data 24a, 24b from either the still image signal processing unit 10c or the moving image signal processing unit 10b, depending on the still image mode or the moving image mode, respectively. , 24c is entered. Using these pixel data, the color difference matrix unit 10d generates luminance data Y and color difference data C. _r , C _b Is generated. The color difference matrix unit 10d uses the conventional calculation formulas used so far for the matrix calculation performed here. The color difference matrix unit 10d generates the generated luminance data Y (28a) and color difference data C. _r (28b), C _b (28c) is supplied to the rear signal processing unit (not shown) in the subsequent stage. Examples of the post signal processing unit include a distortion prevention processing unit, an aperture adjustment unit, and a color difference gain adjustment unit. These are particularly effective when a honeycomb type signal is supplied.
[0031]
The post signal processing unit will be briefly described. The distortion prevention processing unit includes a low-pass filter having a band up to a high frequency so as not to cause aliasing distortion without impairing the band of the three signals supplied. In addition, the distortion prevention processing unit limits the overlapping frequency band in one direction with respect to the overlapping region of the horizontal and vertical frequency bands. This avoids image quality degradation due to frequency overlap. The aperture adjustment unit performs processing and outputs so as to improve the reduction of the high-frequency component by, for example, low-pass filter processing. As a result, the image has the same effect as the contour (edge) enhancement processing. In addition, the color difference gain adjustment unit is supplied with the supplied color difference data C _r , C _b Is adjusted to a predetermined level. The signal processing device 10 generates luminance data Y and color difference data C generated in this way. _r , C _b Is output.
[0032]
Here, the signal processing apparatus 10 will be described using a more specific embodiment. In this embodiment, pixel data 14 obtained by the basic Bayer pattern 30 shown in FIG. 2 is supplied. In the Bayer pattern 30, the basic pattern area 32 to be repeated is two lines of “GRGRGR...” And “BGBGBG. It can be seen that the line memory unit 102 may be provided with one line memory 102a from the above-described relationship (see FIG. 3). The thinning processing unit 104 collects two pixels for each line color in the horizontal direction. That is, since the thinning processing unit 104 collects two pixels for each of the two colors of the line and adjusts the timing, it is sufficient to provide a total of six delay elements 104a to 104c / 104d to 104f for each line. I understand that. The thinning processing unit 104 is provided with adders 104g, 104h, and 104i for synthesizing the same color. By inputting the read pixel data 14 and the output of the delay element 104b to the adder 104g, it is possible to add pixel data of the same color supplied every other pixel.
[0033]
For example, when the data are supplied in the order of GBGB..., The color G pixel data added to the color B pixel data advances by one. For this reason, a delay element 104c is provided. The adder 104g outputs pixel data of color B at the next addition. Therefore, the pixel data of colors G and B are obtained at the same timing. The adder 104g is connected to the selector 106 via the signal line 34. The delay element 104c is connected to the selector 106 via the signal line 36.
[0034]
Pixel data 18 from the line memory 102a is supplied to the thinning processing unit 104 for adjacent lines. Since two pixels are added and thinned, the connection relationship of the signal lines is almost the same as the connection relationship described above. In this case, for example, RGRG... Is supplied to this line, so that the color R pixel data advances from the color G pixel data and is output from the adder 104i. In consideration of the synchronization of the colors R and G, the adder 104i may supply the selector 106 via the signal line 38 so as to extract the pixel data of the color G 1. For color R 1, delay element 104 f outputs output 40 to selector 106.
[0035]
The adder 104h is supplied with the pixel data added with the color G at this timing. The adder 104h outputs the pixel data of the color G which is four times as much as the operation by adding the supplied pixel data. The selector 106 outputs pixel data 22a, 22b, and 22c for the three primary colors RGB in response to the supplied control signal 108a. The selector 106 can output pixel data of 1: 1: 1 or 1: 2: 1 as a ratio of the sizes of the pixel data 22a, 22b, and 22c by selection. The selection should be performed every other clock.
[0036]
As another specific example, a case where pixel data 14 of a basic Bayer pattern is supplied in the same manner as described above, and a thinning process of 2 pixels / 3 pixels in the horizontal direction with respect to the pixel data 14 will be described (see FIG. 4). ). Compared with the above-described thinning-out process of two pixels, four delay elements are used per line because timing adjustment is performed in conjunction with a delay corresponding to a maximum of three pixels. As compared with the previous embodiment, it can be seen that delay elements 104g and 104h are added. Six adders 42 to 52 are arranged so as to add pixel data of the same color. Assume that pixel data is supplied with GBGB ... / RGRG ... on each line.
[0037]
The adder 42 adds the pixel data of the color G using the output of the delay element 104g and the pixel data 14, and outputs the result to the adder 44. The adder 44 adds the output of the adder 42 and the output from the delay element 104 b to generate 3G pixel data and outputs it to the selector 106. Further, the adder 46 adds the outputs from the delay elements 104a and 104c so as to add to the color B, generates the pixel data 2B of the double color B, and outputs it to the selector 106.
[0038]
The thinning process for adjacent lines is performed using the pixel data 18 from the line memory 102a. The connection relationship may be the same as the connection described above. The pixel data of the color R is added through the adders 48 and 50, and finally, the pixel data 3R of the color R of 3 times is generated. The adder 50 supplies the generated pixel data of the color R to the selector 106. The adder 52 adds the pixel data of color G to form pixel data 2G. The adder 52 supplies the added pixel data to the selector 106. Although not shown in FIG. 4, pixel data 5G obtained by adding pixel data of color G obtained in each line may be supplied to the selector 106.
[0039]
The selector 106 selects the pixel data of the three primary colors RGB to be supplied every other clock. However, it goes without saying that the output is stopped until it is supplied from the delay element to the selector 106. The selector 106 can output 2: 3: 3 or 2: 2: 3 pixel data as the ratio of the sizes of the pixel data 22a, 22b, and 22c by performing selection in consideration of the balance of the ratio. If the pixels at the center of the three pixels are ignored without using the adders 44 and 50, the size ratio can be 1: 1: 1.
[0040]
The thinning process is not limited to the thinning described above for each line. Further, the thinning-out process may be changed according to the requirements of the number of pixels and the readout processing time, such as three-pixel thinning-out and four-pixel thinning-out. Therefore, when the number of pixels of the image sensor increases, it is possible to change only this part, so that it is not necessary to redesign an already developed LSI. This increases the degree of freedom in designing the device to which the signal processing device 10 is applied, and can greatly reduce the development cost of the applied device due to, for example, a change in a solid-state imaging device or the like. Further, the signal processing device 10 can be reduced in circuit size, and power consumption can be reduced.
[0041]
The pixel data of the three primary colors RGB thus obtained is supplied to the pixel interpolation processing unit 110, and pixel interpolation in the horizontal and / or vertical directions is performed by averaging. As a result, the pixel interpolation processing unit 110 can perform adjustment so as to suppress generation of false colors and false signals with respect to an image obtained as compared to when thinning out. Therefore, the signal processing apparatus 10 is an apparatus that is applied by performing signal processing using a processing circuit that supports moving images in consideration of the arrangement pattern of the color filter segments even when the number of pixels is increased in the imaging unit that performs image input. Can provide high flexibility that does not affect the video display generated by.
[0042]
Note that the signal processing device 10 is not limited to moving images, and it is advantageous to apply it to, for example, generation of still images and index images that perform high-speed processing.
[0043]
Although the embodiments described so far have described the processing for a basic Bayer pattern, there are various types of Bayer patterns (see FIG. 5). The Bayer patterns shown in FIGS. 5 (a) and 5 (b) are both improved, and the basic pattern area 32 has four lines. Even in such a case, the line memory unit 102 may prepare a line memory having the number of lines corresponding to the basic pattern.
[0044]
In addition, the pixel data 14 to be supplied is arranged in various colors even when supplied in a G-stripe RB complete checkered pattern in which all colors (RGB) are aligned in one line, a honeycomb-shaped G square RB complete checkered pattern, and a complementary color pattern. Considering the pattern, the number of pixels to be thinned out, and the timing of synchronization, thinning processing can be performed accurately.
[0045]
As described above, since the low-pass filter process before the thinning process and the pixel interpolation process are performed after the thinning process, generation of false colors and false signals can be suppressed as compared with the case where the thinning process is simply performed. Actually, the image obtained by this process has a very large number of original pixels, so that the deterioration of the image quality is not so noticeable even if the image is thinned out.
[0046]
With the above configuration, even if the number of pixels increases, the moving image display within the specified time is satisfied for the pixel data supplied according to the color arrangement pattern that has undergone the low-pass processing, and the number of pixels also increases. Therefore, even if the image is obtained by thinning out, an image in which the deterioration of the image quality is not so conspicuous can be obtained, the redesign of the developed LSI can be avoided, and the development cost can be reduced.
[0047]
【The invention's effect】
As described above, according to the signal processing apparatus and signal processing method of the present invention, the data supply control means controls the supply of pixel data line by line in the unit by line, and the filter means collects a plurality of lines. Filter processing suitable for display is performed, the same color pixel data in the line is collected at the same timing by the same color composition means, the basic color is output from the basic pattern to the output switching means, and from the output switching means according to the control of the selection control means By outputting pixel data and interpolating the pixel data with the interpolation means, the same processing is performed as when the pixels in different positional relationships for each color are thinned in the horizontal direction, and the basic colors are aligned, and the filter processing and interpolation processing Pixel data supplied according to the color arrangement pattern that has undergone low-pass processing even if the number of pixels increases by suppressing the generation of false colors and false signals For the moving image within the time specified in the moving image, the thinning processing is performed in response to the high-speed processing, and the interpolation processing is performed in consideration of the position of the pixel data and the number of pixels using the obtained pixel data. Generation is completed, and false colors and false signals generated in the obtained image are suppressed. Since the number of pixels is increasing, even if the image is thinned out, the degradation of the image quality can be made less noticeable, redesign of the developed LSI can be avoided, and the development cost can be reduced.
[Brief description of the drawings]
FIG. 1 is a schematic block diagram of a signal processing apparatus to which the present invention is applied.
FIG. 2 is a schematic diagram illustrating a color arrangement of a Bayer pattern with respect to pixel data supplied to the signal processing apparatus of FIG. 1;
3 is a circuit diagram showing a specific configuration of a thinning processing unit in the moving image signal processing unit of FIG. 1;
4 is a circuit diagram showing another specific configuration of the thinning-out processing unit in the moving image signal processing unit of FIG. 1;
FIG. 5 is a schematic diagram showing another color arrangement pattern when the Bayer pattern of FIG. 2 is improved.
[Explanation of symbols]
10 Signal processor
10a Data correction unit
10b Video signal processor
10c Signal processing unit for still images
10d color difference matrix
10B Same color composition part
100 Low pass filter
102 Line memory section
104 Thinning processing unit
106 selector
108 Data input / output controller
110 pixel interpolation processor

Claims (2)

In a signal processing device for generating basic colors to be used for image generation in consideration of a color arrangement pattern generated by supplying pixel data corresponding to one color to a pixel and generating the color of the supplied pixel data, the device includes:
Data correction means for performing color correction on supplied pixel data ;
Filter means for performing filter processing on the pixel data supplied in accordance with the correction in accordance with the number of pixels by thinning processing ;
Among the pixel data of each line supplied through the filtering process, pixels of a plurality of lines representing a repeated basic pattern included in the color arrangement pattern used for the color filter are supplied at the same timing, and pixels of the same color in the line The same color composition means for outputting pixel data of mixed color or only the same color and reducing the number of pixels ,
Output switching means for switching the output of the combined pixel data of each color;
Data input / output control means for controlling and adjusting the timing with the selection timing of the output switching means and the control signals related to the write / read enable signal of the data correction means ;
Look including an interpolation means for performing pixel interpolation by using each color of the pixel data the selected,
The apparatus inputs pixel data in which a Bayer pattern is set as the basic pattern as the color arrangement pattern,
The same color synthesis means includes line storage means for storing pixel data of each line that is one less than the number of lines of the basic pattern;
Output timing adjustment means for adjusting the output timing of pixel data in each line according to the basic pattern;
Combining means for combining the timing-adjusted pixel data for each color,
The signal processing apparatus according to claim 1, wherein the output timing adjusting means is a delay means for adjusting timing according to the type of color included in one line and the number of pixels to be collected . In a signal processing method for generating a basic color to be used when image generation is performed in consideration of a color arrangement pattern generated by the color of pixel data corresponding to one color supplied to a pixel and the color of the supplied pixel data. The method is
A first step of color correcting the supplied pixel data ;
The pixel data supplied in response to the correction, a second step of filtering in accordance with the number of pixels by thinning processing,
Among the pixel data of each line supplied through the filter processing, a plurality of lines of pixels representing a repeated basic pattern included in the color arrangement pattern used for the color filter are supplied at the same timing, and the same color in the line A third step of reducing the number of pixels by combining the pixel data in a mixed color or the same color , and further outputting the pixel data so that the combined pixel data of the same color form the basic pattern;
A fourth step of switching and outputting the pixel data of each color in accordance with the output timing of the synthesized pixel data of each color ;
Look including a fifth step of interpolating the pixels with the colors of the pixel data to be output,
The method inputs pixel data used in the basic pattern as a Bayer pattern as the color arrangement pattern,
The third step is a sixth step of supplying pixel data of the Bayer pattern and collecting a plurality of pieces of pixel data of the same color in each line;
Signal processing method characterized by seventh step and the containing Mukoto the same color pixel data among summarizes the forming the basic pattern, synthesized.

Images