JP2011166535A - Imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the following problem: in a luminance signal produced from signals R, B and G amplified so as to match white-balancing, an S/N is deteriorated by the influence of noise caused by amplification processing, and motion cannot be exactly detected. <P>SOLUTION: A color interpolation circuit (15) performs color interpolation processing based on a color filter array of a solid-state imaging element (11) and outputs the signals R, G and B. A white balance amplification circuit (16) amplifies the signals R and B based on a gain set by a control circuit (20) and outputs signals RW and BW. A signal level detecting module (17) obtains a pixel integration value or an average value of each of the signals RW, G and BW and supplies a result to the control circuit (20). A moving amount calculation circuit (30) generates a moving amount signal MD which is based on an inter-frame difference of a color addition signal MDi obtained by adding the signals R, G and B. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, and more particularly, to an imaging apparatus that can output a more accurate motion detection result and obtain a higher-quality captured image even in an imaging environment with low illuminance.

  As a conventional imaging device, white balance processing according to the color temperature of the light source amplifies the primary color signal R when the color temperature of the light source is high, and amplifies the primary color signal B when the color temperature of the light source is low, thereby achieving white balance. There is one configured to amplify R and B signals so as to match (see, for example, Patent Document 1).

  There is also known an imaging apparatus configured to determine whether there is a movement of a subject by obtaining luminance difference information from a video signal output from an imaging element and comparing the luminance difference information with a detection parameter for motion detection. (For example, refer to Patent Document 2).

Japanese Patent Laid-Open No. 3-155292 (page 3, FIG. 5) Japanese Patent No. 431457 (paragraph 0012, FIG. 1)

Since the conventional imaging device described in Patent Document 1 is configured as described above, the primary color signal R or the primary color signal B is amplified by the color temperature of the light source. Since the S / N of the primary color signal B is low, circuit noise increases when amplified by analog signal processing, and quantization noise increases and S / N deteriorates when amplified by digital signal processing.
Even if the technique described in Patent Document 1 is incorporated in the imaging apparatus described in Patent Document 2, the amplified primary color signal R and the primary color signal B and the luminance signal generated from the primary color signal G are also S / Since N deteriorates, there is a problem in that the inter-frame difference signal of the luminance signal includes not only a motion component but also a lot of noise components, and accurate motion detection cannot be performed.

  The present invention has been made in order to solve the above-described problems. It is possible to perform motion detection capable of outputting a more accurate motion detection result, and more accurate motion detection result. An object of the present invention is to obtain an imaging device capable of obtaining a higher quality captured image based on the above.

In order to solve the above problems, an imaging apparatus according to the present invention provides:
An imaging signal generation unit that includes an imaging unit that images a subject, and that generates an imaging signal of a plurality of color components obtained as a result of imaging by the imaging unit;
A white balance amplifying circuit for amplifying the signals of a plurality of color components output from the imaging signal generating means for white balance;
Control means for controlling the amplification factor for each color component of the white balance amplifier circuit so as to achieve white balance;
Video signal generating means for generating a video signal from a plurality of color component signals output from the white balance amplifier circuit;
A signal of a plurality of color components obtained as a result of imaging by the imaging means, which has not been amplified by the white balance amplifier circuit, is input, and the sum of the input signals of the plurality of color components is a color addition signal And a motion amount calculation circuit for detecting the motion of the subject based on the color addition signal.

  According to the present invention, since the motion amount is obtained based on the signal obtained by adding the primary color signals R, G, and B to which the amplification processing by the white balance control is not applied, the noise component included in the motion amount is small. Thus, there is an effect that a more accurate motion detection result can be obtained.

It is a block block diagram which shows the imaging device of Embodiment 1 of this invention. FIG. 2 is a color filter array diagram in a color filter array of the solid-state imaging device 11 of FIG. 1. FIG. 2 is a block configuration diagram illustrating an example of a motion amount calculation circuit 30 in FIG. 1. It is a block block diagram which shows the other example of the motion amount calculation circuit 30 of FIG. It is a block block diagram which shows the imaging device of Embodiment 2 of this invention. It is a block block diagram which shows the imaging device of Embodiment 3 of this invention. It is a block block diagram which shows the imaging device of Embodiment 4 of this invention. It is a block block diagram which shows an example of the noise reduction circuit 50 of FIG. FIG. 9 is a block configuration diagram illustrating an example of a synthesis circuit 52 in FIG. 8. It is a block block diagram which shows the imaging device of Embodiment 5 of this invention. It is a block block diagram which shows the imaging device of Embodiment 6 of this invention. FIG. 12 is a block configuration diagram illustrating an example of a pixel addition circuit 70 in FIG. 11. FIG. 13 is a pixel space arrangement diagram showing a spatial positional relationship of signals added by an in-plane pixel addition circuit 74 of FIG. 12. It is a figure which shows the spatial positional relationship of the signal added by the space addition circuit 75 of FIG. It is a block block diagram which shows the imaging device of Embodiment 7 of this invention. It is a block block diagram which shows the imaging device of Embodiment 8 of this invention. It is a block block diagram which shows the imaging device of Embodiment 9 of this invention.

Embodiment 1 FIG.
FIG. 1 is a block diagram showing an imaging apparatus according to Embodiment 1 of the present invention. In the following, an imaging apparatus compatible with NTSC television will be described as an example.

In FIG. 1, a subject image is formed by a lens (not shown) on an imaging surface of a solid-state imaging device 11 constituted by a CCD, for example. Noise or the like is removed from the imaging signal photoelectrically converted by the solid-state imaging device 11 and transferred and output by the correlated double sampling processing circuit (CDS circuit) 12.
The programmable gain amplifier circuit (PGA) 13 amplifies and outputs the output signal of the CDS circuit 12 with a gain controlled by a control signal Sgc output from the control circuit 20 described later.
The A / D conversion circuit (ADC) 14 converts the output signal of the PGA 13 into a digital signal.

  The color interpolation circuit 15 performs color interpolation processing based on the color filter array of the solid-state image sensor 11 and outputs primary color signals R, G, and B.

  Among the above, the imaging signal generation unit 10 is configured by the solid-state imaging device 11, the CDS circuit 12, the PGA 13, the ADC 14, and the color interpolation circuit 15.

The white balance amplifier circuit 16 adjusts the white balance by amplifying one or more of the primary color signals R, G, and B based on the gain set by the control circuit 20. The illustrated white balance amplifier circuit 16 includes an R signal amplifier circuit 16R and a B signal amplifier circuit 16B.
The R signal amplifier circuit 16R amplifies the primary color signal R based on the gain set by the control circuit 20, and outputs the primary color signal RW.
The B signal amplification circuit 16B amplifies the primary color signal B based on the gain set by the control circuit 20 and outputs the primary color signal BW.
In the illustrated example, the primary color signal G is not amplified, but the primary color signal G may be amplified.

The signal level detection circuit 17 calculates the pixel integration values of the primary color signals RW, G, and BW output from the white balance amplification circuit 16 and supplies them to the control circuit 20.
The color matrix circuit 18 performs color matrix conversion on the primary color signals RW, G, and BW, and outputs a luminance signal Y and color difference signals RY and BY.
The color modulation circuit 19 outputs a color signal C by performing quadrature two-phase modulation on the color subcarrier with the color difference signal RY and the color difference signal BY.
A luminance signal Y is output from the output terminal 21Y, and a color signal C is output from the output terminal 21C.
A screen (field or frame) composed of the luminance signal Y and the color signals RY and BY output from the color matrix circuit 18 constitutes a video signal. A generation circuit is configured.

As illustrated in FIG. 3, the motion amount calculation circuit 30 includes a color addition circuit (SUM) 31, a delay circuit (FDL) 32, and a difference absolute value calculation circuit 33.
The color addition circuit 31 adds the primary color signals R, G, and B supplied through the input terminals 36R, 36G, and 36B, respectively, and generates a color addition signal MDi. The color addition signal MDi is also called a motion detection signal.
The delay circuit 32 generates a delayed color addition signal MDd obtained by delaying the color addition signal MDi by one frame period.

The difference absolute value calculation circuit 33 obtains the absolute value of the difference between the color addition signal MDi and the delayed color addition signal MDd and outputs it as a motion amount signal MD.
The difference absolute value calculation circuit 33 includes a subtraction circuit 34 and an absolute value circuit (ABS) 35. The subtracting circuit 34 outputs a difference signal obtained by subtracting the delayed color addition signal MDd from the color addition signal MDi. The absolute value circuit 35 generates a motion amount signal MD by removing the sign of the difference signal output from the subtracting circuit 34 to obtain an absolute value. As described above, the absolute difference calculation circuit 33 generates the motion amount signal MD representing the motion of each pixel based on the inter-frame difference of the color addition signal. The motion amount signal MD is output via the output terminal 37.

The motion threshold generation circuit 41 generates a motion threshold TH based on the noise level information input from the control circuit 20.
The determination circuit 42 performs a motion determination based on the motion amount signal MD and the motion threshold value TH set by the motion threshold value generation circuit 41, and generates a motion detection signal MV.
The motion detection signal MV is output from the output terminal 21M.

  The control circuit 20 sets a setting value for each circuit. The control circuit 20 observes the signal level of the video signal, and performs automatic exposure control by setting the aperture of the lens, the exposure time of the solid-state imaging device, and the gain of the programmable gain amplification circuit (PGA). Also, the set value of each circuit is set based on the analysis result of the image.

The synchronization signal generation circuit 43 generates a vertical synchronization signal and a horizontal synchronization signal and supplies them to the timing generation circuit 44.
The timing generation circuit 44 generates a drive timing signal for the solid-state imaging device 11 and supplies it to the drive circuit 45.
The drive circuit 45 generates a drive signal for the solid-state imaging device 11 based on the drive timing signal output from the timing generation circuit 44.
The solid-state imaging device 11 performs photoelectric conversion and charge transfer based on the drive signal output from the drive circuit 45.

  FIG. 2 is a schematic diagram of a color filter array of the solid-state image sensor 11. For each pixel, R, G, and B color filters are arranged in a Bayer array. From one scanning line (for example, L1) of the solid-state image sensor 11, color components are read out for each pixel in the order of G, B, G, and B in the horizontal direction. From the next scanning line (for example, L2), color components are read for each pixel in the order of R, G, R, and G. From the solid-state imaging device 11, a signal having only one color component for each pixel (a signal in which only one color component exists and other color components are missing) is read out.

  The color interpolation circuit 15 is a color component that is missing in an interpolation process using pixels of the same color (located in a neighboring region including each pixel and its surrounding pixels) to align all color components for each pixel. Is generated by interpolation. For example, for the second pixel of the second line (row) L2, that is, the pixel of the second column P2, the R component is the pixel adjacent to the left and right, that is, the first column P1 and the third column of the same line (second line) L2. Interpolation is generated based on the R component pixels of the pixels in the column P3. Similarly, the B component is generated by interpolation based on the B component pixels of the pixels adjacent to each other in the vertical direction, that is, the first line L1 and the third line L3 in the same column (second column) P2. Next, for the pixels in the second line L2 and the third column P3, the G component is the pixel adjacent in the vertical and horizontal directions, that is, the pixels in the first line L1, the third column P3, the pixels in the third line L3, the third column P3, Interpolation is generated based on the G component pixels of the pixels of the second line L2, the second column P2, and the pixels of the second line L2, the fourth column P4. Similarly, the B component includes pixels adjacent in the oblique direction, that is, the pixels of the first line L1, the second column P2, the third line L3, the pixels of the second column P2, the pixels of the first line L1, the fourth column P4, and Interpolation is generated based on the B component pixels of the pixels in the third line L3 and the fourth column P4. For other pixels, color components that are missing from neighboring neighboring pixels are generated by interpolation. By interpolating the missing color components for each pixel, the primary color signals R and G for which all pixel values are aligned for the R component, and the primary color signals for which all pixel values are aligned for the G and B components. B can be generated.

The signal level detection circuit 17 calculates pixel integration values of the primary color signals RW, G, and BW and supplies them to the control circuit 20.
For example, the signal level detection circuit 17 adds all the pixel values of one field period of the primary color signal RW and supplies the R sum signal RI to the control circuit 20, and supplies all the pixel values of the primary color signal G of one field period. And the G sum signal GI is supplied to the control circuit 20, all pixel values of one field period of the primary color signal BW are added, and the B sum signal BI is supplied to the control circuit 20.

  In the above example, the operation of the signal level detection circuit 17 has been described as adding all the pixel values in one field period. However, it may be configured to add all the pixel values in one frame period, In a camera that places importance on the subject located at the center, it may be configured to obtain the sum of the pixel values only in the central part of the screen, and not only in the central part in the screen, but also in a specific part, The total sum of the pixel values may be obtained, and in this case, the same operation is performed and the same effect can be obtained.

  Further, as the signal level detection circuit 17, a circuit for obtaining the average value of the signal may be used instead of the signal for obtaining the integral value of the signal. Note that the process for obtaining the integral value is equivalent to obtaining the average value if the number of pixels to be integrated is known.

  An operation of white balance control in the control circuit 20 will be described. The control circuit 20 performs white balance control based on the premise that the sum of color components (sum of many feeds or frames) included in the screen imaged in many scenes is close to an achromatic color. The control circuit 20 controls the gains of the R signal amplification circuit 16R and the B signal amplification circuit 16B so that the R total signal RI and the B total signal BI input from the signal level detection circuit 17 approach the value of the G total signal GI. To do. For example, the gain of the R signal amplifier circuit 16R is changed by one step until RI = GI, and the gain of the B signal amplifier circuit 16B is changed by one step until BI = GI. The gain change is stopped when the total GI is sufficiently close (the difference is equal to or less than a predetermined value) so that the color change does not hunting, and the gain change is started when the color change is more than the predetermined value.

  A silicon material forming a photoelectric conversion circuit such as a photodiode of the solid-state imaging device 11 generally has low sensitivity in the short wavelength component on the Blue (blue) side and high sensitivity in the long wavelength component on the Red (red) side. For this reason, even in an illumination environment where the spectral emission characteristics are flat, the amount of blue exposure charge is smaller than that of green (green) and red. Thus, the white balance control operates so that the gain of the B signal amplifier circuit 16B is set large, the primary color signal B is amplified, and the signal level approaches the primary color signal G.

  In an illumination environment where the color temperature is low, the radiant power of the long wavelength component on the Red side is large, and the radiant power of the short wavelength component on the Blue side is small. Even in an illumination environment where the spectral emission characteristics are flat, the amount of blue exposure charge is smaller than that of green and red, but in an illumination environment where the radiant power of the short wavelength component on the blue side is small, blue exposure The amount of charge further decreases, and is significantly smaller than the exposure amount of Green and Red. Therefore, the white balance control operates so that the gain of the B signal amplification circuit 16B is set to be significantly large, the primary color signal B is amplified, and the signal level is brought close to the primary color signal G. As an illumination environment with a low color temperature, for example, an incandescent lamp is used for illumination, and the color temperature is around 3000K.

  In an illumination environment with a high color temperature, the radiant power of the short wavelength component on the Blue side is large and the radiant power of the long wavelength component on the Red side is small. In an illumination environment where the radiant power of the long-wavelength component on the Red side is small, the Red exposure charge amount decreases and becomes significantly smaller than the Green exposure charge amount. Therefore, the white balance control operates so that the gain of the R signal amplifier circuit 16R is set large, the primary color signal R is amplified, and the signal level is brought close to the primary color signal G.

  As described above, in the white balance control, the primary color signal R is amplified by the R signal amplification circuit 16R, and the primary color signal B is amplified by the B signal amplification circuit 16B. In a very dark low-light environment where the S / N is poor, the low S / N primary color signal R and the primary color signal B are amplified, and further, amplifier noise is added to deteriorate the S / N.

  In the above example, the signal level detection circuit (17) for white balance control is provided for the primary color signals R, G and B. However, the color difference signal RY and color difference signal output from the color matrix circuit 18 are provided. B-Y is configured to be integrated, and the control circuit 20 causes the R signal amplifier circuit 16R and the B signal amplifier circuit 16B so that the difference between the sum of the color difference signals RY and the sum of the color difference signals BY approaches zero. The gain may be controlled. It operates similarly and the same effect is acquired.

The color matrix circuit 18 generates a luminance signal Y and color difference signals RY and BY from primary color signals RW, G, and BW based on the following color matrix conversion formula.
Y = + 0.30RW + 0.59G + 0.11BW
RY = + 0.70RW-0.59G-0.11BW
BY = −0.30RW−0.59G + 0.89BW

  The color modulation circuit 19 outputs a color signal C by performing quadrature two-phase modulation on the color subcarrier with the color difference signal RY and the color difference signal BY. A color signal C is generated by digital quadrature two-phase modulation of the clock frequency four times the color subcarrier frequency with the color difference signal RY and the color difference signal BY.

The output signals R, G, and B of the color interpolation circuit 15 are supplied to the input terminals 36R, 36G, and 36B of the motion amount calculation circuit 30, respectively.
The color addition circuit 31 adds the primary color signals R, G, and B for each pixel as shown in the following formula to generate a color addition signal MDi.
MDi = R + G + B

The 1-frame delay circuit 32 delays the color addition signal MDi by one frame period and outputs a delayed color addition signal MDd.
The difference absolute value sum generation circuit 33 generates a motion amount signal MD representing the motion of the subject for each pixel based on the difference between the color addition signal MDi and the delayed color addition signal MDd, that is, the interframe difference of the color addition signal.
The combination of the delay circuit 32 and the difference absolute value calculation circuit 33 generates a motion amount signal MD based on the inter-frame difference of the color addition signal MDi.
The motion amount signal MD is output from the output terminal 37.
The delay time of the delay circuit 32 is not limited to one frame period, and may be an even multiple of the vertical scanning period.

FIG. 4 shows another configuration example of the motion amount calculation circuit 30 together with 1-frame delay circuits 22R, 22G, and 22B used together with the motion amount calculation circuit 30.
Also in the motion amount calculation circuit 30 in FIG. 4, the output signals R, G, and B of the color interpolation circuit 15 are supplied to the input terminals 36R, 36G, and 36B, similarly to the motion amount calculation circuit 30 in FIG.
The color addition circuit 31 adds the primary color signals R, G, and B for each pixel as shown in the following formula to generate a color addition signal MDi.
MDi = R + G + B

  The 1-frame delay circuit 22R delays the primary color signal R output from the color interpolation circuit 15 by 1 frame period and outputs a frame-delayed primary color signal Rd. The 1-frame delay circuit 22G delays the primary color signal G output from the color interpolation circuit 15 by 1 frame period and outputs a frame-delayed primary color signal Gd. The 1-frame delay circuit 22B delays the primary color signal B output from the color interpolation circuit 15 by 1 frame period and outputs a frame-delayed primary color signal Bd.

The frame delay primary color signals Rd, Gd, and Bd delayed by the one-frame delay circuits 22R, 22G, and 22B are input to the input terminals 38R, 38G, and 38B of the motion amount calculation circuit 30.
The color addition circuit (SUM) 39 receives the frame delay signals Rd, Gd and the input to the input terminals 38R, 38G, and 38B, and adds the frame delay primary color signals Rd, Gd, and Bd for each pixel as shown in the following equation. A delayed color addition signal MDd is generated.
MDd = Rd + Gd + Bd

The difference absolute value calculation circuit 33 calculates the absolute value of the difference between the color addition signal MDi and the delayed color addition signal MDd and outputs it as a signal (motion amount signal) MD indicating the amount of motion for each pixel.
The motion amount signal MD is output from the output terminal 37.
Note that the delay time of the delay circuits 22R, 22G, and 22B is not limited to one frame period, and may be an even multiple of the vertical scanning period.

  Returning to FIG. 1, the determination circuit 42 performs a motion determination based on the motion amount signal MD and the motion threshold TH set by the motion threshold generation circuit 41, and generates a motion detection signal MV. The motion detection signal MV is output from the output terminal 21M. When the motion amount signal MD is larger than the motion threshold value TH, it is determined that “there is motion” and the motion detection signal MV is made significant. When the motion amount signal MD is smaller than the motion threshold TH, it is determined that “no motion” and the motion detection signal MV is made involuntary. Based on the motion detection signal MV for each pixel, the motion of the entire screen is determined, for example, an emergency bell is sounded or emergency lighting is turned on. Further, based on the motion detection signal MV for each pixel, the screen is divided into, for example, 64 partial regions of horizontal 8 divisions and vertical 8 divisions, motion determination is performed in units of partial regions, and output from the output terminal 21Y. 64 motion detection points may be superimposed on the luminance signal Y and the color signal C output from the output terminal 21C, and the presence / absence of motion may be displayed with the display color of the detection points.

  The control circuit 20 determines the signal integration level observed for the automatic exposure control, the lens aperture set for the automatic exposure control, the exposure time of the solid-state image sensor, and the illuminance of the subject from the gain of the PGA. Guess. A noise level is estimated from the estimated illuminance, lens aperture, exposure time of the solid-state image sensor, and PGA gain, and noise level information is supplied to the motion threshold value generation circuit 41. When the illuminance is low, the gain of the PGA is set large in order to secure the signal level, and the noise level becomes large.

  The motion threshold generation circuit 41 calculates the noise level included in the motion amount signal MD according to the estimated noise level. The noise level included in the motion amount signal MD is calculated in consideration of the addition calculation for performing motion detection on the noise levels of the primary color signals R, G, and B and the inter-frame difference calculation. The motion threshold generation circuit 41 supplies the determination circuit 42 with a motion threshold TH that exceeds the noise level included in the motion amount signal MD on the assumption that the motion component is larger than the noise component.

  For example, when the movement amount is obtained based on the difference between the luminance signals generated from the primary color signals R, G, and B after the white balance control, the control circuit 20 automatically determines the signal integration level being observed, Illuminance is estimated from the aperture of the lens set for exposure control, the exposure time of the solid-state imaging device, and the gain of the PGA. The noise level is estimated from the set values of the estimated illuminance, the lens aperture, the exposure time of the solid-state imaging device, and the gain of the PGA. A noise level is estimated by adding noise generated by the gain of the R signal amplifier circuit and the gain of the B signal amplifier circuit set for automatic white balance control to the noise level.

  The motion threshold value generation circuit 41 calculates the noise level included in the motion amount signal MD according to the noise level in consideration of automatic white balance control. The motion threshold generation circuit 41 supplies the determination circuit 42 with a motion threshold TH that exceeds the noise level included in the motion amount signal MD on the assumption that the motion component is larger than the noise component. A minute movement below the noise level included in the movement amount signal MD cannot be detected.

  As described above, in the present invention, since the motion amount is obtained based on the signal obtained by adding the primary color signals R, G, and B to which the amplification process by the white balance control is not added, it is included in the motion amount signal MD. The noise component generated is reduced, the motion threshold TH of the determination circuit 42 can be set small, and there is an effect that even a minute motion can be detected.

Since the color addition circuit 31 adds the primary color signals R, G, and B that have not been amplified by the white balance control and does not use a signal that greatly deteriorates the S / N due to the white balance control, as shown in the above equation. The color addition signal MDi can be generated without deteriorating the S / N. The noise component of the signal used for motion detection is reduced, and there is an effect that motion can be detected correctly even in an extremely dark low-light environment with poor S / N. The movement threshold TH can be set small, and there is an effect that even a minute movement can be detected.
In addition, since motion detection is performed using not only a luminance signal but also a signal including all color components, a change in color motion can also be detected. This has the effect of detecting motion even when subjects with the same brightness level but different colors move.

  The motion amount calculation circuit 30 generates a motion amount signal MD based on the inter-frame difference of the color addition signal MDi. When the S / N of the color addition signal MDi is high, the motion component is obtained by the inter-frame difference. However, when the S / N of the color addition signal MDi is low, the inter-frame difference includes not only the motion component but also the color addition signal MDi. Many differences in the included noise are included. Therefore, if the S / N of the color addition signal MDi is low, there is a high risk of outputting an erroneous motion detection result due to noise.

  In a surveillance system that includes an imaging device, if a motion is detected, an intruder is judged and an alarm is issued, and an emergency bell sounds, emergency lights turn on, and security guards rush Has been. Since it is configured to detect motion based on a signal obtained by adding the primary color signals R, G, and B to which amplification processing by white balance control has not been added, the risk of outputting an erroneous motion detection result is reduced, resulting in false alarms. Prevents noise from emergency bells and lights, reducing the number of useless guards.

  In the configuration of FIG. 4, in order to obtain the inter-frame difference of the color addition signal obtained by adding a plurality of color components, the color addition signal obtained by adding the plurality of color components is not delayed by one frame, but remains as a plurality of color components. Since it is configured to delay one frame and add a plurality of color components before and after one frame delay, the memory circuit for delaying one frame can be shared with other memory application circuits, and one memory circuit can be reduced. There is an effect that the component cost, the circuit mounting area and the power consumption can be reduced.

Embodiment 2. FIG.
FIG. 5 is a block diagram showing an imaging apparatus according to Embodiment 2 of the present invention. The image pickup apparatus according to the second embodiment is generally the same as the image pickup apparatus according to the first embodiment described with reference to FIG. 1, but is different in that a peripheral pixel addition circuit 47 is added. In FIG. 5, in the configuration shown in FIG. 1, the portion on the left side of the A / D conversion circuit 14 is not shown.

The peripheral pixel addition circuit 47 performs peripheral pixel addition based on the color filter array of the solid-state image sensor 11, and outputs primary color signals Rm, Gm, and Bm.
The color addition circuit 31 of the motion amount calculation circuit 30 adds the primary color signals Rm, Gm, and Bm to generate a color addition signal MDi.

As described in connection with the first embodiment, the color filter array of the solid-state imaging device 11 is configured as shown in FIG. 2, for example. The operation of the peripheral pixel addition circuit 47 will be described with reference to FIG. First, a case where peripheral pixels in the range of 3 horizontal pixels and 3 vertical pixels are used will be described. When the pixel of interest is G44, Rm (44), Gm (44), and Bm (44) that can be obtained by the following equations are output as primary color signals Rm, Gm, and Bm.
Gm (44) = (G33 + G35 + G44 + G53 + G55) / 5
Bm (44) = (B43 + B45) / 2
Rm (44) = (R34 + R54) / 2

When the pixel of interest is R54, Rm (54), Gm (54) and Bm (54) obtained by the following equations are output as primary color signals Rm, Gm and Bm.
Gm (54) = (G44 + G53 + G55 + G64) / 4
Bm (54) = (B43 + B45 + B63 + B65) / 4
Rm (54) = R54

When the pixel of interest is B45, Rm (45), Gm (45) and Bm (45) obtained by the following equation are output as primary color signals Rm, Gm and Bm.
Gm (45) = (G35 + G44 + G46 + G55) / 4
Bm (45) = B45
Rm (45) = (R34 + R36 + R54 + R56) / 4

A case where peripheral pixels in the range of 5 horizontal pixels and 5 vertical pixels are used will be described. When the pixel of interest is G44, Rm (44), Gm (44) and Bm (44) obtained by the following equations are output as primary color signals Rm, Gm and Bm.
Gm (44) = (G22 + G24 + G26 + G33 + G35 + G42 + G44 + G46 + G53 + G55 + G62 + G64 + G66) / 13
Bm (44) = (B23 + B25 + B43 + B45 + B63 + B65) / 6
Rm (44) = (R32 + R34 + R36 + R52 + R54 + R56) / 6

When the pixel of interest is R54, Rm (54), Gm (54) and Bm (54) obtained by the following equations are output as primary color signals Rm, Gm and Bm.
Gm (54) = (G33 + G35 + G42 + G44 + G46 + G53 + G55 + G62 + G64 + G66 + G73 + G75) / 12
Bm (54) = (B43 + B45 + B63 + B65) / 4
Rm (54) = (R32 + R34 + R36 + R52 + R54 + R56 + R72 + R74 + R76) / 9

When the pixel of interest is B45, Rm (45), Gm (45) and Bm (45) obtained by the following equation are output as primary color signals Rm, Gm and Bm.
Gm (45) = (G24 + G26 + G33 + G35 + G37 + G44 + G46 + G53 + G55 + G57 + G64 + G66) / 12
Bm (45) = (B23 + B25 + B27 + B43 + B45 + B47 + B63 + B65 + B67) / 9
Rm (45) = (R34 + R36 + R54 + R56) / 4

  As described above, according to the present embodiment, not only one pixel but also a pixel in a neighboring region centered on the target pixel, for example, a peripheral pixel average value having the same distance centered on the target pixel is used for motion detection. The noise component is reduced, and there is an effect that the motion can be detected correctly even in an extremely dark low light environment where the S / N is poor. Compared to the case where peripheral pixels in the range of 3 horizontal pixels and 3 vertical pixels are used as the pixels in the vicinity region, peripheral pixels in the range of 5 horizontal pixels, 5 vertical pixels, peripheral pixels in the 7 horizontal and 7 vertical pixels range The S / N of the color addition signal is improved when using. Noise of signals used for motion detection because primary color signals Rm, Gm, and Bm are generated from peripheral pixels centered on a target pixel of a Bayer array signal, and a motion amount is obtained based on a signal obtained by adding the primary color signals Rm, Gm, and Bm. There is an effect that the components can be reduced and the motion can be correctly detected even in an extremely dark low light environment where the S / N is poor. The movement threshold TH can be set small, and there is an effect that even a minute movement can be detected.

  In addition, since motion detection is performed based on a signal obtained by adding peripheral pixels centered on the target pixel of the Bayer array signal read from the solid-state imaging device, it is possible to more accurately detect motion in units of pixels. Since the luminance signal generated by the video signal processing may be displaced from the pixel position at the time of imaging due to the influence of the interpolation processing or the filter processing, it is difficult to detect the motion in units of pixels strictly.

Embodiment 3 FIG.
FIG. 6 is a block diagram showing an imaging apparatus according to Embodiment 3 of the present invention. The imaging apparatus according to the third embodiment is generally the same as the imaging apparatus according to the first embodiment described with reference to FIG. 1, but has the following differences. That is, the image pickup apparatus shown in FIG. 6 is a three-plate camera using three solid-state image pickup devices, and instead of the image pickup device 11 shown in FIG. 1, a solid-state image pickup device 11R for photoelectrically converting R component incident light; A solid-state imaging device 11G for photoelectrically converting G-component incident light and a solid-state imaging device 11B for photoelectrically converting B-component incident light are provided. Further, instead of the CDS circuit 12, the PGA 13 and the ADC 14, CDS circuits 12R, 12G, 12B, PGA 13R, 13G, 13B, ADC 14R, 14G, 14B provided corresponding to the solid-state imaging devices 11R, 11G, 11B, respectively, are provided. ing.

The lens 48 forms a subject image on the imaging surfaces of the solid-state imaging devices 11R, 11G, and 11B.
The prism 49 separates the incident light from the lens 48 into three primary colors of RGB by reflection of the dichroic film.

  The solid-state imaging device 11R photoelectrically converts R component incident light dispersed by the prism 49, transfers the charges, and outputs the result. The CDS circuit 12R removes noise and the like of the imaging signal output from the solid-state imaging device 11R. The PGA 13R amplifies and outputs the output signal of the CDS circuit 12R with a gain controlled by the control signal output from the control circuit 20. The ADC 14R converts the output signal of the PGA 13R into a digital signal and outputs a primary color signal R.

  The solid-state imaging device 11G photoelectrically converts the G component incident light split by the prism 49, transfers the charges, and outputs the charges. The CDS circuit 12G removes noise and the like of the imaging signal output from the solid-state imaging device 11G. The PGA 13G amplifies the output signal of the CDS circuit 12G with a gain controlled by the control signal output from the control circuit 20, and outputs the amplified signal. The ADC 14G converts the output signal of the PGA 13G into a digital signal and outputs a primary color signal G.

  The solid-state imaging device 11B photoelectrically converts the B component incident light split by the prism 49, transfers the charges, and outputs the charges. The CDS circuit 12B removes noise and the like of the imaging signal output from the solid-state imaging device 11B. The PGA 13B amplifies the output signal of the CDS circuit 12B with a gain controlled by the control signal output from the control circuit 20, and outputs the amplified signal. The ADC 14B converts the output signal of the PGA 13B into a digital signal and outputs a primary color signal B.

In the imaging apparatus shown in FIG. 6, the color interpolation circuit 15 shown in FIG. 1 is not provided, and primary color signals R, G, and B output from the ADCs 14R, 14G, and 14B are output from the color interpolation circuit 15 shown in FIG. Instead of the primary color signals R, G, and B, the white balance amplification circuit 16 and the motion amount calculation circuit 30 are supplied.
The motion amount calculation circuit 30 generates a motion amount signal MD based on the primary color signals R, G, and B output from the ADCs 14R, 14G, and 14B.

  In FIG. 6, the portion on the right side of the white balance amplification circuit 16 and the motion amount calculation circuit 30 in FIG. 1 is omitted, but the configuration is the same as that in FIG. 1.

Embodiment 4 FIG.
FIG. 7 is a block diagram showing an imaging apparatus according to Embodiment 4 of the present invention. The image pickup apparatus according to the fourth embodiment is generally the same as the image pickup apparatus according to the first embodiment described with reference to FIG. 1, but is different in that a noise reduction circuit 50 is added. In FIG. 7, in the configuration shown in FIG. 1, the portion on the left side of the color interpolation circuit 15 is not shown.

In FIG. 7, the luminance signal output from the color matrix circuit 18 is indicated by a symbol “Yi”, and the color difference signals are indicated by “R-Yi” and “B-Yi”.
The noise reduction circuit 50 receives the luminance signal Yi and the color difference signals R-Yi and B-Yi, performs noise reduction processing based on the average calculation in the time axis direction using the frame correlation, and performs the luminance signal Y and the color difference signal R-. Y and BY are output. The luminance signal Y is output from the output terminal 21Y, and the color difference signals RY and BY are supplied to the color modulation circuit 19.

  FIG. 8 is a block diagram illustrating a configuration example of a portion 50Y that performs processing on the luminance signal Yi in the noise reduction circuit 50. The noise reduction circuit 50 also includes a portion that performs processing on the color difference signal R-Yi and a portion that performs processing on the color difference signal B-Yi, but these are similar to the portion 50Y that performs processing on the luminance signal Yi. Since it is configured and operates in the same manner, illustration and detailed description are omitted.

The circuit portion 50Y of the noise reduction circuit 50 is constituted by a recursive filter. In FIG. 8, the luminance signal Yi output from the color matrix circuit 18 is input to the input terminal 51.
A synthesis circuit (MIX) 52 synthesizes a luminance signal Yi and a frame delay luminance signal Yd, which will be described later, at a predetermined synthesis ratio set by the synthesis ratio generation circuit 54 to generate a synthesized luminance signal Y. It is also called a signal synthesis circuit, and the synthesis ratio is also called a video signal synthesis ratio generation circuit. The combined luminance signal Y generated by the combining circuit 52 is output from the output terminal 55. Further, the noise reduction circuit 50 is also called a video signal noise reduction circuit.

  The 1-frame delay circuit 53 delays the combined luminance signal Y output from the combining circuit 52 by one frame period, and outputs a frame delayed luminance signal Yd.

  A motion amount signal MD output from the motion amount calculation circuit 30 is input to the input terminal 56. The noise reduction characteristic setting value KCON output from the control circuit 20 is input to the input terminal 57.

Based on the noise reduction characteristic setting value KCON set by the control circuit 20, the synthesis ratio generation circuit 54 performs a noise reduction coefficient K (0 ≦ K ≦ 1) corresponding to the motion amount signal MD output from the motion amount calculation circuit 30. ) Is supplied to the synthesis circuit 52.
The combining circuit 52 combines the luminance signal Yi and the frame delay luminance signal Yd based on the noise reduction coefficient K set by the combining ratio generation circuit 54.
The delay time of the delay circuit 53 is not limited to one frame period, and may be an even multiple of the vertical scanning period.

FIG. 9 is a block configuration diagram illustrating a configuration example of the synthesis circuit 52. In FIG. 9, a luminance signal Yi supplied to the input terminal 51 is input to the input terminal 61. A frame delay luminance signal Yd output from the 1 frame delay circuit 53 is input to the input terminal 62. The noise reduction coefficient K output from the synthesis ratio generation circuit 54 is input to the input terminal 67. The multiplier circuit 63 multiplies the luminance signal Yi by 1-K and outputs (1-K) · Yi. The multiplication circuit 64 multiplies the frame delayed luminance signals Yd and K and outputs K · Yd. The adder circuit 65 adds (1-K) · Yi and K · Yd based on the following expression, and outputs a luminance signal Y.
Y = (1−K) · Yi + K · Yd
The luminance signal Y output from the adder circuit 65 is output via the output terminal 66.

  The noise reduction coefficient K is also called a cyclic coefficient. When the noise reduction coefficient K is increased, the proportion of the frame delay luminance signal Yd increases and the noise reduction effect increases, but the image is blurred in a portion where there is motion. The harmful effect is also increased. When the noise reduction coefficient K is reduced, the proportion of the luminance signal Yi increases, and the noise reduction effect is reduced. However, the adverse effect of blurring the image in a portion where there is motion is reduced.

  The synthesis ratio generation circuit 54 in FIG. 8 generates a noise reduction coefficient K corresponding to the motion amount signal MD for each pixel. A noise reduction coefficient K is generated from the motion amount signal MD based on the noise reduction characteristic setting value KCON. The noise reduction characteristic setting value KCON set by the control circuit 20 includes a maximum value and a minimum value of the noise reduction coefficient K, a moving image determination threshold value, and a still image determination threshold value. The synthesis ratio generation circuit 54 generates a noise reduction coefficient K corresponding to the motion amount signal MD using the noise reduction characteristic setting value KCON set by the control circuit 20 as a parameter. For example, when the motion amount signal MD is larger than the moving image determination threshold (when the amount of motion is determined to be a moving image), the noise reduction coefficient K is set to the minimum value to reduce blur due to motion. When the motion amount signal MD is smaller than the still image determination threshold (when it is determined that the amount of motion is small and still image), the noise reduction coefficient K is set to the maximum value to reduce noise.

  In the present embodiment, since the motion amount signal MD is obtained based on the signal obtained by adding the primary color signals R, G, and B to which the amplification process by the white balance control is not added, it is included in the motion amount signal MD. The noise component is reduced, the erroneous setting of the noise reduction coefficient K due to the influence of the noise component included in the motion amount signal MD is eliminated, there is less blur due to motion, and an image with reduced noise can be obtained. In addition, the synthesis ratio generation circuit 54 can optimally set the noise reduction coefficient K based on a motion amount with less noise, and has an effect of obtaining an image with reduced noise and reduced noise.

Embodiment 5 FIG.
FIG. 10 is a block diagram showing an imaging apparatus according to Embodiment 5 of the present invention. The image pickup apparatus according to the fifth embodiment is generally the same as the image pickup apparatus according to the fourth embodiment described with reference to FIG. 7, but is different in that a peripheral pixel addition circuit 47 is added. In FIG. 10, the left side of the A / D conversion circuit 14 is not shown, but for example, a configuration similar to that shown in FIG. 1 can be used.

The peripheral pixel addition circuit 47 performs peripheral pixel addition based on the color filter array of the solid-state image sensor 11, and outputs primary color signals Rm, Gm, and Bm.
The color addition circuit 31 of the motion amount calculation circuit 30 adds the primary color signals Rm, Gm, and Bm to generate a color addition signal MDi.
The peripheral pixel adding circuit 47 operates in the same manner as described with reference to FIG. 5 with respect to the second embodiment, and provides the same effect, so that the description thereof is omitted.

  Also in this embodiment, since the motion detection is performed using not only one pixel but also a pixel in a neighboring region centered on the target pixel, for example, an average value of peripheral pixels at the same distance centering on the target pixel, There is an effect that motion can be correctly detected even in an extremely dark low-light environment where the S / N is poor. Compared to the case where peripheral pixels in the range of 3 horizontal pixels and 3 vertical pixels are used as the pixels in the vicinity region, peripheral pixels in the range of 5 horizontal pixels, 5 vertical pixels, peripheral pixels in the 7 horizontal and 7 vertical pixels range The S / N of the color addition signal is improved when using. Noise of signals used for motion detection because primary color signals Rm, Gm, and Bm are generated from peripheral pixels centered on a target pixel of a Bayer array signal, and a motion amount is obtained based on a signal obtained by adding the primary color signals Rm, Gm, and Bm. There is an effect that the components can be reduced and the motion can be correctly detected even in an extremely dark low light environment where the S / N is poor. The movement threshold TH can be set small, and there is an effect that even a minute movement can be detected.

  In the present embodiment, not only one pixel but also a pixel in the vicinity region centered on the target pixel, for example, a peripheral pixel average value at the same distance centered on the target pixel is used to determine the amount of motion. Therefore, the noise component included in the motion amount signal MD is reduced, the erroneous setting of the noise reduction coefficient K due to the influence of the noise component included in the motion amount signal MD is eliminated, the blur due to motion is small, and the noise-reduced image is obtained. There is an effect to be obtained.

Embodiment 6 FIG.
FIG. 11 is a block diagram showing an imaging apparatus according to Embodiment 6 of the present invention. The image pickup apparatus according to the sixth embodiment is generally the same as the image pickup apparatus according to the first embodiment described with reference to FIG. 1 except that a pixel addition circuit 70 is added. In FIG. 11, in the configuration shown in FIG. 1, the illustration of the portion on the left side of the color interpolation circuit 15 is omitted.

In FIG. 11, as in FIG. 7, the luminance signal output from the color matrix circuit 18 is indicated by a symbol “Yi”, and the color difference signals are indicated by “R−Yi” and “B−Yi”.
The pixel addition circuit 70 receives the luminance signal Yi and the color difference signals R-Yi and B-Yi, and performs high-sensitivity processing by pixel addition in the time axis direction using the frame correlation, so that the luminance signal Y and the color difference signal R- Y and the color difference signal BY are output. The luminance signal Y is output from the output terminal 21Y, and the color difference signal RY and the color difference signal BY are supplied to the color modulation circuit 19.

  FIG. 12 is a block diagram illustrating a configuration example of a portion 70Y that performs processing on the luminance signal Yi in the pixel addition circuit 70. The pixel addition circuit 70 also includes a portion that performs processing for the color difference signal R-Yi and a portion that performs processing for the color difference signal B-Yi, which are similar to the portion 70Y that performs processing for the luminance signal Yi. Since it is configured and operates in the same manner, illustration and detailed description are omitted.

In FIG. 12, the luminance signal Yi output from the color matrix circuit 18 is input to the input terminal 71.
The one-field delay circuit 72 delays the luminance signal Yi input from the input terminal 71 by one field period and outputs a field delayed luminance signal Yj.
The one-field delay circuit 73 delays the field delay luminance signal Yj by one field period and outputs a frame delay luminance signal Yk.
The in-plane pixel addition circuit 74 performs in-plane pixel addition within the same field of the field delayed luminance signal Yj and outputs an in-plane pixel addition signal Yv.
The inter-plane pixel addition circuit 75 performs inter-plane pixel addition between the fields of the luminance signal Yi, the field delayed luminance signal Yj, and the frame delayed luminance signal Yk, and outputs an inter-plane pixel addition signal Yf.
A motion amount signal MD output from the motion amount calculation circuit 30 is input to the input terminal 79.
The composition ratio generation circuit (KG) 77 determines a composition ratio based on the motion amount signal MD supplied via the input terminal 79.
The synthesis circuit (MIX circuit) 76 synthesizes the in-plane pixel addition signal Yv and the inter-plane pixel addition signal Yf at a predetermined synthesis ratio determined by the synthesis ratio generation circuit 77 to generate a synthesized luminance signal Y. Yes, it is also called a video signal synthesis circuit, and the synthesis ratio generation circuit 77 is also called a video signal synthesis ratio generation circuit. Further, the pixel addition circuit 70 is also called a video signal pixel addition circuit.
The combined luminance signal Y generated by the combining circuit 76 is output from the output terminal 78.
Note that the delay time of the delay circuits 72 and 73 is not limited to one field period, and may be an integer multiple of the vertical scanning period (including 1 time).

  For example, by controlling so that the in-plane pixel addition signal Yv occupies a large proportion when the motion amount signal MD is large and the inter-plane pixel addition signal Yf occupies a large proportion when the motion amount signal MD is small, blur due to motion is suppressed. Increase sensitivity while reducing. Even in a very low-light environment, sufficient signal amplitude can be secured while reducing blur due to movement, and the visibility of the subject is improved.

A spatial positional relationship of signals added by the in-plane pixel addition circuit 74 will be described with reference to FIG. FIG. 13 is a pixel arrangement diagram of a video signal of an interlaced scanning method with a vertical axis in the vertical direction and a horizontal axis in the horizontal direction. The line 1 to the middle of the line 263 corresponds to the A field scanning line, and the middle of the line 263 to the line 525 corresponds to the B field scanning line. A solid line represents the A field scanning line, and a broken line represents the B field scanning line. The in-plane pixel addition circuit 74 is a pixel in the vicinity of the target pixel P22 in the same field with respect to the target pixel P22, for example, pixels T22, B22, and L22 located on the upper, lower, left, and right sides of the same field. , R22 is added to generate the in-plane pixel addition signal Yv. The in-plane pixel addition signal Yv is calculated by the following equation.
Yv = P22 + T22 + B22 + L22 + R22

The spatial positional relationship of signals added by the inter-plane pixel addition circuit 75 will be described with reference to FIG. FIG. 14 is a pixel arrangement diagram of a video signal of an interlaced scanning method with a vertical axis in the vertical direction and a time axis in the horizontal direction. The A field of the first frame is represented as 1A, the B field of the first frame is 1B, the A field of the second frame is 2A, the B field of the second frame is 2B, and the A field of the third frame is 3A. The A field screen is indicated by a solid line, and the B field screen is indicated by a broken line. In the figure, the field period is 1/60 seconds and the frame period is 1/30 seconds. The inter-plane pixel addition circuit 75 is located in the adjacent field with respect to the target pixel P22 in the adjacent region centered on the target pixel, for example, the pixel adjacent in the vertical direction, that is, the closest pixel. The inter-pixel addition signal Yf is generated by adding the pixel values of the pixels P11, P13, P31, and P33. The inter-plane pixel addition signal Yf is calculated by the following equation.
Yf = P22 + P11 + P13 + P31 + P33

  Further, the spatial positional relationship of signals added by the inter-plane pixel addition circuit 75 will be described with reference to FIG. The inter-plane pixel addition circuit 75 adds the pixel values of the pixels P11, P13, P31, and P33 that are adjacent to the target pixel P22 in the vertical direction of the adjacent field, that is, the nearest pixels P11, P13, P31, and P33. Yf is generated. In the space having the vertical axis in FIG. 13 and the horizontal axis in FIG. 13, the pixels P11 and P31, and the pixels P13 and P33 appear to overlap.

Even in the present embodiment, since the movement amount is obtained based on the signal obtained by adding the primary color signals R, G, and B to which the amplification process by the white balance control is not added,
The noise component included in the motion amount signal MD is reduced, and there is no malfunction in the synthesis processing of the in-plane pixel addition signal Yv and the inter-plane pixel addition signal Yf due to the influence of the noise component included in the motion amount signal MD, and blur due to motion is eliminated. Sufficient signal amplitude can be secured while reducing, and the visibility of the subject is improved.
Further, since the synthesis ratio generation circuit 77 optimally sets the synthesis ratio in the synthesis circuit 76 based on the motion amount signal MD with less noise, a sufficient signal amplitude can be ensured while reducing blur due to motion, and the subject. This has the effect of improving the visibility.

  In the above example, the operation of the in-plane pixel addition 74 is the addition of pixels in one field, and the operation of the inter-plane pixel addition circuit 75 is the addition of pixels between fields. You may comprise so that the addition of the pixel between frames may be performed. In that case, the same operation is performed and the same effect can be obtained.

Embodiment 7 FIG.
FIG. 15 is a block diagram showing an imaging apparatus according to Embodiment 7 of the present invention. The image pickup apparatus according to the seventh embodiment is generally the same as the image pickup apparatus according to the sixth embodiment described with reference to FIG. 11 except that a peripheral pixel addition circuit 47 is added. In FIG. 15, the portion on the left side of the A / D conversion circuit 14 is not shown, but for example, a configuration similar to that shown in FIG. 1 can be used.

The peripheral pixel addition circuit 47 performs peripheral pixel addition based on the color filter array of the solid-state image sensor 11, and outputs primary color signals Rm, Gm, and Bm.
The color addition circuit 31 of the motion amount calculation circuit 30 adds the primary color signals Rm, Gm, and Bm to generate a color addition signal MDi.
The peripheral pixel adding circuit 47 operates in the same manner as described with reference to FIG. 5 with respect to the second embodiment, and provides the same effect, so that the description thereof is omitted.

  In this embodiment, since the motion detection is performed using not only one pixel but also a pixel in a neighboring region centered on the target pixel, for example, an average value of peripheral pixels at the same distance centering on the target pixel, There is an effect that motion can be correctly detected even in an extremely dark low-light environment where the S / N is poor. Compared to the case where peripheral pixels in the range of 3 horizontal pixels and 3 vertical pixels are used as the pixels in the vicinity region, peripheral pixels in the range of 5 horizontal pixels, 5 vertical pixels, peripheral pixels in the 7 horizontal and 7 vertical pixels range The S / N of the color addition signal is improved when using. Noise of signals used for motion detection because primary color signals Rm, Gm, and Bm are generated from peripheral pixels centered on a target pixel of a Bayer array signal, and a motion amount is obtained based on a signal obtained by adding the primary color signals Rm, Gm, and Bm. There is an effect that the components can be reduced and the motion can be correctly detected even in an extremely dark low light environment where the S / N is poor. The movement threshold TH can be set small, and there is an effect that even a minute movement can be detected.

In addition, since not only one pixel but also a pixel in a neighboring area centered on the target pixel, for example, a peripheral pixel average value at the same distance centered on the target pixel, the amount of motion is obtained.
The noise component included in the motion amount signal MD is reduced, and there is no malfunction in the synthesis processing of the in-plane pixel addition signal Yv and the inter-plane pixel addition signal Yf due to the influence of the noise component included in the motion amount signal MD, and blur due to motion is eliminated. Sufficient signal amplitude can be secured while reducing, and the visibility of the subject is improved.

Embodiment 8 FIG.
FIG. 16 is a block diagram showing an imaging apparatus according to Embodiment 8 of the present invention. The image pickup apparatus according to the eighth embodiment is generally the same as the image pickup apparatus according to the first embodiment described with reference to FIG. 1, but differs in that noise reduction circuits 90R, 90G, and 90B are added. In FIG. 16, in the configuration shown in FIG. 1, the portion on the left side of the color interpolation circuit 15 and the portion on the right side of the white balance amplifier circuit 16 and the motion amount calculation circuit 30 are not shown.

  Each of the noise reduction circuits 90R, 90G, and 90B has the same configuration as the noise reduction circuit 50Y described with reference to FIGS. That is, the noise reduction circuit 90R includes a synthesis circuit (MIX) 92R, a one frame period delay circuit (FDL) 93R, and a synthesis ratio generation circuit (KG) 94R. The noise reduction circuit 90G includes a synthesis circuit 92G, a one-frame period delay circuit 93G, and a synthesis ratio generation circuit 94G. The noise reduction circuit 90B includes a synthesis circuit 92B, a 1 frame period delay circuit 93B, and a synthesis ratio generation circuit 94B.

  The synthesis circuit 92R synthesizes the primary color signal R and the frame delay primary color signal Rd output from the color interpolation circuit 15 at a predetermined synthesis ratio set by the synthesis ratio generation circuit 94R to generate a synthesis primary color signal Rn. The combined primary color signal Rn generated by the combining circuit 92R is supplied to the R signal amplifying circuit 16R. The 1-frame delay circuit 93R delays the primary color signal Rn output from the synthesis circuit 92R by one frame period and outputs a frame-delayed primary color signal Rd. The synthesis ratio generation circuit 94R obtains a noise reduction coefficient K corresponding to the motion amount signal MD output from the motion amount calculation circuit 30 based on the noise reduction characteristic setting value KCON set by the control circuit 20, and combines the circuit 92R. To supply. The combining circuit 92R combines the primary color signal R and the frame delay primary color signal Rd based on the noise reduction coefficient K set by the combining ratio generation circuit 94R.

  Detailed operations of the combining circuit 92R, the one-frame delay circuit 93R, and the combining ratio generation circuit 94R are the same as those of the fourth embodiment described above with reference to FIG. 8, the combining circuit 52, the one-frame delay circuit 53, and the combining ratio generation circuit. This is the same as the operation 54, and detailed description thereof is omitted.

  The combining circuit 92G combines the primary color signal G output from the color interpolation circuit 15 and the frame delay primary color signal Gd at a predetermined combining ratio set by the combining ratio generating circuit 94G to generate a combined primary color signal Gn. The combined primary color signal Gn generated by the combining circuit 92G is supplied to the signal level detection circuit 17 and the color matrix circuit 18. The 1-frame delay circuit 93G delays the primary color signal Gn output from the synthesizing circuit 92G by 1 frame period and outputs a frame-delayed primary color signal Gd. The synthesis ratio generation circuit 94G obtains a noise reduction coefficient K corresponding to the motion amount signal MD output from the motion amount calculation circuit 30 based on the noise reduction characteristic setting value KCON set by the control circuit 20, and combines the circuit 92G. To supply. The combining circuit 92G combines the primary color signal G and the frame delay primary color signal Gd based on the noise reduction coefficient K set by the combining ratio generation circuit 94G.

  Detailed operations of the combining circuit 92G, the one-frame delay circuit 93G, and the combining ratio generation circuit 94G are the same as those of the combining circuit 52, the one-frame delay circuit 53, and the combining ratio generation circuit 54 described with reference to FIG. The detailed operation will be omitted.

  The synthesis circuit 92B synthesizes the primary color signal B and the frame delay primary color signal Bd output from the color interpolation circuit 15 at a predetermined synthesis ratio set by the synthesis ratio generation circuit 94B to generate a synthesis primary color signal Bn. The combined primary color signal Bn generated by the combining circuit 92B is supplied to the B signal amplification circuit 16B. The 1-frame delay circuit 93B delays the primary color signal Bn output from the synthesis circuit 92B by one frame period and outputs a frame delay primary color signal Bd. The synthesis ratio generation circuit 94B obtains the noise reduction coefficient K corresponding to the motion amount signal MD output from the motion amount calculation circuit 30 based on the noise reduction characteristic setting value KCON set by the control circuit 20, and combines the circuit 92B. To supply. The combining circuit 92B combines the primary color signal B and the frame delayed primary color signal Bd based on the noise reduction coefficient K set by the combining ratio generation circuit 94B.

  Detailed operations of the combining circuit 92B, the one-frame delay circuit 93B, and the combining ratio generation circuit 94B are the same as those of the combining circuit 52, the one-frame delay circuit 53, and the combining ratio generation circuit 54 described with reference to FIG. The detailed operation will be omitted.

  The combining circuits 92R, 92G, and 92B are the same as the combining circuit (video signal combining circuit) 52, but are also called imaging signal combining circuits for distinction. The combining ratio generation circuits 94R, 94G, and 94B Although it is similar to the generation circuit (video signal synthesis ratio generation circuit) 54, it is also called an imaging signal synthesis ratio generation circuit for distinction. Furthermore, the noise reduction circuits 90R, 90G, and 90B are also referred to as imaging signal noise reduction circuits for distinction from the noise reduction circuit 50.

  Note that the delay time of the delay circuits 93R, 93G, and 93B is not limited to one frame period, and may be an even multiple of the vertical scanning period.

The color addition circuit 31 of the motion amount calculation circuit 30 adds the primary color signals R, G, and B for each pixel as shown in the following formula to generate a color addition signal MDi.
MDi = R + G + B

The color addition circuit 39 adds the frame delay primary color signals Rd, Gd, and Bd for each pixel as shown in the following formula to generate a color addition signal MDd.
MDd = Rd + Gd + Bd

The difference absolute value calculation circuit 33 calculates the absolute value of the difference between the signal MDi and the signal MDd and outputs it as a motion amount signal MD indicating the motion amount for each pixel.
The motion amount signal MD is supplied to the determination circuit 42 and the synthesis ratio generation circuits 94R, 94G, and 94B.

  In the present embodiment, in order to obtain the inter-frame difference of the color addition signal MDi obtained by adding a plurality of color components by the motion amount calculation circuit 30, a plurality of frames delayed by one frame generated by the noise reduction circuits 90R, 90G, and 90B are obtained. Since the color components (Rd, Gd, Bd) are added to generate the color addition signal MDd delayed by one frame, the memory circuit for delaying one frame can be shared with the noise reduction circuit, and motion detection Therefore, the memory circuit can be reduced, and the component cost, circuit mounting area and power consumption can be reduced. In addition, since the plurality of color components output from the noise reduction circuits 90R, 90G, and 90B are added to generate the color addition signal MDd delayed by one frame, the noise component of the signal used for motion detection is further increased. There is an effect that motion can be correctly detected even in an extremely dark low-light environment where the S / N is poor.

Embodiment 9 FIG.
FIG. 17 is a block diagram showing an imaging apparatus according to Embodiment 9 of the present invention. The image pickup apparatus according to the ninth embodiment is generally the same as the image pickup apparatus according to the first embodiment described with reference to FIG. 1 except that pixel addition circuits 100R, 100G, and 100B are added. In FIG. 17, in the configuration shown in FIG. 1, the portion on the left side of the color interpolation circuit 15 and the portion on the right side of the white balance amplification circuit 16 and the motion amount calculation circuit 30 are not shown.

  Each of the pixel addition circuits 100R, 100G, and 100B has the same configuration as the pixel addition circuit 70Y described with reference to FIG. That is, the pixel addition circuit 100R includes one-field delay circuits (VDL) 102R and 103R, an in-plane pixel addition circuit (VADD) 104R, an inter-plane pixel addition circuit (FADD) 105R, a synthesis circuit (MIX) 106R, And a synthesis ratio generation circuit (KG) 107R. The pixel addition circuit 100G includes one-field delay circuits 102G and 103G, an in-plane pixel addition circuit 104G, an inter-plane pixel addition circuit 105G, a synthesis circuit 106G, and a synthesis ratio generation circuit 107G. The pixel addition circuit 100B includes 1-field delay circuits 102B and 103B, an in-plane pixel addition circuit 104B, an inter-plane pixel addition circuit 105B, a synthesis circuit 106B, and a synthesis ratio generation circuit 107B.

  The one-field delay circuit 102R delays the primary color signal R output from the color interpolation circuit 15 by one field period and outputs a field-delayed primary color signal Rj. The 1-field delay circuit 15 delays the field delay primary color signal Rj by one field period and outputs a frame delay primary color signal Rk. The in-plane pixel addition circuit 104R performs in-plane pixel addition within the same field of the field delayed primary color signal Rj and outputs an in-plane pixel addition signal Rv. The inter-plane pixel addition circuit 105R performs inter-plane pixel addition between fields of the primary color signal R, the field delay primary color signal Rj, and the frame delay primary color signal Rk, and outputs an inter-plane pixel addition signal Rf. The synthesizing circuit 106R synthesizes the in-plane pixel addition signal Rv and the inter-plane pixel addition signal Rf with a predetermined synthesis ratio determined by the synthesis ratio generation circuit 107R. The primary color signal Ra generated by synthesizing the in-plane pixel addition signal Rv and the inter-plane pixel addition signal Rf by the synthesis circuit 106R is supplied to the R signal amplification circuit 16R.

  Detailed operations of the one-field delay circuits 102R and 103R, the in-plane pixel addition circuit 104R, the inter-plane pixel addition circuit 105R, the synthesis circuit 106R, and the synthesis ratio generation circuit 107R will be described with reference to FIG. The operations of the one-field delay circuit 72, the one-field delay circuit 73, the in-plane pixel adding circuit 74, the inter-plane pixel adding circuit 75, the synthesizing circuit 76, and the synthesizing ratio generating circuit 77 are the same, and detailed description thereof is omitted.

  The 1-field delay circuit 102G delays the primary color signal G output from the color interpolation circuit 15 by one field period and outputs a field-delayed primary color signal Gj. The 1-field delay circuit 25 delays the field delay primary color signal Gj by one field period and outputs a frame delay primary color signal Gk. The in-plane pixel addition circuit 104G performs in-plane pixel addition within the same field of the field delayed primary color signal Gj and outputs an in-plane pixel addition signal Gv. The inter-plane pixel addition circuit 105G performs inter-plane pixel addition between fields of the primary color signal G, the field delay primary color signal Gj, and the frame delay primary color signal Gk, and outputs an inter-plane pixel addition signal Gf. The synthesis circuit 106G synthesizes the in-plane pixel addition signal Gv and the inter-plane pixel addition signal Gf at a predetermined synthesis ratio determined by the synthesis ratio generation circuit 107G. The primary color signal Ga generated by synthesizing the in-plane pixel addition signal Gv and the inter-plane pixel addition signal Gf by the synthesis circuit 106G is supplied to the signal level detection circuit 17 and the color matrix circuit 18.

  Detailed operations of the 1-field delay circuits 102G and 103G, the in-plane pixel addition circuit 104G, the inter-plane pixel addition circuit 105G, the synthesis circuit 106G, and the synthesis ratio generation circuit 107G will be described with reference to FIG. The operations of the one-field delay circuit 72, the one-field delay circuit 73, the in-plane pixel adding circuit 74, the inter-plane pixel adding circuit 75, the synthesizing circuit 76, and the synthesizing ratio generating circuit 77 are the same, and detailed description thereof is omitted.

  The 1-field delay circuit 102B delays the primary color signal B output from the color interpolation circuit 15 by 1 field period and outputs a field-delayed primary color signal Bj. The 1-field delay circuit 35 delays the field delay primary color signal Bj by one field period and outputs a frame delay primary color signal Bk. The in-plane pixel addition circuit 104B performs in-plane pixel addition within the same field of the field delayed primary color signal Bj and outputs an in-plane pixel addition signal Bv. The inter-plane pixel addition circuit 105B performs inter-plane pixel addition between fields of the primary color signal B, the field delay primary color signal Bj, and the frame delay primary color signal Bk, and outputs an inter-plane pixel addition signal Bf. The synthesizing circuit 106B synthesizes the in-plane pixel addition signal Bv and the inter-plane pixel addition signal Bf with a predetermined synthesis ratio determined by the synthesis ratio generation circuit 107B. The primary color signal Ba generated by synthesizing the in-plane pixel addition signal Bv and the inter-plane pixel addition signal Bf by the synthesis circuit 106B is supplied to the B signal amplification circuit 16B.

  Detailed operations of the 1-field delay circuits 102B and 103B, the in-plane pixel addition circuit 104B, the inter-plane pixel addition circuit 105B, the synthesis circuit 106B, and the synthesis ratio generation circuit 107B will be described with reference to FIG. The operations of the one-field delay circuit 72, the one-field delay circuit 73, the in-plane pixel adding circuit 74, the inter-plane pixel adding circuit 75, the synthesizing circuit 76, and the synthesizing ratio generating circuit 77 are the same, and detailed description thereof is omitted.

  The synthesizing circuits 106R, 106G, and 106B are similar to the synthesizing circuit (video signal synthesizing circuit) 76, but are also called imaging signal synthesizing circuits for distinction. The synthesizing ratio generating circuits 107R, 107G, and 107B Although it is the same as the generation circuit (video signal synthesis ratio generation circuit) 77, it is also called an imaging signal synthesis ratio generation circuit for distinction. Further, the pixel addition circuits 100R, 100G, and 100B are also referred to as imaging signal pixel addition circuits for distinction from the pixel addition circuit 70.

  Note that the delay time of the delay circuits 102R, 103R, 102G, 103G, 102B, and 103B is not limited to one field period, but may be an integer multiple of the vertical scanning period (including 1 time).

The color addition circuit 31 of the motion amount calculation circuit 30 adds the primary color signals R, G, and B for each pixel as shown in the following formula to generate a color addition signal MDi.
MDi = R + G + B

The color addition circuit 39 adds the frame delay primary color signal Rk, the frame delay primary color signal Gk, and the frame delay primary color signal Bk for each pixel as shown in the following formula to generate a color addition signal MDd.
MDd = Rk + Gk + Bk

  The difference absolute value calculation circuit 33 outputs the absolute value of the value obtained by subtracting the signal MDd from the signal MDi as the motion amount signal MD indicating the motion amount for each pixel. The motion amount signal MD is supplied to the determination circuit 42 and the composition ratio generation circuits 107R, 107G, and 107B.

  The synthesis ratio generation circuits 107R, 107G, and 107B determine the synthesis ratios in the synthesis circuits 106R, 106G, and 106B, respectively, based on the motion amount signal MD.

  In the present embodiment, in order to obtain the inter-frame difference of the color addition signal MDi obtained by adding a plurality of color components by the motion amount calculation circuit 30, a plurality of frames delayed by one frame generated by the pixel addition circuits 100R, 100G, and 100B are obtained. Since the color components (Rk, Gk and Bk) are added to generate the color addition signal MDd delayed by one frame, the memory circuit for delaying one frame is shared with the pixel addition circuits 100R, 100G and 100B. It is possible to reduce the memory circuit for motion detection and to reduce the component cost, circuit mounting area and power consumption.

  In each of the above embodiments, the noise reduction circuit using frame correlation has been described. However, a noise reduction circuit using field correlation may be used. In the noise reduction circuit using the frame correlation, the delay circuit is a frame memory. In the noise reduction circuit using the field correlation, the delay circuit is a field memory. If the signal processing is improved by controlling the inter-frame or inter-field signal processing in which the image of the moving portion is blurred by controlling according to the motion detection result, the same operation and the same effect can be obtained.

  When the noise reduction circuit uses field correlation, a delay circuit having a delay time of one field period (more generally, an integral multiple of the vertical scanning period (including 1 time)) is used. .

  In each of the above embodiments, the case of using a motion amount calculation circuit that detects motion in units of pixels has been described, but FIG. 5 (Embodiment 2), FIG. 10 (Embodiment 5), and FIG. As in the example shown in 7), surrounding pixels may be added to the target pixel to further reduce the influence of noise. By adding peripheral pixels in accordance with the signal S / N, the same operation is performed and a better effect can be obtained.

  In each of the above embodiments, the description has been made based on one configuration example of the solid-state imaging device. However, any two-dimensional image sensor capable of capturing a moving image is actually a solid-state imaging device or a CMOS image sensor. But it ’s okay. Moreover, not only an interline transfer solid-state image sensor but also a frame transfer solid-state image sensor or a frame interline transfer solid-state image sensor may be used.

  In each of the above embodiments, for the sake of convenience of explanation, a system that controls white balance with primary color signals R, G, and B has been described as an example. However, a luminance signal, an RY color difference signal, and a BY color difference signal may be used. The operation is the same as in the case of the primary color signals R, G and B, and the same effect is obtained.

  In each of the above embodiments, for the sake of convenience of explanation, a plurality of color components have been described by taking an example of an imaging unit having an R (Red) component, a G (Green) component, and a B (Blue) component. However, a Ye (Yellow) component and Cy An image sensor having a (Cyan) component, an Mg (Magenta) component, and a G (Green) component may be used, and the same operation is performed and the same effect is obtained. Further, when reading out by the two-row mixed readout method from the image sensor in which the color filters that transmit the color components are arranged in a checkered pattern, the color components of Cy + G component, Ye + Mg component, Cy + Mg component, and Ye + G component may be used. The same effect can be obtained.

  In each of the above embodiments, for the sake of convenience of explanation, an imaging apparatus compatible with NTSC television has been described as an example. However, the display apparatus is not limited to interlaced scanning, and may be a non-interlaced display format. It operates in the same way as in the case of interlace and the same effect is obtained.

The features of the embodiments described above can be used in combination with each other.
For example, as described with reference to FIG. 16 regarding the eighth embodiment, after providing the noise reduction devices 90R, 90G, and 90B, refer to FIG. 7 regarding the fourth embodiment on the output side of the white balance amplifier circuit. As described above, the noise reduction circuit 50 may be provided, or the pixel addition circuit 70 may be provided as described with reference to FIG. 11 with respect to the sixth embodiment. As described with reference to FIG. 17, the pixel addition circuits 100R, 100G, and 100B are provided, and further, as described with reference to FIG. The reduction circuit 50 may be provided, or the pixel addition circuit 70 may be provided as described with reference to FIG. 11 regarding the sixth embodiment.

  Further, the peripheral addition circuit 47 shown in FIG. 5 (Embodiment 2), FIG. 10 (Embodiment 5) and FIG. 15 (Embodiment 7) is replaced with FIG. 6 (Embodiment 3), FIG. (Embodiment 4), FIG. 11 (Embodiment 6), FIG. 16 (Embodiment 8), and FIG. 17 (Embodiment 9) may be incorporated.

  DESCRIPTION OF SYMBOLS 10 Imaging signal production | generation means 11, 11R, 11G, 11B Solid-state image sensor, 12, 12R, 12G, 12B Correlated double sampling processing circuit (CDS circuit), 13, 13R, 13G, 13B Programmable gain amplifier circuit (PGA), 14, 14R, 14G, 14B A / D conversion circuit (ADC), 15 color interpolation circuit, 16 white balance amplification circuit, 16R R signal amplification circuit, 16B B signal amplification circuit, 17 signal level detection circuit, 18 color matrix circuit, 19 color modulation circuit, 20 control circuit, 21M output terminal, 21Y output terminal, 21C output terminal, 22R, 22G, 22B 1 frame delay circuit, 30 motion amount calculation circuit, 31 color addition circuit, 32 1 frame delay circuit, 33 difference Absolute value calculation circuit, 34 Subtraction circuit, 35 Absolute value circuit, 36R, 36G, 36B input terminal, 37 output terminal, 38R, 38G, 38B input terminal, 39 color addition circuit, 41 motion threshold value generation circuit, 42 determination circuit, 43 synchronization signal generation circuit, 44 timing generation circuit, 45 drive circuit, 47 peripheral pixel addition circuit, 48 lens, 49 prism, 50 noise reduction circuit, 51 input terminal, 52 synthesis circuit, 53 1 frame delay circuit, 54 synthesis ratio generation circuit, 55 output terminal, 56 input terminal, 57 Input terminal 61 Input terminal 62 Input terminal 63 Multiplier circuit 64 Multiplier circuit 65 Adder circuit 66 Output terminal 67 Input terminal 70 Pixel adder circuit 71 Input terminal 72 One field delay circuit 73 One field delay Circuit, 74 in-plane painting Element addition circuit, 75 inter-pixel addition circuit, 76 composition circuit, 77 composition ratio generation circuit, 78 output terminal, 79 input terminal, 90R, 90G, 90B noise reduction circuit, 92R, 92G, 92B composition circuit, 93R, 93G, 93B 1 frame delay circuit, 94R, 94G, 94B synthesis ratio generation circuit, 100R, 100G, 100B pixel addition circuit, 102R, 102G, 102B 1 field delay circuit, 103R, 103G, 103B 1 field delay circuit, 104R, 104G, 104B In-plane pixel addition circuit, 105R, 105G, 105B Inter-plane pixel addition circuit, 106R, 106G, 106B synthesis circuit, 107R, 107G, 107B synthesis ratio generation circuit.

Claims (13)

An imaging signal generation unit that includes an imaging unit that images a subject, and that generates an imaging signal of a plurality of color components obtained as a result of imaging by the imaging unit;
A white balance amplifying circuit for amplifying the signals of a plurality of color components output from the imaging signal generating means for white balance;
Control means for controlling the amplification factor for each color component of the white balance amplifier circuit so as to achieve white balance;
Video signal generating means for generating a video signal from a plurality of color component signals output from the white balance amplifier circuit;
A signal of a plurality of color components obtained as a result of imaging by the imaging means, which has not been amplified by the white balance amplifier circuit, is input, and the sum of the input signals of the plurality of color components is a color addition signal An image pickup apparatus comprising: a first color adding unit that generates a movement amount calculating circuit that detects a movement of a subject based on the color addition signal. The motion amount calculation circuit is
A difference absolute value calculating means for calculating an absolute value of a difference between different screens of the color addition signal;
The imaging apparatus according to claim 1, wherein the movement of the subject is detected based on an absolute value of a difference between the screens. The motion amount calculation circuit is
Delay means for delaying the color addition signal for an integer multiple of the vertical scanning period and outputting a delayed color addition signal;
The imaging apparatus according to claim 2, wherein the difference absolute value calculation unit calculates an absolute value of a difference between the color addition signal and the delayed color addition signal. A delay unit that delays the signals of the plurality of color components input to the motion amount calculation circuit by an integer multiple of a vertical scanning period;
The motion amount calculation circuit is
A second color addition unit that generates a delayed color addition signal by adding the delayed plurality of color component signals output from the delay unit;
The difference absolute value calculation means is:
The imaging apparatus according to claim 2, wherein an absolute difference between the color addition signal output from the first color addition unit and the delayed color addition signal output from the second color addition unit is obtained. The imaging signal generation means includes
A lens that forms an image of a subject on the imaging means;
A programmable gain amplifying circuit for amplifying a signal output from the imaging means with a variable gain;
A level detection circuit that receives the signal of the color component amplified by the white balance amplifier circuit and integrates or averages a plurality of pixels in the entire screen or a specific portion to obtain the signal level of the color component. Further comprising
The control means is
Based on the signal level of the color component obtained by the level detection means,
While setting the aperture of the lens, the exposure time of the imaging means, and the amplification gain of the programmable gain amplification circuit, obtain the illuminance of the subject,
Furthermore, a noise level is generated from the obtained illuminance and the set lens aperture, exposure time and amplification gain value,
Threshold generation means for generating the motion threshold based on the generated noise level;
5. The determination unit according to claim 2, further comprising: a determination unit that detects that there is a movement when the difference absolute value signal output from the difference absolute value calculation unit is larger than a predetermined movement threshold value. Imaging device. The imaging unit outputs only one color component for each pixel, and the signal output from the imaging unit is a component in which other color components are missing,
The imaging signal generating means further comprises color interpolation means for interpolating the missing color component for each pixel of the color imaging means from the signal of the same color component of pixels around the pixel,
The motion amount calculation circuit outputs a color component signal output from the color interpolation means.
6. The signal according to claim 1, wherein the signal is a signal of a plurality of color components obtained as a result of imaging by the imaging unit, and is not amplified by the white balance amplifier circuit. Imaging device. Among the signals output from the imaging means, the sum of signals having the same color components as the pixels of a plurality of pixels in the vicinity region centered on each pixel is output as a peripheral pixel addition signal for each pixel. It further has peripheral pixel addition means,
The motion amount calculation circuit is a signal of a plurality of color components obtained as a result of imaging by the imaging unit, and is amplified by the white balance amplification circuit. The imaging apparatus according to claim 1, wherein the imaging apparatus is used as a signal that is not used. An imaging signal generation unit that includes an imaging unit that images a subject, and that generates an imaging signal of a plurality of color components obtained as a result of imaging by the imaging unit;
An imaging signal noise reduction circuit that outputs an imaging signal in which noise included in the imaging signal output from the imaging signal generation means is suppressed;
A white balance amplifying circuit for amplifying the noise-reduced imaging signal for white balance;
Control means for controlling the amplification factor for each color component of the white balance amplifier circuit so as to achieve white balance;
Video signal generating means for generating a video signal from a plurality of color component signals output from the white balance amplifier circuit;
A movement amount calculation circuit for detecting the movement of the subject based on the imaging signal,
The imaging signal noise reduction circuit is
Delay means for delaying the noise-reduced imaging signal for an integer multiple of a vertical scanning period and outputting the delayed imaging signal;
An imaging signal synthesis circuit that synthesizes the imaging signal and the delayed imaging signal at a predetermined synthesis ratio and outputs a noise-reduced imaging signal in which noise is suppressed;
An imaging signal synthesis ratio generation circuit that determines the synthesis ratio of the imaging signal synthesis circuit based on a motion quantity signal representing the amount of motion detected by the motion quantity calculation circuit;
The motion amount calculation circuit is
First color adding means for adding a plurality of color component signals of an image pickup signal input to the image pickup signal combining circuit to generate a color addition signal;
Second addition means for generating a delayed color addition signal by adding a plurality of color component signals output from the delay means;
A difference absolute value calculating means for calculating an absolute value of a difference between the color addition signal and the delayed color addition signal;
The imaging signal synthesis ratio generation circuit uses a signal representing the absolute value of the difference detected by the difference absolute value calculation means of the motion amount calculation circuit as a motion amount signal representing the amount of motion, and based on the signal, An image pickup apparatus that generates the above-described combination ratio in an image pickup signal combining circuit. An imaging signal generation unit that includes an imaging unit that images a subject, and that generates an imaging signal of a plurality of color components obtained as a result of imaging by the imaging unit;
An imaging signal pixel addition circuit that generates an added imaging signal using an imaging signal output from the imaging signal generation unit as an input;
A white balance amplifying circuit for amplifying the first addition imaging signal for white balance;
Control means for controlling the amplification factor for each color component of the white balance amplifier circuit so as to achieve white balance;
Video signal generating means for generating a video signal from a plurality of color component signals output from the white balance amplifier circuit;
A movement amount calculation circuit for detecting the movement of the subject based on the imaging signal,
The imaging signal pixel adding circuit is
First delay means for outputting a first delayed imaging signal by delaying imaging signals of a plurality of color components obtained as a result of imaging by the color imaging means for an integer multiple of a vertical scanning period;
Second delay means for outputting the second delayed imaging signal by delaying the first delayed imaging signal by an integral multiple of the vertical scanning period;
In-plane pixel addition means for adding a signal of a pixel located in a region near the pixel of interest in the same field as the pixel of interest to the signal of the pixel of interest of the delayed imaging signal;
The imaging signal, the first delayed imaging signal, and the second delayed imaging signal are input, and the signal of the target pixel of the first delayed imaging signal is included in the field to which the first delayed imaging signal belongs. In an adjacent field, an inter-plane pixel addition means for adding signals of pixels located in a neighboring region centered on the pixel of interest;
An imaging signal combining circuit that combines a signal output from the in-plane pixel addition unit and a signal output from the inter-plane pixel addition unit;
An imaging signal synthesis ratio generation circuit that generates a synthesis ratio in the imaging signal synthesis circuit based on a motion amount signal representing the amount of motion detected by the motion amount calculation circuit;
With
The motion amount calculation circuit is
First color addition means for outputting a sum of a plurality of color component signals of the imaging signal as a color addition signal;
Second addition means for outputting a sum of a plurality of color component signals of the second delayed imaging signal as a delayed color addition signal;
A difference absolute value calculating means for calculating an absolute value of a difference between the color addition signal and the delayed color addition signal;
The imaging signal synthesis ratio generation circuit uses a signal representing the absolute value of the difference detected by the difference absolute value calculation means of the motion amount calculation circuit as a motion amount signal representing the amount of motion, and based on the signal, An image pickup apparatus that generates the above-described combination ratio in an image pickup signal combining circuit. Further comprising a video signal noise reduction circuit that suppresses noise included in the video signal output from the video signal generation means and outputs a noise-reduced video signal that has been subjected to noise suppression;
The video signal noise reduction circuit is
Delay means for delaying the noise-reduced video signal for an integral multiple of a vertical scanning period and outputting the delayed video signal;
A video signal synthesis circuit for synthesizing the video signal and the delayed video signal at a predetermined synthesis ratio and outputting the noise-reduced video signal;
10. A video signal synthesis ratio generation circuit for generating a synthesis ratio of the video signal and the delayed video signal in the video signal synthesis circuit based on the motion amount signal. The imaging device according to one item. The video signal synthesis ratio generation circuit
When the motion amount signal indicates that the motion amount is large, a synthesis ratio that increases the ratio of the video signal in the video signal synthesis circuit is generated,
11. The composition ratio according to claim 10, wherein when the motion amount signal indicates that the motion amount is small, a composite ratio that increases the ratio of the delayed video signal is generated in the video signal composition circuit. The imaging device described. A video signal pixel adding circuit for receiving the video signal output from the video signal generating means and generating an added video signal;
The video signal pixel adding circuit is
In-plane pixel addition means for adding a signal of a pixel located in a region near the pixel of interest in the same field as the pixel of interest to the signal of the pixel of interest of the video signal;
An inter-plane pixel addition means for adding a signal of a pixel located in a neighboring region centered on the target pixel in a field adjacent to the field to which the target pixel belongs to the signal of the target pixel of the video signal;
A video signal synthesis circuit for synthesizing the signal output from the in-plane pixel addition means and the signal output from the inter-plane pixel addition means at a predetermined synthesis ratio;
6. A video signal synthesis ratio generation circuit for generating a synthesis ratio of a signal output from the in-plane pixel addition means and a signal output from the inter-plane pixel means based on the motion amount signal. The imaging device according to any one of 1 to 9. The video signal synthesis ratio generation circuit
When the motion amount signal indicates that the motion amount is large, a synthesis ratio that increases the ratio of the output signal of the in-plane pixel addition means is generated,
13. The imaging apparatus according to claim 12, wherein when the motion amount signal indicates that the motion amount is small, a composition ratio is generated so as to increase a ratio of an output signal of the inter-plane pixel adding means. .

Images