JP2008199403A - Imaging apparatus, imaging method and integrated circuit - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain a high quality image by obtaining a signal of a high SN ratio which does not deteriorate other characteristics by a high SN ratio in an imaging apparatus. <P>SOLUTION: When there is sufficiently a large amount of light from an object, an imaging element of an imaging section increases a frame frequency of the imaging section having an imaging element of high output sensitivity in order to extract a signal by using as large amount of light as possible. Since image data signals for a plurality of sheets are outputted from the imaging section having the imaging element of high output sensitivity in this way, averaging processing is applied to the image data signals to thereby improve an SN ratio of the image data signal. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an imaging device intended to obtain an image with a high S / N ratio.

In recent years, a composite image or the like of a video imaged by an imaging device and CG (Computer Graphics) has been used for a video image such as a television or a movie. Here, there are various methods for extracting an image from an image pickup apparatus using a chroma key technique and combining the images to create an image. When performing such chroma key composition or the like, an image with a high S / N ratio is desired. In recent years, a MOS type solid-state image sensor that operates at a frame frequency substantially faster than the frame frequency of a standard television signal has been realized.
A conventional imaging apparatus will be described below.
Conventionally, what was described in Unexamined-Japanese-Patent No. 2000-278704 is known as an imaging device. The imaging apparatus is shown in FIG. FIG. 5 shows a configuration diagram of a conventional imaging apparatus. In FIG. 5, the imaging apparatus is separated from a lens 501 that collects light from a subject, a three-color separation prism 502 that separates the light collected by the lens 501 into three colors, and a three-color separation prism 502. A solid-state image sensor for blue 503, a solid-state image sensor for green 504, and a solid-state image sensor for red 505 for converting light to be photoelectrically converted into an electric signal. In addition, this imaging device includes drive circuits 506, 507, and 508 for driving the solid-state image pickup element 503 for blue, the solid-state image pickup element 504 for green, and the solid-state image pickup element 505 for red, respectively. , A microprocessor 509 for determining the accumulation time of the green and red solid-state imaging devices, and a process circuit 510 for generating a standard television signal by performing gamma correction, DTL processing (detail enhancer processing), synchronization addition, and the like And have.

The operation of the conventional imaging apparatus configured as described above will be described below. First, light from a subject is separated into three color lights of blue, green, and red by a three-color separation prism 502 through a lens 501, and solid-state imaging is performed. The image is formed as a subject image on the elements 503, 504, and 505, photoelectrically converted, and output as an electrical signal. At this time, the time (charge accumulation time) in which charges are accumulated in the solid-state imaging devices 503, 504, and 505 is set so that the signal levels of the electrical signals output from the solid-state imaging devices 503, 504, and 505 are substantially equal. The charge accumulation time is set by the drive circuits 506, 507, and 508 under the control of the microprocessor 509. The output signals corresponding to blue, green, and red output from the blue solid-state image pickup element 503, the green solid-state image pickup element 504, and the red solid-state image pickup element 505 have output sensitivities between the respective colors in the process circuit 510. The signal level is adjusted so as to be constant, and further, gamma correction, DTL processing, synchronization addition, and the like are executed and output from the process circuit 510 as a standard television signal. The microprocessor 509 shortens the charge accumulation time for a solid-state image sensor with a color with a higher signal level, and lengthens the charge accumulation time for a solid-state image sensor with a color with a lower signal level, thereby reducing the output level of the solid-state image sensor for each color. Almost match.

In a normal imaging device, the output level of the solid-state imaging device decreases in the order of green, red, and blue. In other words, when the imaging device is composed of three solid-state image sensors, that is, a solid-state image sensor for green, a solid-state image sensor for red, and a solid-state image sensor for blue, the output level (output sensitivity) of the solid-state image sensor for green is the largest. (High), the output level (output sensitivity) of the blue solid-state image sensor is the lowest (low). The ratio of the output level (output sensitivity) of the green solid-state image sensor to the output level (output sensitivity) of the blue solid-state image sensor is about 4: 1.
This will be described with reference to FIG. FIG. 6A is a diagram showing the relationship between the vertical synchronization signal of the standard television signal and time. FIG. 6B is a diagram showing the relationship between the charge accumulation amount of the green solid-state imaging device and time. FIG. 6C is a diagram illustrating the relationship between the charge accumulation amount of the red solid-state imaging device and time. FIG. 6D is a diagram showing the relationship between the charge accumulation amount of the blue solid-state imaging device and time. As shown in FIG. 6, the charge accumulation time in the CCD type solid-state imaging device is the timing when the charge reset signal is inputted (timing of trG, trR, trB shown in FIG. 6) and the accumulation end time as a frame. This is determined by making it coincide with the end time of (the timing at which the vertical synchronization signal of the standard television signal is output). In the MOS type solid-state image pickup device, the method for determining the charge accumulation time is slightly different from the case of the CCD type solid-state image pickup device. In the MOS type solid-state imaging device, the signal readout time from each pixel constituting the solid-state imaging device is the end of the charge accumulation time, and reset so that the charge accumulation time is the same for all pixels constituting the solid-state imaging device. A pulse is inserted for each pixel. Then, the charge accumulated during this charge accumulation time is read out as a voltage signal. In the solid-state imaging device, in order to minimize the charge accumulation time of the green solid-state imaging device 504 with high output sensitivity and to maximize the charge accumulation time of the blue solid-state imaging device 503 with low output sensitivity, the frame period (standard frame) By setting the entire region (long period) as the charge accumulation period, the output sensitivities of the levels (output voltages) of the signals output from the solid-state imaging elements for the respective colors are matched. In this way, by matching the output sensitivities for the signal levels of the output signals output from the solid-state imaging devices for the respective colors, the reproduction ranges of all colors are made equal. In this way, it is possible to use the amount of charge accumulated to the maximum within the range below the saturation level of the charge accumulation amount of the solid-state imaging device for all colors. Therefore, in the signal that is photoelectrically converted and output from the solid-state imaging device, the SN ratio of the output signal output from the blue solid-state imaging device with low output sensitivity is improved, so that the SN ratio as a whole of the color signal is also improved and high. A signal having an S / N ratio is obtained.
JP 2000-278704 A

However, in the above configuration, since the charge accumulation time in the green and red solid-state image sensors is shorter than the time corresponding to the frame period (the time corresponding to the standard frame length), the incident light enters the green and red solid-state image sensors. In a situation where there is a period in which the emitted light cannot be used and there is a large amount of light from the subject, the light utilization rate of the imaging device (camera) is deteriorated. In particular, green band light with high output sensitivity of the solid-state image sensor is not effectively used, and there is a problem that the amount of photoelectric conversion in the solid-state image sensor is reduced.
The present invention solves the above-described problems, and realizes an imaging apparatus, an imaging method, and an integrated circuit that improve light utilization efficiency and improve the SN ratio of an output signal in a situation where the amount of light from a subject is sufficiently large. The purpose is to do.

  The first invention is a first color imaging unit, a second color imaging unit, a frame frequency setting unit, a first color driving unit, a second color driving unit, and a second color calculation process. And an imaging device. The first color imaging unit includes an imaging device, and photoelectrically converts light of the first color band included in the light from the subject within a reference time as image data information corresponding to at least one image. Obtain and output. The second color imaging unit includes an image sensor, and is light in the second color band included in the light from the subject within the reference time, and the output sensitivity of the image sensor is light in the first color band. And photoelectrically converting light in the second color band higher than the output sensitivity of the image sensor to obtain image data information corresponding to a plurality of images, and image data information for each image data information corresponding to a single image Output in the order of acquisition. The frame frequency setting unit determines the output rate of the image data information output from the first color imaging unit and the output rate of the image data information output from the second color imaging unit. And a frame frequency for the second color for determining. The first color driving unit outputs image data information from the first color imaging unit at an output rate determined by the first color frame frequency set by the frame frequency setting unit. The second color driving unit outputs the image data information from the second color imaging unit at an output rate determined by the second color frame frequency set by the frame frequency setting unit. The second color calculation processing unit calculates the image data information corresponding to one image as unit image data information with respect to the image data information output from the second color imaging unit, and calculates between the unit image data information. Process and output.

  In this imaging apparatus, the light of the first color band included in the light from the subject is photoelectrically converted by the first color imaging unit within the reference time, and image data information corresponding to one image (hereinafter referred to as N). The image data corresponding to the images is acquired as “image data information for N sheets”) and output. The light of the second color band included in the light from the subject is acquired and output as image data information for a plurality of sheets by the second color imaging unit within the reference time. The image data information for a plurality of sheets sequentially output from the second color imaging unit is converted into unit image data information by using the second color calculation processing unit as image data information corresponding to one image as unit image data information. Between them. Since the output sensitivity of the image sensor of the second color imaging unit with respect to the light of the second color band is higher than the output sensitivity with respect to the light of the first color band, in the second color imaging unit, a plurality of images are obtained at the reference time. The image data information can be acquired efficiently.

As a result, in a situation where the amount of light from the subject is sufficiently large, it is possible to improve light use efficiency in photoelectric conversion for light with high output sensitivity of the image sensor, and noise reduction processing is performed by the second color arithmetic processing unit. Since it can perform, the S / N ratio of the output signal from an imaging device can be improved.
The “reference time” refers to the time required to construct one image when displaying as a moving image. For example, when displaying 30 images per second as a moving image, 1 / 30 seconds is the reference time. The “image data information” refers to data information that can form an image, and is a concept that includes, for example, an image data signal that can form a two-dimensional image.
2nd invention is 1st invention, Comprising: The frame rate conversion part for 2nd colors and a delay part are further provided. The first color driving unit outputs image data information from the first color imaging unit as reference time image data information at an output rate determined by the first color frame frequency corresponding to the reference time. The second color frame rate conversion unit converts the image data information output from the second color calculation processing unit into reference time image data information corresponding to the reference time, and outputs the reference time image data information. The delay unit matches the output timings of the reference time image data information output from the first color imaging unit and the reference time image data information output from the second color frame rate conversion unit.

Thus, the image data information output from the second color frame rate conversion unit corresponds to the reference time. Further, a phase shift and a delay amount between the image data information corresponding to the reference time output from the first color imaging unit and the image data information corresponding to the reference time output from the second color frame speed conversion unit Can be adjusted by the delay unit, the image data information having the same output timing is output from the delay unit.
3rd invention is 1st or 2nd invention, Comprising: A frame frequency setting part is the output sensitivity of the image pick-up element of the imaging part for 1st colors, and the output sensitivity of the image pick-up element of the image pick-up part for 2nd colors. Accordingly, the first color frame frequency and the second color frame frequency are set.
As a result, the output levels of the image data information output from the first color imaging unit and the image data information output from the second color imaging unit are matched, or the difference between the output levels is kept within a certain range. Can do. For example, when the ratio between the output sensitivity of the image sensor of the first color image pickup unit and the output sensitivity of the image sensor of the second color image pickup unit is N: M, the frame frequency for the first color and the second color use By setting the ratio to the frame frequency to N: M, the output levels of the image data information output from the first color imaging unit and the image data information output from the second color imaging unit are matched. Alternatively, the difference in output level can be kept within a certain range.

4th invention is 3rd invention, Comprising: A frame frequency setting part is an integer ratio of the output sensitivity of the image pick-up element of the imaging part for 1st colors, and the output sensitivity of the image pick-up element of the image pick-up part for 2nd colors, The first color frame frequency and the second color frame frequency are set so that the ratio between the first color frame frequency and the second color frame frequency matches.
Thus, with a simple configuration, the image data information output from the first color imaging unit and the output level of the image data information output from the second color imaging unit are matched, or the difference in output level is set. It can be kept within a certain range. For example, when the ratio between the output sensitivity of the image sensor of the first color imaging unit and the output sensitivity of the image sensor of the second color imager is 1: 2, the first color frame frequency and the second color frame The ratio to the frequency may be set to 1: 2.

The fifth invention is the invention according to any one of the first to fourth inventions, wherein the frame frequency setting unit has substantially the same output level of the first color imaging unit and the second color imaging unit. The frame frequency for the second color is set so that
As a result, the output level of the first color imaging unit and the output level of the second color imaging unit substantially coincide with each other, and output image data information with no bias in the color band can be acquired. For example, by controlling the frame frequency so that the output level of the first color imaging unit and the output level of the second color imaging unit are substantially the same by feedback control using a microprocessor, this imaging is performed. A device can be realized.
A sixth invention is any one of the first to fifth inventions, wherein the second color arithmetic processing unit is configured to output one image for the image data information output from the second color imaging unit. The image data information corresponding to is used as unit image data information, and an averaging process is performed between the unit image data information and output.
As a result, the image data information output from the second color arithmetic processing unit has noise components reduced.

A seventh invention is any one of the second to sixth inventions, further comprising a process unit that converts reference time image data information output from the delay unit into a standard video signal and outputs the standard video signal.
Accordingly, the reference time image data information output from the delay unit can be converted into a standard video signal, and the output from the imaging device can be displayed on a display device or the like that can display the standard video signal. . Here, the standard video signal is, for example, a standard television signal (60 frames / second, 60 fields / second, 50 frames / second, 50 fields / second, etc.) for display on a display device such as a television monitor. Resolution video signal (video signal such as NTSC, PAL, SECAM, etc.), high resolution video signal (video signal such as HDTV), and cinema video signal (video signal such as 48 frames / second, 24 frames / second). Say.

8th invention is 1st invention, Comprising: The 3rd color imaging part, the 3rd color calculating part, and the frame speed conversion part for 3rd colors are further provided. The third color imaging unit includes an image sensor, and is light in the third color band included in the light from the subject within the reference time, and the output sensitivity of the image sensor is the light in the second color band. And photoelectrically converting light in a third color band higher than the output sensitivity of the image sensor to obtain image data information corresponding to a plurality of images, and image data information for each image data information corresponding to a single image Output in the order of acquisition. The frame frequency setting unit sets a third color frame frequency for determining an output rate of image data information output from the third color imaging unit. The third color frame speed conversion unit uses the image data information corresponding to one image as unit image data information with respect to the image data information output from the third color imaging unit. Perform arithmetic processing and output.
As a result, for example, with respect to light from a subject separated into blue, green, and red color bands, image data information corresponding to the light of the three colors can be acquired, and green with high output sensitivity of the image sensor. As for the image data information corresponding to the light in the red color band, the image data information for a plurality of sheets can be acquired within the reference time, and a calculation process for reducing noise can be executed.

A ninth invention is the eighth invention according to the eighth invention, wherein the image data information output from the third color arithmetic processing section is converted into reference time image data information corresponding to the reference time and output. A speed converter is further provided. The delay unit outputs the reference time image data information output from the first color imaging unit, the reference time image data information output from the second color frame rate conversion unit, and the third color frame rate conversion unit. Match the output timing with the reference time image data information.
Accordingly, the image data information output from the third color frame rate conversion unit corresponds to the reference time. Furthermore, the image data information corresponding to the reference time output from the first color imaging unit, the image data information corresponding to the reference time output from the second color frame rate conversion unit, and the third color frame rate Since the phase shift and the delay amount with respect to the image data information corresponding to the reference time output from the conversion unit can be adjusted by the delay unit, the image data information with the output timing matched is output from the delay unit. The

A tenth aspect of the invention is the eighth or ninth aspect of the invention, wherein the frame frequency setting unit includes the output sensitivity of the image pickup device of the first color image pickup unit, the output sensitivity of the image pickup device of the second color image pickup unit, and the The first color frame frequency, the second color frame frequency, and the third color frame frequency are set in accordance with the output sensitivity of the image pickup device of the three-color image pickup unit.
Accordingly, the output levels of the image data information output from the first color imaging unit, the image data information output from the second color imaging unit, and the image data information output from the third color imaging unit. Can be matched, or the difference in output level can be kept within a certain range.
An eleventh aspect of the invention is the tenth aspect of the invention, wherein the frame frequency setting unit is configured to output the output sensitivity of the image pickup device of the first color image pickup unit, output sensitivity of the image pickup device of the second color image pickup unit, and third color use. The first color frame frequency and the first color frame frequency so that the integer ratio of the output sensitivity of the image pickup device of the image pickup unit and the ratio of the first color frame frequency, the second color frame frequency, and the third color frame frequency match. A frame frequency for two colors and a frame frequency for third color are set.
Accordingly, the image data information output from the first color imaging unit, the output level of the image data information output from the second color imaging unit, and the third color imaging unit are output with a simple configuration. The output level of the image data information can be matched, or the difference in output level can be kept within a certain range. For example, the ratio of the output sensitivity of the image sensor of the first color image pickup unit, the output sensitivity of the image sensor of the second color image pickup unit, and the output sensitivity of the image sensor of the second color image pickup unit is 1: 2: 3. In some cases, the ratio of the first color frame frequency, the second color frame frequency, and the third color frame frequency may be set to 1: 2: 3.

A twelfth aspect of the invention is any one of the eighth to eleventh aspects of the invention, wherein the frame frequency setting unit is configured to output the output level of the first color imaging unit, the output level of the second color imaging unit, and the third color. The frame frequency for the second color and the frame frequency for the third color are set so that the output level of the imaging unit is substantially the same.
As a result, the output level of the first color imaging unit, the output level of the second color imaging unit, and the output level of the third color imaging unit substantially coincide with each other, and output image data information with no bias in the color band is acquired. can do.
A thirteenth aspect of the invention is any one of the eighth to twelfth aspects of the invention, in which the second color arithmetic processing unit is a single image for the image data information output from the second color imaging unit. The image data information corresponding to is used as unit image data information, and an averaging process is performed between the unit image data information and output. The arithmetic processing unit for the third color adds the image data information corresponding to one image as unit image data information to the image data information output from the third color imaging unit between the unit image data information. Perform average processing and output.
As a result, the image data information respectively output from the second color arithmetic processing unit and the third color arithmetic processing unit has a reduced noise component.

A fourteenth aspect of the invention is any one of the ninth to thirteenth aspects of the invention, further comprising a processing unit that converts the reference time image data information output from the delay unit into a standard video signal and outputs the standard video signal.
Accordingly, the reference time image data information output from the delay unit can be converted into a standard video signal, and the output from the imaging device can be displayed on a display device or the like that can display the standard video signal. .
A fifteenth aspect of the invention is any one of the eighth to fourteenth aspects, wherein the light in the first color band is light in the blue band, and the light in the second color band is light in the red band. The light in the third color band is light in the green band.
The blue band light means light having a wavelength of 430 [nm] to 460 [nm] having a peak near 435 [nm], for example, and the red band light is 700 [nm], for example. Light having a wavelength of 610 [nm] to 780 [nm] having a peak in the vicinity, and light in the green band is, for example, from 500 [nm] to 570 [nm] having a peak in the vicinity of 546 [nm]. Light with a wavelength.

The sixteenth invention is the fifteenth invention, wherein the frame frequency setting section sets a ratio of the first color frame frequency, the second color frame frequency, and the third color frame frequency to 1: 2: 3. The first color frame frequency, the second color frame frequency, and the third color frame frequency are set so that
A seventeenth invention is any one of the first to sixteenth inventions, wherein the reference time is a time required for scanning one field in the television signal. The “time required to scan one field” is the time required to create one screen on the display device. For example, in the case of the interlaced NTSC system, it is 1/60 second, In the case of the PAL system, it is 1/50 second.

An eighteenth aspect of the invention is any one of the first to sixteenth aspects of the invention, wherein the reference time is a time required for scanning one frame in the television signal. The “time required to scan one frame” is the time required to form one image on the display device. For example, in the case of the interlaced NTSC system, 1/30 second, non-interlaced NTSC. In the case of the method, it is 1/60 second.
A nineteenth aspect of the invention is an imaging method in an imaging apparatus including a first color imaging unit and a second color imaging unit each having an imaging device, the first color imaging step, and the second color imaging step, The image pickup method includes a frame frequency setting step, a first color driving step, a second color driving step, and a second color calculation processing step. In the first color imaging step, the light of the first color band included in the light from the subject is photoelectrically converted and acquired as image data information corresponding to at least one image within the reference time and output. In the second color imaging step, the output sensitivity of the image sensor with respect to the light of the second color band included in the light from the subject within the reference time and the output sensitivity of the image sensor is the first color band. The higher second color band light is photoelectrically converted and acquired as image data information corresponding to a plurality of images, and the image data information is output in the order of acquisition for each image data information corresponding to one image. . In the frame frequency setting step, the first color frame frequency for determining the output rate of the image data information output in the first color imaging step and the output rate of the image data information output from the second color imaging unit And a frame frequency for the second color for determining. In the first color driving step, the image data information is output from the first color imaging unit at an output rate determined by the first color frame frequency set in the frame frequency setting step. In the second color driving step, image data information is output from the second color imaging unit at an output rate determined by the second color frame frequency set in the frame frequency setting step. In the second color calculation processing step, the image data information output from the second color imaging unit is calculated between the unit image data information using the image data information corresponding to one image as the unit image data information. Process and output.
With this imaging method, in a situation where the amount of light from the subject is sufficiently large, it is possible to improve the light utilization efficiency in photoelectric conversion for light with high output sensitivity of the imaging element, and noise reduction by the second color calculation processing step Since the process can be executed, the SN ratio of the output signal generated by this imaging method can be improved.

  A twentieth aspect of the invention is a first color imaging unit, a second color imaging unit, a frame frequency setting unit, a first color driving unit, a second color driving unit, and a second color calculation process. And an integrated circuit. The first color imaging unit includes an imaging device, and photoelectrically converts light of the first color band included in the light from the subject within a reference time as image data information corresponding to at least one image. Obtain and output. The second color imaging unit includes an image sensor, and is light in the second color band included in the light from the subject within the reference time, and the output sensitivity of the image sensor is light in the first color band. And photoelectrically converting light in the second color band higher than the output sensitivity of the image sensor to obtain image data information corresponding to a plurality of images, and image data information for each image data information corresponding to a single image Output in the order of acquisition. The frame frequency setting unit determines the output rate of the image data information output from the first color imaging unit and the output rate of the image data information output from the second color imaging unit. And a frame frequency for the second color for determining. The first color driving unit outputs image data information from the first color imaging unit at an output rate determined by the first color frame frequency set by the frame frequency setting unit. The second color driving unit outputs the image data information from the second color imaging unit at an output rate determined by the second color frame frequency set by the frame frequency setting unit. The second color calculation processing unit calculates the image data information corresponding to one image as unit image data information with respect to the image data information output from the second color imaging unit, and calculates between the unit image data information. Process and output.

  As a result, in a situation where the amount of light from the subject is sufficiently large, it is possible to improve light use efficiency in photoelectric conversion for light with high output sensitivity of the image sensor, and noise reduction processing is performed by the second color arithmetic processing unit. Since it can perform, the S / N ratio of the output signal from an imaging device can be improved.

  According to the present invention, it is possible to realize an imaging device, an imaging method, and an integrated circuit that improve the light utilization efficiency and improve the SN ratio of the output signal in a situation where the amount of light from the subject is sufficiently large.

Hereinafter, an embodiment of the present invention will be described with reference to FIGS. 1 to 4.
[First Embodiment]
<Overall configuration of imaging device>
FIG. 1 shows a configuration diagram of an imaging apparatus 100 according to the first embodiment of the present invention. The imaging apparatus 100 mainly separates the lens 1 that collects light from the subject and the light collected by the lens 1 into three colors (red (R), green (G), and blue (B)). It has a three-color separation prism 2, and a blue image pickup unit 3, a green image pickup unit 4, and a red image pickup unit 5 for photoelectrically converting the light separated from the three-color separation prism 2 and taking it out as an electric signal. .
The imaging apparatus 100 further includes a green arithmetic processing unit 9 and a red arithmetic processing unit 10 that perform arithmetic processing on outputs from the green imaging unit 4 and the red imaging unit 5, and a green arithmetic processing unit. 9 and a red frame rate conversion unit 12 and a red frame rate conversion unit 12 that perform frame rate conversion on the outputs of the arithmetic processing unit 10 for red and red. Further, the imaging apparatus 100 receives the output signal from the blue imaging unit 3, the output signal from the green frame speed conversion unit 11, and the output signal from the red frame conversion unit, and matches the output timing of each output signal. And a process unit 14 for converting an output signal from the delay unit into a standard television signal or the like. The imaging apparatus 100 includes a microprocessor 15 as a frame frequency setting unit that sets the frame frequencies of the blue imaging unit 3, the green imaging unit 4, and the red imaging unit 5, and the frame frequency set by the microprocessor 15. The blue driving unit 6, the green driving unit 7, and the red driving unit 8 that output image data signals from the blue imaging unit 3, the green imaging unit 4, and the red imaging unit 5 with the output rate determined by have.

The blue imaging unit 3 photoelectrically converts light in the blue band included in the light from the subject within the reference time, and outputs an image data signal as image data information corresponding to one image.
The green image capturing unit 4 and the red image capturing unit 5 photoelectrically convert the green band light and the red band light included in the light from the subject within the reference time, respectively, and correspond to a plurality of images. It is acquired as data information (image data signal) and output in the order of acquisition for each image data signal corresponding to one image.
As the blue imaging unit 3, the green imaging unit 4, and the red imaging unit 5, for example, a solid-state imaging device such as a MOS image sensor is used.
The green arithmetic processing unit 9 and the red arithmetic processing unit 10 unit the image data signal corresponding to one image with respect to the image data signals output from the green imaging unit 4 and the red imaging unit 5, respectively. As the image data signal, arithmetic processing is performed between the unit image data signals and output. For example, the unit image data signal is a standard television signal (60 frames / second, 60 fields / second, 50 frames / second, 50 fields / second, etc., standard resolution video signals (NTSC, PAL, SECAM, etc.) When it is an image data signal for one frame of a high-resolution video signal (video signal such as HDTV) or a cinema video signal (video signal of 48 frames / second, 24 frames / second, etc.) The unit 9 and the red arithmetic processing unit 10 perform arithmetic processing between frames on the pixels corresponding to the same position on the two-dimensional image formed by the image data signal. As the arithmetic processing, for example, there is addition averaging processing and the like.

  The green frame rate conversion unit 11 and the red frame rate conversion unit 12 convert the image data signal output from the green calculation processing unit 9 and the red calculation processing unit 10 into a reference time image data signal corresponding to the reference time. And output. For example, the green imaging unit 4 outputs image data signals corresponding to two images within the reference time, and the red imaging unit 5 outputs image data signals corresponding to three images within the reference time. In this case, the green arithmetic processing unit 9 outputs a unit image data signal in units of 1/3 of the reference time, and the red arithmetic processing unit 10 uses 1/2 of the reference time as a unit. As a result, a unit image data signal is output. Therefore, the green frame rate conversion unit 11 performs time axis extension processing so that the unit image data signal output from the green calculation processing unit 9 is output in units of reference time (in this case, three times the time). Axis extension processing is performed). Similarly, the red frame rate conversion unit 12 performs time axis expansion processing so that the unit image data signal output from the red calculation processing unit 10 is output in units of reference time (in this case, doubled). Perform time axis extension processing).

The delay unit 13 includes, for example, a blue delay unit 131, a green delay unit 132, and a red delay unit 133. The delay unit 13 includes three image data signals (blue image data signal, green color) output from the blue imaging unit 3, the green frame rate conversion unit 11 and the red frame rate conversion unit 12 in units of reference times. Output image data signal and red image data signal), and the output timing of the three image data signals (blue image data signal, green image data signal and red image data signal) output from the delay unit 13 is Delay processing is performed so as to match (including phase).
The process unit 14 performs synchronization signal addition, gamma correction, detail addition (detail enhancer processing), and the like on the image data signal output from the delay unit 13 to generate and output a standard video signal. Here, the standard video signal is, for example, a standard television signal (60 frames / second, 60 fields / second, 50 frames / second, 50 fields / second, etc.) for display on a display device such as a television monitor. Resolution video signal (video signal such as NTSC, PAL, SECAM, etc.), high resolution video signal (video signal such as HDTV), and cinema video signal (video signal such as 48 frames / second, 24 frames / second). Say.

The microprocessor 15 controls various sequences of the imaging device 100. The microprocessor 15 determines the output rate of the image data signal output from the blue imaging unit 3, the green imaging unit 4 and the red imaging unit 5, respectively. The blue frame frequency, the green frame frequency, and the red frame are determined. Set the frequency. By issuing commands to the components of the imaging apparatus 100 such as the blue imaging unit 3, the green imaging unit 4, the red imaging unit 5, and the process unit 14, functions of the respective configuration units are controlled. Note that the microprocessor 15 may be connected directly to each component or may be connected via a bus.
The blue driving unit 6, the green driving unit 7, and the red driving unit 8 have an output rate determined by a frame frequency set by the microprocessor 15, and the blue imaging unit 3, the green imaging unit 4, and the red driving unit. Each image data signal is output from the imaging unit 5.

A part of the microprocessor 15 forms a frame frequency setting unit. The function of the frame frequency setting unit can be realized by causing the microprocessor 15 to read the setting value of the frame frequency stored in advance in, for example, a ROM (not shown). Further, for example, the function of the frame frequency setting unit can also be realized by the user inputting a frame frequency setting value from the outside and the microprocessor 15 reading the input frame frequency setting value.
<Operation of imaging device>
Next, the operation of the imaging apparatus 100 will be described with reference to FIGS.
As shown in FIG. 1, first, light from a subject is collected by a lens 1 and separated into three color lights of blue, green, and red by a three-color separation prism 2 (blue band light, green band light). , Separated into red band light). The light separated into the three colors is formed as a subject image on each solid-state image sensor of the blue imaging unit 3, the green imaging unit 4 and the red imaging unit 5, and is photoelectrically converted to an electrical signal. Is output as Here, the reference time is set to one frame time (1/30 second) of the interlaced NTSC system, and the blue frame frequency is set to 30 [Hz] and the green frame frequency is set to 90 [Hz] by the microprocessor 15 and red. An example in which the frame frequency is set to 60 [Hz] will be described below. It should be noted that the frame frequency of 30 [Hz] of the NTSC system or the like is “standard frame frequency”, the period of the standard frame frequency is “standard frame period”, and the time corresponding to the standard frame period is “standard frame time” or “ This will be referred to as “standard frame length”.

When the blue frame frequency is set to 30 [Hz], the green frame frequency is set to 90 [Hz], and the red frame frequency is set to 60 [Hz], the blue drive unit 6 is connected to the blue image pickup unit 3. The blue image pickup unit 3 is controlled so as to output image data signals (image data signals for 30 frames) corresponding to 30 images per second. The green driving unit 7 is an image data signal corresponding to 90 images per second by the green imaging unit 4 (hereinafter referred to as N image data signals corresponding to N images). The green image pickup unit 4 is controlled so as to be output. The red driving unit 8 controls the red imaging unit 5 so that the red imaging unit 5 outputs image data signals for 60 sheets per second.
Thereby, in the standard frame time, one image data signal from the blue imaging unit 3, three image data signals from the green imaging unit 4, and two images from the red imaging unit 5. Image data signals are output.

The relationship between the charge accumulation amount and the charge accumulation time in the blue imaging unit 3, the green imaging unit 4, and the red imaging unit 5 will be described with reference to FIG. FIG. 2A is a diagram showing the relationship between the vertical synchronization signal (VD signal) of the standard television signal and time. FIG. 2B is a diagram showing the relationship between the charge accumulation amount of the green solid-state imaging device and time. FIG. 2C is a diagram illustrating the relationship between the charge accumulation amount of the red solid-state imaging device and time. FIG. 2D is a diagram showing the relationship between the charge accumulation amount of the blue solid-state imaging device and time.
When the blue frame frequency is set to 30 [Hz], the green frame frequency is set to 90 [Hz], and the red frame frequency is set to 60 [Hz], the charge accumulation time in the blue imaging unit 3 is shown in FIG. The charge accumulation time in the red image pickup unit 5 is TR, and the charge accumulation time in the blue image pickup unit 3 is TB. The output sensitivity of the solid-state imaging device is the output sensitivity of the solid-state imaging device constituting the green imaging unit 4, the output sensitivity of the solid-state imaging device constituting the red imaging unit 5, and the solid-state imaging device constituting the blue imaging unit 3. The output sensitivity decreases in order. Therefore, by increasing the charge accumulation time in the order of TG, TR, and TB, the signal levels of the output signals respectively output from the blue imaging unit 3, the green imaging unit 4, and the red imaging unit 5 are set. , Can be on an equivalent level. In FIG. 2, TG: TR: TB = 3: 2: 1. However, the ratio of the charge accumulation times TG, TR, and TB is not limited to this. For example, the microprocessor 15 detects the output sensitivities of the solid-state image pickup device of the blue image pickup unit 3, the solid-state image pickup device of the green image pickup unit 4, and the solid-state image pickup device of the red image pickup unit 5. Thus, the blue frame frequency, the green frame frequency, and the red frame frequency may be determined, respectively, and the ratio of the charge accumulation times TG, TR, and TB may be determined. Regarding the detection of the output sensitivity of each solid-state image sensor, for example, image data signals output from the blue image-capturing unit 3, the green image-capturing unit 4, and the red image-capturing unit 5 are correlated with the output sensitivity of each solid-state image sensor. May be detected from the output level of the image data signal from the blue delay unit 131, the green delay unit 132, and the red delay unit 133 input to the process unit 14. (In FIG. 1, the specific connection relationship between the microprocessor 15 and the blue, green, and red imaging units is not shown.) Further, for example, the output sensitivity ratio of each solid-state imaging device is 3. When the ratio is not an integer ratio such as 2: 2: 1, truncation processing is performed and the ratio of frame frequencies may be set to an integer (in this case, the ratio of frame frequencies is set to 3: 2: 1). do it). Thereby, the period when the light input into the imaging device 100 is not photoelectrically converted can be reduced, and the light use efficiency can be increased.

In the standard frame time, one image data signal output from the blue imaging unit 3 is input to the blue delay unit 131 of the delay unit 13. On the other hand, in the standard frame time, three image data signals output from the green imaging unit 4 are input to the green arithmetic processing unit 9, and two image data output from the red imaging unit 5. The signal is input to the red arithmetic processing unit 10. The output of the green arithmetic processing unit 9 is input to the green frame rate conversion unit 11, and the output of the red arithmetic processing unit 10 is input to the red frame rate conversion unit 12. The operation at this time will be described with reference to FIGS.
FIG. 3 shows an output waveform of the image data signal output from the green imaging unit 4 of the imaging apparatus 100, an output waveform of the image data signal output from the green arithmetic processing unit 9, and the green frame rate conversion unit 11. An example of the output waveform of the output image data signal is shown. FIG. 3A shows an example of an output waveform of the image data signal output from the green imaging unit 4, and FIG. 3B shows an example of an output waveform of the image data signal output from the green arithmetic processing unit 9. FIG. 3C shows an example of the output waveform of the image data signal output from the green frame rate conversion unit 11. FIGS. 3A to 3C are explanatory diagrams for explanation, and do not indicate the output timing of each waveform.

FIG. 4 shows the output waveform of the image data signal output from the red imaging unit 5 of the imaging apparatus 100, the output waveform of the image data signal output from the red arithmetic processing unit 10, and the red frame rate conversion unit 12. An example of the output waveform of the output image data signal is shown. 4A shows an example of the output waveform of the image data signal output from the red imaging unit 5, and FIG. 4B shows an example of the output waveform of the image data signal output from the red arithmetic processing unit 10. FIG. 4C shows an example of the output waveform of the image data signal output from the red frame rate conversion unit 12. FIGS. 4A to 4C are explanatory diagrams for explanation, and do not indicate the output timing of each waveform.
Since the green frame frequency is set to three times the standard frame frequency, as shown in FIG. 3A, the image data signals G1, G2 for three images from the green imaging unit and G3 is output. In the green arithmetic processing unit 9, addition averaging processing is performed on the three image data signals G 1, G 2, and G 3, and the image data signal GG 1 subjected to the addition average processing is output from the green arithmetic processing unit 9. Since the image data signal GG1 is a signal having a cycle that is 1/3 of the standard frame cycle, the green frame rate conversion unit 11 performs time-axis expansion processing to convert the image data signal GG1 into an image data signal GG2 having a standard frame cycle. Output from the green frame rate conversion unit 11.

Similarly, since the red frame frequency is set to twice the standard frame frequency, as shown in FIG. 4A, two image data signals R1 from the green image pickup unit in the standard frame time. And R2 are output. In the red arithmetic processing unit 10, addition averaging processing is performed on the two image data signals R <b> 1 and R <b> 2, and the image data signal RR <b> 1 subjected to the addition average processing is output from the red arithmetic processing unit 10. Since the image data signal RR1 is a signal having a period that is ½ of the standard frame period, the red frame rate conversion unit 12 performs time axis expansion processing to convert the image data signal RR1 into an image data signal RR2 having a standard frame period. It is output from the red frame rate conversion unit 12.
The image data signals output from the blue imaging unit 3, the green frame rate conversion unit 11, and the red frame rate conversion unit are signals having a standard frame period. The three image data signals input to the delay unit 13 have a phase shift. Therefore, the image data signal output from the blue image pickup unit 3 by the delay unit 13 is output by the blue delay unit 131, and the image data signal output from the green frame rate conversion unit 11 is output by the green delay unit 132 by the red delay unit 131. The image data signals output from the frame rate conversion unit 12 are subjected to delay processing by the red delay unit 133, respectively, and are output from the delay unit 13 in a state where the phase shift is eliminated and the output timings are matched. Is done. The image data signal output from the blue image pickup unit 3 is not subjected to arithmetic processing and frame rate conversion processing, and no delay occurs due to arithmetic processing and frame rate conversion. A configuration without the delay unit 131 may be used.

The image data signal output from the delay unit 13 is subjected to gamma processing, DTL processing (detail enhancer processing), synchronization signal addition processing, and the like necessary for the standard video signal by the process unit 14, thereby generating a standard video signal. Is converted to output.
As described above, according to the imaging apparatus 100 of the present embodiment, the frame frequency of the imaging unit having the solid-state imaging device with the lowest output sensitivity is set as the standard frame frequency, and the frame frequency of the imaging unit having the solid-state imaging device with high output sensitivity. By reducing the value to an integer multiple of the standard frequency, noise reduction processing such as averaging processing is performed on the image data signals for multiple images output in a standard frame time from an imaging unit having a solid-state imaging device with high output sensitivity. (In general, when a highly correlated signal is added and averaged N times, the noise component becomes 1 / N ^1/2 times and the noise is reduced.) The SN ratio of the output image data signal can be improved. In particular, in situations where the amount of light from the subject is sufficiently large, the diaphragm is reduced so that the image sensor does not saturate as in the past, and the amount of light used for photoelectric conversion by the image sensor is reduced. There is no need to shorten the charge accumulation time to reduce the amount of light used for photoelectric conversion, and the effect is remarkable.

[Other Embodiments]
In the above embodiment, the case where the blue frame frequency, the green frame frequency, and the red frame frequency are set in advance has been mainly described. However, the present invention is not limited to this, and for example, a broadcast imaging apparatus Or, in an imaging device used by a professional cameraman, perform a test shot and monitor whether the output from the imaging device of the imaging unit is saturated or not, and manually increase the frame frequency so as not to saturate. The frame frequency may be set by.
Also, in an image pickup apparatus for broadcasting or an image pickup apparatus used by a professional cameraman, the color temperature is always 3200 [K] (usually the color temperature of the light for studio photography is 3200 [K]). Since the image is taken with correction, the frame frequency of the blue, green, and red image sensors may be fixed at 1, 3, and 2 times the standard television frame frequency.

Further, the microprocessor 15 detects the output signal level of each solid-state imaging device of the blue imaging unit 3, the green imaging unit 4, and the red imaging unit 5, and calculates a frame frequency for driving each solid-state imaging device. However, the microprocessor 15 may automatically determine the frame frequency so that the output signal levels of the solid-state imaging devices of the blue imaging unit 3, the green imaging unit 4, and the red imaging unit 5 are matched. good.
In the above embodiment, the case has been described in which the green arithmetic processing unit 9 and the red arithmetic processing unit 10 perform addition averaging processing. For example, an image data signal is converted into a low-frequency component signal and a high-frequency component signal. And after removing the small amplitude high frequency component contained in the high frequency component signal, the high frequency component signal from which the small amplitude high frequency component is removed and the low frequency component signal are added, An arithmetic operation may be performed to further improve the SN ratio by averaging between frames.

Moreover, although the said embodiment demonstrated the case of a 3 plate type imaging device (3 plate type camera), it is not limited to this. For example, in a single-plate imaging device configured to generate a color signal with a color filter provided in one imaging device, the imaging device can be driven for each color ( The CMOS type solid-state image pickup device has an image pickup device having a structure that can be driven grouped for each color.) Is the same as having an image pickup device that can be driven for each different color, and the book described above. Signal processing similar to that of the invention can be applied to such a single-plate imaging device.
In the above embodiment, in the imaging apparatus 100, the image data signal output from the process unit 14 is assumed to be a moving image (video), but is not limited to this. For example, The image data signal output from the delay unit 13 may be output as a still image and output to an external still image display device.

In the above-described embodiment, the imaging device 100 having the configuration including the blue imaging unit 3, the green imaging unit 4, and the red imaging unit 5, that is, the imaging device 100 that performs signal processing for RGB three colors has been described. Without being limited thereto, for example, it may be an imaging device that has imaging units for six colors of two colors of red, two colors of green, and two colors of blue, and performs signal processing for six colors, In addition, an imaging apparatus that has an imaging unit for three subtractive colors (cyan, magenta, and yellow) and performs signal processing for three subtractive colors may be used.
In the above embodiment, the reference time is described as one frame time. However, the reference time may be another reference time such as one field time, for example.
Moreover, each process of the said embodiment may be implement | achieved by hardware, and may be implement | achieved by software. Furthermore, it may be realized by mixed processing of software and hardware.

In the imaging device described in the above embodiment, each block may be individually made into one chip by a semiconductor device such as an LSI, or may be made into one chip so as to include a part or the whole. In particular, when a MOS type image sensor is used as an image pickup element constituting the image pickup unit, it becomes easy to integrate the MOS type integrated circuit.
Here, although LSI is used, it may be called IC, system LSI, super LSI, or ultra LSI depending on the degree of integration.
Further, the method of circuit integration is not limited to LSI, and implementation with a dedicated circuit or a general-purpose processor is also possible. An FPGA (Field Programmable Gate Array) that can be programmed after manufacturing the LSI or a reconfigurable processor that can reconfigure the connection and setting of circuit cells inside the LSI may be used.

Further, if integrated circuit technology comes out to replace LSI's as a result of the advancement of semiconductor technology or a derivative other technology, it is naturally also possible to carry out function block integration using this technology. There is a possibility of adaptation of biotechnology.
The specific configuration of the present invention is not limited to the above-described embodiment, and various changes and modifications can be made without departing from the scope of the invention.

  According to the present invention, it is possible to realize an imaging device, an imaging method, and an integrated circuit that improve the light utilization efficiency and improve the SN ratio of the output signal in a situation where the amount of light from the subject is sufficiently large. It can be implemented in the device related field. This is particularly useful in fields where chroma key processing, CG synthesis, and the like are required, where an image with a high S / N ratio is required.

1 is a configuration diagram of an imaging apparatus according to a first embodiment of the present invention. The figure which shows the relationship between the charge accumulation amount and charge accumulation time in the imaging part for blue of the imaging device which concerns on the embodiment, the imaging part for green, and the imaging part for red An example of the output waveform of the output image data signal from the green imaging unit, the green arithmetic processing unit, and the green frame rate conversion unit of the imaging apparatus 100 according to the embodiment An example of an output waveform of an output image data signal from the red imaging unit, the red arithmetic processing unit, and the red frame rate conversion unit of the imaging apparatus 100 according to the embodiment Configuration diagram of conventional imaging device FIG. 6 is a diagram for explaining the relationship between charge accumulation time and charge accumulation amount of an image sensor in a conventional imaging device.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Imaging device 1 Lens 2 Three color separation prisms 3, 4, 5 Imaging unit for blue, green, red 6, 7, 8 Driving circuit for blue, green, red 9 Arithmetic processing unit for green 10 Arithmetic processing unit for red 11 Green Frame rate conversion unit 12 Red frame rate conversion unit 13 Delay unit 14 Process unit 15 Microprocessor

Claims (20)

A first color having an image sensor, photoelectrically converting light of a first color band included in light from a subject within a reference time, and acquiring and outputting as image data information corresponding to at least one image An imaging unit;
An image sensor, wherein the image sensor is a light of a second color band included in the light from the subject within the reference time, and an output sensitivity of the image sensor for the light of the first color band And photoelectrically converting light of the second color band higher than the output sensitivity of the image data to obtain image data information corresponding to a plurality of images, and the image data information for each of the image data information corresponding to one image. A second color imaging unit for outputting in the order of acquisition;
The first color frame frequency for determining the output rate of the image data information output from the first color imaging unit and the output rate of the image data information output from the second color imaging unit are determined. A frame frequency setting unit for setting a second color frame frequency to
A first color driving unit that outputs the image data information from the first color imaging unit at an output rate determined by the first color frame frequency set by the frame frequency setting unit;
A second color driving unit that outputs the image data information from the second color imaging unit at an output rate determined by the second color frame frequency set by the frame frequency setting unit;
The image data information output from the second color imaging unit is subjected to arithmetic processing between the unit image data information, with the image data information corresponding to one image as unit image data information, and output. A second color calculation processing unit,
An imaging apparatus comprising: A second color frame rate conversion unit and a delay unit;
The first color driving section causes the image data information to be output from the first color imaging section as reference time image data information at an output rate determined by the first color frame frequency corresponding to the reference time. ,
The second color frame rate conversion unit converts the image data information output from the second color calculation processing unit into reference time image data information corresponding to the reference time, and outputs the converted data.
The delay unit matches output timings of the reference time image data information output from the first color imaging unit and the reference time image data information output from the second color frame rate conversion unit,
The imaging device according to claim 1. The frame frequency setting unit includes the first color frame frequency and the first color according to the output sensitivity of the image pickup device of the first color image pickup unit and the output sensitivity of the image pickup device of the second color image pickup unit. Set the frame frequency for two colors,
The imaging device according to claim 1 or 2. The frame frequency setting unit includes an integer ratio between the output sensitivity of the imaging element of the first color imaging unit and the output sensitivity of the imaging element of the second color imaging unit, and the first color frame frequency. Setting the frame frequency for the first color and the frame frequency for the second color so that the ratio with the frame frequency for the second color matches,
The imaging device according to claim 3. The frame frequency setting unit sets the second color frame frequency so that an output level of the first color imaging unit and an output level of the second color imaging unit are substantially the same;
The imaging device according to claim 1. The second color calculation processing unit uses the image data information corresponding to one image as unit image data information with respect to the image data information output from the second color imaging unit. Perform the averaging process between data information and output it.
The imaging device according to claim 1. Further comprising a process unit that converts the reference time image data information output from the delay unit into a standard video signal and outputs the standard video signal.
The imaging device according to claim 2. A third color imaging unit, a third color calculation unit, and a third color frame rate conversion unit;
The image pickup unit for the third color has an image sensor, and is light of a third color band included in the light from the subject within the reference time, and the output sensitivity of the image sensor is the second Photoelectric conversion of light of a third color band higher than the output sensitivity of the image sensor with respect to light of the color band is acquired as image data information corresponding to a plurality of images, and the image data information is obtained as one image Are output in the order obtained for each image data information corresponding to
The frame frequency setting unit sets a third color frame frequency for determining an output rate of the image data information output from the third color imaging unit;
The third color frame speed conversion unit uses the image data information corresponding to one image as unit image data information with respect to the image data information output from the third color imaging unit, and the unit Perform arithmetic processing between image data information and output,
The imaging device according to claim 1. A third color frame rate conversion unit for converting the image data information output from the third color calculation processing unit into reference time image data information corresponding to the reference time, and outputting the reference time image data information;
The delay unit includes the reference time image data information output from the first color imaging unit, the reference time image data information output from the second color frame rate conversion unit, and the third color frame rate. Match the output timing with the reference time image data information output from the conversion unit,
The imaging device according to claim 8. The frame frequency setting unit includes an output sensitivity of the imaging element of the first color imaging unit, an output sensitivity of the imaging element of the second color imaging unit, and an output of the imaging element of the third color imaging unit. The first color frame frequency, the second color frame frequency, and the third color frame frequency are set according to sensitivity.
The imaging device according to claim 8 or 9. The frame frequency setting unit includes an output sensitivity of the imaging element of the first color imaging unit, an output sensitivity of the imaging element of the second color imaging unit, and an output of the imaging element of the third color imaging unit. The first color frame frequency and the second color frame frequency so that the integer ratio of the sensitivity and the ratio of the first color frame frequency, the second color frame frequency, and the third color frame frequency coincide with each other. And a frame frequency for the third color,
The imaging device according to claim 10. The frame frequency setting unit is configured to output the second color imaging unit so that the output level of the first color imaging unit, the output level of the second color imaging unit, and the output level of the third color imaging unit are substantially the same. Setting a color frame frequency and the third color frame frequency;
The imaging device according to claim 8. The second color calculation processing unit uses the image data information corresponding to one image as unit image data information with respect to the image data information output from the second color imaging unit. Add and average between data information and output
The third color calculation processing unit uses the image data information corresponding to one image as unit image data information with respect to the image data information output from the third color imaging unit as the unit image. Perform the averaging process between data information and output it.
The imaging device according to claim 8. Further comprising a process unit that converts the reference time image data information output from the delay unit into a standard video signal and outputs the standard video signal.
The imaging device according to claim 9. The light in the first color band is light in the blue band, the light in the second color band is light in the red band, and the light in the third color band is light in the green band. ,
The imaging device according to claim 8. The frame frequency setting unit sets the respective frequencies so that a ratio of the frame frequency for the first color, the frame frequency for the second color, and the frame frequency for the third color is 1: 2: 3;
The imaging device according to claim 15. The reference time is a time required to scan one field in the television signal.
The imaging device according to claim 1. The reference time is a time required to scan one frame in the television signal.
The imaging device according to claim 1. An imaging method in an imaging apparatus including a first color imaging unit and a second color imaging unit each having an imaging element,
A first color imaging step of photoelectrically converting light of a first color band included in light from a subject within a reference time to obtain and output as image data information corresponding to at least one image;
Within the reference time, the second color band light included in the light from the subject, and the output sensitivity of the image sensor is higher than the output sensitivity of the image sensor with respect to the first color band light. The light of the two color bands is photoelectrically converted and acquired as image data information corresponding to a plurality of images, and the image data information is output in the order of acquisition for each of the image data information corresponding to one image. An imaging step for two colors;
The first color frame frequency for determining the output rate of the image data information output in the first color imaging step and the output rate of the image data information output from the second color imaging unit are determined. A frame frequency setting step for setting a frame frequency for the second color for
A first color driving step for outputting the image data information from the first color imaging unit at an output rate determined by the first color frame frequency set in the frame frequency setting step;
A second color driving step of outputting the image data information from the second color imaging unit at an output rate determined by the second color frame frequency set in the frame frequency setting step;
The image data information output from the second color imaging unit is subjected to arithmetic processing between the unit image data information, with the image data information corresponding to one image as unit image data information, and output. A second color calculation processing step;
An imaging method including: A first color having an image sensor, photoelectrically converting light of a first color band included in light from a subject within a reference time, and acquiring and outputting as image data information corresponding to at least one image An imaging unit;
An image sensor, wherein the image sensor is a light of a second color band included in the light from the subject within the reference time, and an output sensitivity of the image sensor for the light of the first color band And photoelectrically converting light of the second color band higher than the output sensitivity of the image data to obtain image data information corresponding to a plurality of images, and the image data information for each of the image data information corresponding to one image. A second color imaging unit for outputting in the order of acquisition;
The first color frame frequency for determining the output rate of the image data information output from the first color imaging unit and the output rate of the image data information output from the second color imaging unit are determined. A frame frequency setting unit for setting a second color frame frequency to
A first color driving unit that outputs the image data information from the first color imaging unit at an output rate determined by the first color frame frequency set by the frame frequency setting unit;
A second color driving unit that outputs the image data information from the second color imaging unit at an output rate determined by the second color frame frequency set by the frame frequency setting unit;
The image data information output from the second color imaging unit is subjected to arithmetic processing between the unit image data information, with the image data information corresponding to one image as unit image data information, and output. A second color calculation processing unit,
An integrated circuit comprising:

Images