JP4984517B2 - Imaging unit and imaging apparatus - Google Patents

Description

  The present invention belongs to the technical field of an image sensor in which a plurality of pixels are arranged in a matrix, and particularly includes a color pixel in which a color filter is disposed and a monochrome pixel in which the color filter is not disposed. The present invention relates to an image pickup unit including an image pickup element and an image pickup apparatus including the image pickup unit.

  In general, in an image sensor with a Bayer arrangement in which, for example, R (red), G (green), and B (blue) color filters having different spectral characteristics are arranged at a predetermined ratio, each color filter is photoelectrically converted to each pixel. Since the light guided to the part is attenuated, the effective sensitivity is lower than that of an image sensor not provided with a color filter. Furthermore, in recent years, the size of one pixel has been reduced with the reduction in size and increase in the number of pixels, and the amount of light received per pixel has decreased, further reducing the effective sensitivity of the image sensor. There is a tendency.

  Therefore, it is necessary to irradiate the flash frequently to secure the amount of received light, and as a result, when the number of shootable images decreases due to the increase in power consumption or the so-called camera shake correction function is installed, the camera shake correction is performed. Various problems have arisen such that the correction effect is small even when executed, or the S / N ratio is deteriorated (decreased) by increasing the amplification factor of the pixel signal obtained from each pixel.

In the following Patent Document 1, in an imaging device including photodiodes arranged vertically and horizontally, a luminance filter (including no filter on the surface of the photodiode) is provided on the photodiodes arranged in a checkered pattern. A technique is disclosed in which R (red), G (green), and B (blue) color filters are provided on the remaining checkered photodiodes that are not provided with luminance filters.
JP 2003-318375 A

  In the image pickup device in which the luminance filter is arranged as described in Patent Document 1, the color filter is arranged because each color filter attenuates the light guided to the photodiode of each pixel as described above. The sensitivity difference between a pixel (hereinafter referred to as a color pixel) and a pixel provided with a luminance filter (hereinafter referred to as a monochrome pixel) is greatly different, resulting in the following problems.

  FIG. 31A is a diagram showing a certain horizontal pixel column in which color pixels and monochrome pixels are alternately arranged in the horizontal direction among the image pickup elements in which the pixels are arranged in a matrix. b) is a diagram showing a signal waveform when an analog circuit provided in a subsequent stage of the image sensor reads out pixel signals alternately from color pixels and monochrome pixels belonging to the horizontal pixel column. In FIG. 31A, hatched pixels S1, S3, S5, and S7 indicate color pixels, and unhatched pixels S2, S4, S6, and S8 indicate monochrome pixels.

  As indicated by the dotted lines in FIG. 31, the signal waveform when the pixel signals are alternately read out from the color pixels S1, S3, S5, S7 and the monochrome pixels S2, S4, S6, S8 is ideally rectangular. is there.

  However, in reality, the pixel signals generated in the color pixels S1, S3, S5, and S7 and the monochrome signal are caused by a large sensitivity difference between the color pixels S1, S3, S5, and S7 and the monochrome pixels S2, S4, S6, and S8. The signal level differs greatly from the pixel signals generated at the pixels S2, S4, S6, and S8.

  When signals with significantly different signal levels are alternately input to the analog circuit, the signal level of the signal sampled by the analog circuit is the target for reading out the pixel signal due to the responsiveness of the analog circuit. Even if the pixel is switched, the signal level corresponding to the pixel signal generated by the pixel does not rise instantaneously, and a response delay that rises over a predetermined time from the switching timing occurs, as indicated by an arrow X in FIG. Waveform. As a result, when an analog signal is A / D converted into a digital signal, an appropriate A / D conversion value cannot be obtained, and there is a possibility that the image quality of the captured image is deteriorated.

  In particular, in recent years, it has been demanded that pixel signal readout processing be performed at a high driving frequency as the number of pixels increases, that is, the pixel signal readout time T for one pixel shown in FIG. When the readout time T is shortened in this way, as can be seen from FIG. 31B, the signal level corresponding to the pixel signal generated by the pixel (the signal level indicated by the arrow Y or the arrow Z) is not reached. As a result, the above-described readout process is performed on the pixels, and the above-described deterioration in the image quality of the captured image becomes remarkable. In Patent Document 1, no countermeasure technique for such a problem has been proposed.

  The present invention has been made in view of the above circumstances, and in the case of employing an imaging device in which color pixels and monochrome pixels are arranged, the image quality of a captured image due to a large sensitivity difference between the color pixels and the monochrome pixels. It aims at providing the technique which prevents or suppresses a fall.

According to the first aspect of the present invention, an imaging device in which a plurality of pixels including a color pixel in which a color filter is disposed and a monochrome pixel in which the color filter is not disposed are arranged in a matrix, First and second sampling circuits that sample pixel signals generated by the image sensor, and pixel signals of the monochrome pixels or color pixel pixels in which the pixel signals sampled by the sampling circuits are continuous in time series A control means for controlling the operation of the imaging device and / or each sampling circuit so as to be a signal, and provided between the imaging device and the first sampling circuit, and a pixel signal of the monochrome pixel is A first signal path that flows toward the first sampling circuit, and is provided between the imaging device and the second sampling circuit. Is, the pixel signals of the color pixels and a second signal path that flows toward the second sampling circuit, arranged corresponding to the first signal path, is output from the first sampling circuit A first amplifying unit that amplifies a pixel signal of a monochrome pixel at a preset amplification factor, and a pixel of the color pixel that is arranged corresponding to the second signal path and is output from the second sampling circuit Second amplifying means for amplifying a signal at an amplification factor different from that of the first amplifying means, and the control means is provided in the imaging element, and in the first signal path, a pixel of the monochrome pixel. The imaging unit is characterized in that only the signal of the color pixel is output to the second signal path while only the signal is output.

According to the invention, so that the pixel signals are more sampled each sampling circuits is chronologically consecutive pixel signals of the pixel signals or color pixels of the monochrome pixels, the image pickup device and / or the respective since so as to control the operation of the sampling circuits, and more sampling circuitry, forms a pixel signal having a signal level of the same level are continuously chronological order, i.e. a plurality of pixel signals generated by the plurality of color pixels Are sampled in a time-series continuous form or a plurality of pixel signals generated by a plurality of monochrome pixels in a time-series continuous form.

  Thereby, it is possible to avoid or suppress the problem of the response delay that occurs when signals having greatly different signal levels are alternately input to the sampling circuit at a high frequency.

According to the first aspect of the present invention, only the pixel signal of the monochrome pixel is sampled by the first sampling circuit, and only the pixel signal of the color pixel is sampled by the second sampling circuit. The As a result, the pixel signal sampled by each sampling circuit is the pixel signal of the monochrome pixel or the pixel signal of the color pixel continuous in time series, so that the problem of the response delay can be avoided or suppressed. it can.

According to the first aspect of the present invention, the first signal path through which the pixel signal of the monochrome pixel flows toward the first sampling circuit is disposed between the imaging device and the first sampling circuit, A second signal path through which the pixel signal of the color pixel flows toward the second sampling circuit is disposed between the image sensor and the second sampling circuit, and the control means connects the image sensor with the second signal path. Only the pixel signal of the monochrome pixel is output to one signal path, while only the pixel signal of the color pixel is output to the second signal path.

Thus, the pixel signal input to each sampling circuit via each signal path is in a form in which pixel signals of monochrome pixels or pixel signals of color pixels are continuous in time series. Thereby, the problem of the response delay can be avoided or suppressed.

According to the first aspect of the present invention, the pixel signal output from the monochrome pixel and the pixel signal output from the color pixel are amplified with different amplification factors. Both signal levels of the signal and the pixel signal output from the color pixel can be set to the same level.

The invention according to claim 2, in the image pickup unit according to claim 1, wherein the control means that causes the output of the time-divided into pixel signals between the monochrome and color pixels on the imaging device It is a feature.

  According to the present invention, the image sensor outputs the pixel signal by dividing the monochrome pixel and the color pixel in time, that is, the pixel signal generated by the color pixel after sampling the pixel signal of the monochrome pixel, for example. Since the pixel signal is sampled, the pixel signal of the monochrome pixel or the pixel signal of the color pixel can be sampled in a time series. Thus, the response delay problem can be avoided or suppressed.

According to a third aspect of the present invention, in the imaging unit according to the first or second aspect , the imaging element is a CMOS.

According to the present invention, when the image pickup device is a CMOS, the operation of the invention according to the first or second aspect can be obtained.

The invention according to claim 4, an imaging optical system for imaging an optical image of a subject, any of claims 1 to 3 including the imaging device imaging surface is disposed on the imaging plane of the imaging optical system The image pickup unit according to claim 1, input operation means for inputting an instruction to start and end an exposure operation to the image sensor, and image generation means for generating an image from a pixel signal obtained by the exposure operation of the image sensor And an image display means for displaying the image generated by the image generation unit.

According to this invention, it is possible to realize an imaging apparatus that can obtain the effects of the invention according to any one of claims 1 to 3 .

According to the first or second aspect of the present invention, it is possible to avoid or suppress the problem of response delay that occurs when signals having greatly different signal levels are alternately input to the sampling circuit. It is possible to prevent or suppress the deterioration of the image quality of the captured image.

In particular, according to the first aspect of the present invention, the signal level of the pixel signal output from the monochrome pixel and the signal level of the pixel signal output from the color pixel can be set to the same level. Large variations in luminance can be eliminated or reduced.

According to the invention described in claim 3, when the image pickup device is a CMOS, the operation in the invention described in claim 1 or 2 can be obtained.

According to the fourth aspect of the present invention, it is possible to realize an imaging apparatus capable of preventing or suppressing deterioration in image quality of a captured image caused by the response delay.

  An embodiment of an imaging apparatus according to the present invention will be described. FIG. 1 is a front view of the imaging apparatus 1, and FIG. 2 is a rear view of the imaging apparatus 1.

  As shown in FIGS. 1 and 2, the imaging apparatus 1 includes a power button 2, a photographing optical system 3, an LCD (Liquid Crystal Display) 4, an optical finder 5, a built-in flash 6, and a mode setting switch 7. A quadruple switch 8 and a shutter button 9 are provided.

  The power button 2 is used to switch on / off the power of the imaging apparatus 1. The photographic optical system 3 includes a zoom lens, an unillustrated mechanical shutter, and the like, and forms an optical image of a subject on an imaging surface of an imaging element 10 (see FIG. 3) such as a CCD (Charge Coupled Device). It is.

  The LCD 4 displays a live view image and an image (recorded image) recorded in an external storage unit 21 (see FIG. 3), which will be described later, and reproduces and displays an image recorded in the external storage unit 21. The live view image is a series of images that are switched and displayed on the LCD 4 at a constant cycle (1/30 second) until the subject image is recorded. The live view image allows the subject state to be substantially real-time. The photographer can check the state of the subject on the LCD 4. Instead of the LCD 4, an organic EL or plasma display device may be used.

  The optical viewfinder 5 enables optical observation of a range where a subject is photographed. The built-in flash 6 irradiates the subject with illumination light by discharging a discharge lamp (not shown) when the exposure amount to the image sensor 10 is insufficient.

  The mode setting switch 7 reproduces on the LCD 4 a “still image shooting mode” for shooting a still image of the subject image, a “moving image shooting mode” for shooting a moving image of the subject image, and a shot image recorded in the external storage unit 21. This is a switch for switching the mode between the “playback mode” to be displayed. The mode setting switch 7 is a three-contact slide switch that slides in the vertical direction. When the switch is set down, the image pickup apparatus 1 is set in the playback mode. When the switch is set at the center, the still image shooting mode is set. The shooting mode is set.

  Although not described in detail, the quadruple switch 8 sets a menu mode for setting various functions, moves the zoom lens in the optical axis direction, exposure correction, frame-by-frame feeding of a recorded image to be reproduced on the LCD 4, etc. It is a switch for performing.

  The shutter button 9 is a button that is pressed in two stages (half-press and full-press), and is used to instruct the timing of exposure control. The imaging apparatus 1 has a still image shooting mode for shooting a still image and a moving image shooting mode for shooting a movie, and the shutter button 9 is not operated when the still image shooting mode and the movie shooting mode are set. Then, an optical image of the subject is captured every 1/30 (seconds), and a live view image is displayed on the LCD 4.

  In the still image shooting mode, when the shutter button 9 is half-pressed, the camera is set to an imaging standby state in which exposure control values (shutter speed and aperture value) are set, and the full-press operation is performed. As a result, an exposure operation (recording exposure operation) by the image sensor 10 for generating an image of a subject to be recorded in the external storage unit 21 is started.

  In the moving image shooting mode, the shutter button 9 is fully pressed to start the recording exposure operation, the pixel signals are periodically taken out, images are sequentially generated from the pixel signals, and the full press operation is performed again. As a result, the recording exposure operation is stopped.

  FIG. 3 is a block configuration diagram showing an electrical configuration of the imaging apparatus 1. In the figure, the same members as those shown in FIGS. 1 and 2 are denoted by the same reference numerals.

  The imaging apparatus 1 includes an imaging optical system 3, an LCD 4, an imaging device 10, first and second sampling circuits 11 and 12, first and second amplifying units 13 and 14, and first and second A / D. Conversion units 15 and 16, a timing generator 17, an image memory 18, a VRAM (Video Random Access Memory) 19, an input operation unit 20, an external storage unit 21, and a control unit 22 are configured. .

  The photographing optical system 3 corresponds to the photographing optical system 3 shown in FIG. 1, and includes a zoom lens, a mechanical shutter, and the like as described above. The LCD 4 corresponds to the LCD 4 shown in FIG.

  The imaging element 10 is a CCD color area sensor in which a plurality of photoelectric conversion elements (hereinafter referred to as pixels) constituted by, for example, photodiodes are two-dimensionally arranged in a matrix.

  As shown in FIG. 4, the image sensor 10 of the present embodiment includes pixels (hereinafter referred to as color) in which R (red), G (green), and B (blue) color filters having different spectral characteristics are arranged on the light receiving surface. Pixels) and pixels (hereinafter referred to as “monochrome pixels” in which the characters “R”, “G”, and “B” are not represented in FIG. 4), and R ( A plurality of color pixels of red, G (green), and B (blue) are regularly dispersed and arranged in a plurality of monochrome pixels.

  That is, in the pixel arrangement example shown in FIG. 4, attention is paid to a part of the light receiving area (area consisting of 9 columns × 16 columns) on the light receiving surface of the image sensor 10, and X− When Y2D coordinates are set with the pixel located at the upper left as the origin (0, 0), the color pixel of R (red) is arranged at the position (x, y is an integer) represented by (4x, 4y) Has been. The G (green) color pixel is at a position represented by (4x + 2, 4y) or (4x, 4y + 2), and the B (blue) color pixel is at a position represented by (4x + 2, 4y + 2). All other pixels are arranged as monochrome pixels. As shown in FIG. 5, the sensitivity of the monochrome pixel is, for example, four times that of the color pixel.

  The image sensor 10 converts a light image of a subject formed by the photographing optical system 3 into an analog electric signal, and outputs the electric signal as a pixel signal. It should be noted that color information is obtained from analog signals of R (red), G (green), and B (blue) color components based on pixel signals output from color pixels, and luminance information is obtained from analog signals output from monochrome pixels. Information is obtained respectively.

  As shown in FIG. 6, the image sensor 10 of the present embodiment has the pixel (the color pixel and the monochrome pixel) 24 and the charge accumulated by the pixel 24 in the vertical direction (interline direction indicated by arrow Y <b> 2 in FIG. 6). ) And a horizontal register 26 for transferring the charges transferred to the vertical register 25 in the horizontal direction.

  The charges accumulated in each pixel are transferred to the vertical register 25 by a vertical synchronization signal, and the charges transferred to each vertical register 25 are vertically directed toward the horizontal register 26 in order from a pixel close to the horizontal register 26 by a horizontal synchronization signal. Forwarded in the direction. The charges transferred to the horizontal register 26 are transferred in the horizontal direction toward the first and second sampling circuits 11 and 12 in order from the pixel 24 close to the output terminal of the image sensor 10.

  The imaging operation such as reading (horizontal synchronization and vertical synchronization) of the output signal of each pixel in the image sensor 10 and the start and end timing of the exposure operation by the image sensor 10 are controlled by a timing generator 17 and the like which will be described later. The

  Returning to FIG. 3, the first and second sampling circuits 11 and 12 once capture the pixel signal output from the image sensor 10 as described above, and sample some pixel signals from the captured pixel signal. Is. In the present embodiment, a plurality of (two in this embodiment) sampling circuits are provided in order to solve the above-described response delay problem caused by a large sensitivity difference between the color pixel and the monochrome pixel. With these sampling circuits, among the pixel signals output from the image sensor 10, the pixel signals of the group including the pixel signal of the color pixel and the pixel signals of the group not including the pixel signal of the color pixel are sampled by different sampling circuits. It has the feature in the place where it is made to do. Sampling operations by the first and second sampling circuits 11 and 12 are controlled by the control unit 22 described later via the timing generator 17, which will be described later. Note that the first and second sampling circuits 11 and 12 also reduce noise of the sampled pixel signal.

  The first and second amplifying units 13 and 14 perform level adjustment on the pixel signal after the noise reduction processing output from the first and second sampling circuits 11 and 12. As described above, since the sensitivity of the monochrome pixel is, for example, four times that of the color pixel, the amplification factor of the second amplification unit 14 is set to about four times the amplification factor of the first amplification unit 13 so that the monochrome pixel has a sensitivity. The level of the pixel signal of the pixel (signal level) and the level of the pixel signal of the color pixel (signal level) can be made the same level. Thereby, it is possible to avoid or suppress the occurrence of luminance variations in the image due to the sensitivity difference between the monochrome pixel and the color pixel.

  The first and second A / D converters 15 and 16 are composed of a plurality of bits (for example, 10 bits) for the analog R, G, and B pixel signals output from the first and second amplifiers 13 and 14. Each is converted into a digital pixel signal (hereinafter referred to as pixel data).

  Based on the reference clock CLK 0 transmitted from the control unit 22, the timing generator 17 controls the readout of the drive control signal for the image sensor 10, for example, the timing signal for integration start / end (exposure start / end), and the light reception signal of each pixel. A clock signal CLK 1 such as a signal (horizontal synchronization signal, vertical synchronization signal, etc.) is generated, and this clock signal CLK 1 is output to the image sensor 10. Similarly, the timing generator 17 generates clock signals CLK2 and CLK3 such as timing signals related to the sampling operation of the first and second sampling circuits 11 and 12 based on the reference clock CLK0, and the clock signals CLK2 and CLK3 are generated. While outputting to the 1st, 2nd sampling circuits 11 and 12, clock signals CLK4 and CLK5 such as timing signals related to the A / D conversion operations of the first and second A / D conversion units 15 and 16 are generated, and this clock The signals CLK4 and CLK5 are output to the first and second A / D converters 15 and 16.

  The image memory 18 temporarily stores the image data output from the first and second A / D conversion units 15 and 16 in the shooting mode, and performs various processes on the image data by the control unit 22. A memory used as a work area. Further, in the playback mode, the memory temporarily stores image data read from an external storage unit 21 described later.

  The VRAM 19 has a recording capacity for image signals corresponding to the number of pixels of the LCD 4 and is a buffer memory for pixel data constituting an image reproduced and displayed on the LCD 4. The input operation unit 20 includes the shutter button 9, the quadruple switch 8, the power button 2, and the mode setting switch 7, and inputs the operation information to the control unit 22. The external storage unit 21 includes a memory card, a hard disk, and the like, and stores an image generated by the control unit 22.

  The control unit 22 includes a microcomputer having a built-in storage unit such as a ROM that stores a control program or a flash memory that temporarily stores data, and controls the driving of each member in the imaging apparatus 1 in association with each other. Thus, the imaging operation of the imaging apparatus 1 is comprehensively controlled.

  The control unit 22 also performs black level correction for correcting the black level to the reference black level, and white balance adjustment for converting the level of digital signals of R (red), G (green), and B (blue) color components. , R (red), G (green), and B (blue) image processing unit (not shown) that performs γ correction for correcting the γ characteristics of digital signals of each color, and the image processing unit performs the above various processes. The compressed image data is generated by subjecting the pixel data of the recorded image to predetermined compression processing by JPEG (Joint Picture Experts Group) method such as two-dimensional DCT (Discrete Cosine Transform) conversion and Huffman coding. It functions as an image compression unit (not shown) that records in the external storage unit 21 an image file in which information (information such as a compression rate) related to the captured image is added to the image data.

  Further, the control unit 22 also has a function as a sampling control unit 23 that controls the sampling operation of the first and second sampling circuits 11 and 12 via the timing generator 17. Hereinafter, sampling operations of the first and second sampling circuits 11 and 12 controlled by the sampling controller 23 will be described with reference to FIGS. 4, 6, and 7.

  Now, assuming that the vertical transfer direction and the horizontal transfer direction of the pixel signal generated in each pixel shown in FIG. 4 correspond to those shown in FIG. 6, the output of the pixel signal generated in each pixel shown in FIG. The order is as shown in FIG.

  7A pays attention to some of the pixels shown in FIG. 4 (pixels belonging to the lower horizontal pixel column shown in FIG. 7A), and the pixels generated by this pixel. It is the figure which showed the output order of the signal, and has shown that it outputs from the image pick-up element 10 in an order from the left side.

  As shown in FIG. 4, in order to identify each pixel of the image sensor 10, a number is assigned to the partial pixel. That is, for R (red) pixels, “R1”, “R2”,..., For G (green) pixels, “G1”, “G2”,. It is assumed that “B1”, “B2”,... Are assigned to the blue pixels, and only numbers are assigned in order from 1 to the monochrome pixels.

  At this time, the output order of the pixel signals output from the image sensor 10 in the pixels assigned with these numbers is as shown in FIG. 4 corresponds to the pixel signal labeled “G1” in FIG. 7A. For example, the pixel signal labeled “G1” in FIG. The pixel signal of the numbered pixel corresponds to the pixel signal in which only the number “1” in FIG.

  In the present embodiment, one of the pixel signals output from the image sensor 10 when the plurality of pixels in the image sensor 10 are divided into two groups each including a plurality of vertical pixel columns arranged every other column. The first sampling circuit 11 samples the pixel signal generated by the pixels belonging to this group, and the second sampling circuit 12 samples the pixel signal generated by the pixels belonging to the other group. That is, as shown in FIG. 4, the first sampling circuit 11 samples the pixel signal of the pixel surrounded by the dotted line shown in FIG. 4, while the second sampling circuit 12 detects the pixel signal not surrounded by the dotted line. The pixel signal is sampled.

  Therefore, when the pixel signals sampled by the first sampling circuit 11 are listed from the left in the order of sampling, as shown in FIG. 7B, “1”, “2”, “3”, “4”, “5” , “6”, “7”, “8”, “9”, “11”, “13”, “15”, “17”, and “19”, the pixel signals of the monochrome pixels are arranged. Further, when pixel signals sampled by the second sampling circuit 12 are listed from the left in the sampling order, as shown in FIG. 7C, “G1”, “R1”, “G2”, “R2”, “ The pixel signals of the color pixels numbered “G3”, “R3”, “G4”, “R4” are arranged in this order, and then “10”, “12”, “14”, “16”, “ Pixel signals of monochrome pixels numbered “18” and “20” The aspect alongside.

  As a result, since the pixel to be processed by the first sampling circuit 11 is only a monochrome pixel, the problem of the response delay caused by the sensitivity difference between the color pixel and the monochrome pixel does not occur.

  In addition, although the pixel to be processed by the second sampling circuit 12 is both a color pixel and a monochrome pixel, the color pixel and the monochrome pixel are switched in units of a predetermined number (eight in FIG. 7). For this reason, in each cycle in which the sampling target is switched between the monochrome pixel and the color pixel, pixel signals having the same signal level are continuously sampled in time series, so that the response delay hardly occurs. Therefore, the frequency of occurrence of the response delay can be greatly reduced as compared with the case where the color pixel and the monochrome pixel are switched one by one.

  As a result, since a signal faithful to the pixel signal generated at each pixel is output from the first and second sampling circuits 11 and 12, the first and second A / D converters 15 and 16 can appropriately perform A / D. A conversion value is obtained, and deterioration of the image quality of the captured image due to the response delay can be avoided or reduced.

  In the configuration described above, the second sampling circuit 12 samples the pixel signal of the monochrome pixel and the pixel signal of the color pixel. However, the second sampling circuit 12 includes almost all the pixels output from the image sensor 10. Of the signals, only the pixel signal of the color pixel may be selected and used for sampling, and the first sampling circuit 11 may be used for selecting and sampling only the pixel signal of the monochrome pixel. In this way, the response delay caused by the switching in units of the predetermined number (eight in FIG. 7) can be eliminated.

  This case includes modifications described in the following [1] to [4] in addition to the above embodiment or instead of the above embodiment.

  [1] In the first embodiment, the first and second sampling circuits 11 and 12 once capture substantially all of the pixel signals output from the image sensor 10 and then sample each of the sampling circuits 11 and 12. Although the configuration is such that the pixel signal to be selected is selected and sampled, when outputting the pixel signal from the image sensor 10, the pixel signal may be output by dividing the output destination. FIG. 8 is a block configuration diagram showing an electrical configuration of the imaging apparatus 1 in the present embodiment. In the figure, members having substantially the same configuration as in the first embodiment are assigned the same numbers as in the first embodiment.

  In the imaging apparatus 1 of the present embodiment, as shown in FIG. 8, first and second sampling circuits 11 ′ and 12 ′ are provided as well as the first embodiment, and from the imaging element 10 ′. A first signal line (signal path) L1 to the first sampling circuit 11 ′ and a signal line (signal path) L2 from the image sensor 10 ′ to the second sampling circuit 12 ′ are provided, and are monochrome pixels. The generated pixel signal is output to the first sampling circuit 11 ′ via the signal line L1, and the pixel signal generated by the color pixel is output to the second sampling circuit 12 ′ via the signal line L2. ing.

  FIG. 9 is a diagram illustrating a configuration of the image sensor 10 ′ corresponding to such a pixel signal output form. As shown in FIG. 9, the imaging device 10 ′ of the present embodiment has a plurality of output terminals (not shown) (two in the present embodiment) and corresponds to the output terminals in the horizontal direction. A plurality of horizontal transfer units (first and second horizontal transfer units 27 and 28) each including a plurality of horizontal registers arranged side by side are provided.

  Further, when a plurality of pixels of the image sensor 10 ′ are divided into two groups composed of a plurality of vertical pixel columns arranged every other column, each group is associated with each horizontal transfer unit 27 and 28. That is, if the vertical pixel columns shown in FIG. 9 are numbered sequentially from the left side, the pixels belonging to the vertical pixel columns located in the first, third, and fifth columns are stored in the first horizontal transfer unit 27 as pixels. On the other hand, the pixels belonging to the vertical pixel columns located in the second, fourth, and sixth columns output pixel signals to the second horizontal transfer unit 28.

  Then, the first horizontal transfer unit 27 outputs the transferred pixel signal to the first sampling circuit 11 through the signal path L1, and the second horizontal transfer unit 28 outputs the transferred pixel signal. The signal is output to the second sampling circuit 12 via the signal path L2.

  Therefore, among the pixels shown in FIG. 9, “R1” to “RY” for the R (red) color pixels belonging to the three horizontal pixel columns located on the upper side and the three horizontal pixel rows located on the lower side, respectively. The numbers “G1” to “GX” are assigned to G (green) color pixels, “B1” to “BY” are assigned to B (blue) color pixels, and “B1” to “BY” are assigned to monochrome pixels. Assume that numbers “1” to “Z” are assigned respectively, and pixel signals sampled by the first sampling circuit 11 ′ are listed from the left in the order of sampling, as shown in FIG. ”,“ G1 ”,“ R2 ”numbered color pixel pixel signals are arranged in this order, followed by“ 4 ”,“ 6 ”,“ 8 ”numbered monochrome pixel pixel signals. Are arranged in this order, then "G2", "B1" The pixel signal of the color pixels numbered as "G3" are lined up in this order. The pixel signals of the color pixels numbered “B (Y-1)”, “G (X-2)”, and “BY” are arranged in this order, and “Z-8”, “Z-6” are arranged. ”,“ Z-4 ”numbered monochrome pixel pixel signals are arranged in this order, and then“ G (X−1) ”,“ RY ”,“ GX ”numbered color pixel signals are arranged. Pixel signals are arranged in this order.

  On the other hand, when the pixel signals sampled by the second sampling circuit 12 ′ are listed from the left in the order of sampling, as shown in FIG. 10B, “Z-2”, “Z-1”, “Z”, “Z-7”, “Z-5”, “Z-3”, “Z-11”, “Z-10”,..., “10”, “11”, “12”, “5”, “ The pixel signals of the monochrome pixels numbered 7, 9, 1, 2, and 3 are arranged in this order.

  As a result, the pixel to be processed by the second sampling circuit 12 'is only a monochrome pixel, and the above-described problem of response delay does not occur. In addition, although the pixel to be processed by the first sampling circuit 11 ′ is both a color pixel and a monochrome pixel, the color pixel and the monochrome pixel are switched in units of a predetermined number (three in FIG. 10A). Therefore, in each cycle in which the sampling target is switched between a monochrome pixel and a color pixel, the pixel signal having the same signal level is sampled continuously in time series, so that the response delay hardly occurs. Therefore, the frequency of occurrence of the response delay can be greatly reduced as compared with the case where the color pixel and the monochrome pixel are switched one by one.

  As a result, since a signal faithful to the pixel signal generated at each pixel is output from the first and second sampling circuits 11 and 12, the first and second A / D converters 15 and 16 can appropriately perform A / D. A conversion value is obtained, and deterioration of the image quality of the captured image due to the response delay can be avoided or reduced.

  As described above, the first and second sampling circuits 11 ′ and 12 ′ can be used in addition to the configuration in which the pixel signals to be sampled by the first and second sampling circuits 11 and 12 are selected as in the first embodiment. The same effect as that of the first embodiment can be obtained by preliminarily distributing pixel signals to be output in the image sensor 10 ′ and outputting them to the first and second sampling circuits 11 ′ and 12 ′. Obtainable.

  [2] In the first embodiment and the modified embodiment [1], the CCD is used as the imaging device, but a CMOS (Complementary Metal Oxide Semiconductor) may be used. FIG. 11 is a diagram illustrating an electrical configuration of the imaging apparatus 100 according to the present embodiment. In addition, the same number is attached | subjected about the member etc. which have a function substantially the same as the said 1st Embodiment.

  As shown in FIG. 11, in the imaging apparatus 100 of the present embodiment, the imaging element 101 is configured with a CMOS. Here, a CMOS pixel configuration will be described. FIG. 12 is a diagram illustrating a configuration of a CMOS pixel.

  As shown in FIG. 12, each pixel of the CMOS includes a photodiode 1011 as a photoelectric conversion element that performs a photoelectric conversion operation, and a plurality of transistors Tr1 to Tr4. The input terminal of the transistor Tr1 is connected to the power supply Vcc, the control terminal is connected to a vertical register (not shown), and the output terminal is connected to the input terminal of the transistor Tr2. The control terminal of the transistor Tr2 is connected to the timing generator 103 (see FIG. 11) having the same function as the timing generators 17 and 17 'described above, and the output terminal is connected to the cathode of the photodiode 1011.

  The input terminal of the transistor Tr3 is connected to the power supply Vcc, the control terminal is connected to the connection point A between the transistors Tr1 and Tr2, and the output terminal is connected to the input terminal of the transistor Tr4. The control terminal of the transistor Tr4 is connected to the timing generator 103, and the output terminal is connected to the output terminal of the element via an amplifier (not shown). The anode of the photodiode 1011 is connected to the ground.

  The transistor Tr1 functions as a reset switch, the transistor Tr2 functions as a switch that determines the timing for transferring the charge accumulated in the photodiode 1011 to the transistor Tr3, and the transistor Tr3 is connected to the photodiode 1011 via the transistor Tr2. It functions as an amplifying element that converts the output charge into a voltage and amplifies it. The transistor Tr4 functions as a switch for selecting a target pixel for outputting a pixel signal.

  In the pixel having such a configuration, the transistor Tr2 is turned on, the transistor Tr1 is turned on, and then the transistor Tr4 is turned on, whereby a reset operation for discharging the charge accumulated in the photodiode 1011 is performed, while the transistor Tr2 Is turned on, the transistor Tr1 is turned off, and then the transistor Tr4 is turned on, whereby the charge accumulated in the photodiode 1011 is read out as a pixel signal constituting the image.

  As described above, the CMOS can take out a pixel signal from an arbitrary pixel by appropriately setting a signal to be output to the control terminals of the transistors Tr1, Tr2, and Tr4. By using this, in the present embodiment, pixel signals from each pixel of the CMOS may be read as follows.

  For example, the pixels of the image sensor 101 may be grouped into a group of monochrome pixels and a group of color pixels, and a pixel signal read operation for each pixel may be performed according to the read order set for these groups. .

  That is, for example, as shown in FIG. 13, P0, P1, P2, P3, P4,..., Pn-4, Pn-3, Pn-2, Pn-1, and Pn are assigned, and L0, L1, L2, L3,..., Lm-3, Lm-2, and Ln-1 are sequentially arranged from the upper side with respect to the horizontal pixel column. , Lm, first, (L0, P1) → (L0, P3) → ... → (L0, Pn-3) → (L0, Pn-1) → (L1, P0) → (L1, P1) → (L1, P2) → (L1, P3) → (L1, P4) →... → (L1, Pn-4) → (L1, Pn-3) → (L1, Pn-2) ) → (L1, Pn−1) → (L1, Pn) →... Are read out in the order of monochrome pixels, and then (L0, P0) → (L0 (P2) → (L0, P4) →... → (L0, Pn-4) → (L0, Pn-2) → (L0, Pn) → (L2, P0) → (L2, P2) → (L2, It can be assumed that the pixel signals are read from the color pixels in the order of (P4) →... → (L2, Pn-4) → (L2, Pn-2) → (L2, Pn) →.

  Note that the arrows shown for the upper horizontal pixel column in FIG. 13 indicate the readout order of the pixel signals for the monochrome pixels, and the arrows shown for the lower horizontal pixel column indicate the color. This shows the reading order of pixel signals for pixels.

  As a result, each pixel signal of a monochrome pixel and each pixel signal of a color pixel can be output from the image sensor 101 in a time-sequentially continuous form, so that it is generated by the image sensor 101 as shown in FIG. Only one sampling circuit, amplification unit, and A / D conversion unit for sampling pixel signals are required (sampling circuit 102, amplification unit 13 and A / D conversion unit 15 in FIG. 11), and the first embodiment. As compared with the above, the configuration of the image sensor 10 can be simplified.

  Since each pixel signal of the monochrome pixel and each pixel signal of the color pixel can be output to the sampling circuit 102 in a time-series continuous form, the problem relating to the response delay can be eliminated or reduced. it can.

  Here, the pixel signal of the monochrome pixel is read prior to the color pixel, but the pixel signal of the color pixel may be read before the pixel signal of the monochrome pixel. However, if there is a relatively long time difference between the time when the reading of the pixel signal to the image sensor 101 is started and the time until the reading of the pixel signal ends, a period corresponding to this time difference. In addition, since a dark current is generated in a pixel whose pixel signal is read out later, if the pixel signal is read out from a pixel having a poor S / N ratio, the adverse effect on the image quality due to the dark current is reduced. can do. In general, a color pixel has a lower (bad) S / N ratio than a monochrome pixel.

  In addition to the pixel signal readout mode shown in FIG. 13, as shown in FIG. 14, each pixel of the image sensor 101 is divided into a group of monochrome pixels, a group of R (red) color pixels, and a group of G (green) color pixels. A group and a group of B (blue) color pixels may be grouped, and a pixel signal generated in each pixel may be read in accordance with a reading order set for these groups.

  For example, the sampling circuit 102 reads pixel signals from all monochrome pixels, reads pixel signals from G (green) color pixels, reads pixel signals from R (red) color pixels, and then reads B ( A mode in which a pixel signal is read from a blue color pixel can be assumed as an example.

  That is, as shown in FIG. 14, the sampling circuit 102 includes (L0, P1) → (L0, P3) →... → (L0, Pn−3) → (L0, Pn−1) → (L1, P0). ) → (L1, P1) → (L1, P2) → (L1, P3) → (L1, P4) →... → (L1, Pn-4) → (L1, Pn-3) → (L1, Pn -2) → (L1, Pn-1) → (L1, Pn) →... After reading out pixel signals from the monochrome pixels, (L0, P2) →... → (L0, Pn-4) → (L0, Pn) → (L2, P0) → (L2, P4) → (L2, Pn-2) → ... → (Lm-3, P2) → ... → (Lm-3, Pn- 4) → (Lm−3, Pn) → (Lm−1, P0) → (Lm−1, P4) → (Lm−1, Pn−2) in order of pixel signals from G (green) color pixels. Out look.

  After that, the sampling circuit 102 (L0, P0) → (L0, P4) →... → (L0, Pn−2) →... → (Lm−3, P0) → (Lm−3, After reading pixel signals from R (red) color pixels in the order of (P4) →... → (Lm-3, Pn-2), (L2, P2) → (L2, Pn-4) →. → (L2, Pn) → ... → (Lm-1, P2) → ... → (Lm-1, Pn-4) → (Lm-1, Pn) in order of R (red) color pixels Read the pixel signal.

  Also by this, each pixel signal of monochrome pixels and each pixel signal of color pixels are output to the sampling circuit 102 in a time-series continuous form, so that the problem relating to the response delay is solved or reduced. Can do. Note that the pixel signal generated by the monochrome pixel may be read after the pixel signal generated by the color pixel.

  Further, in addition to the readout modes shown in FIGS. 13 and 14, each pixel of the image sensor 101 is grouped into two groups each composed of a plurality of vertical pixel columns arranged every other column, and each group is set. The pixel signal generated in each pixel may be read according to the reading order.

  For example, as shown in FIG. 15, (L0, P0) → (L0, P2) → (L0, P4) →... → (L0, Pn-4) → (L0, Pn-2) → (L1, Pn ) → (L1, P0) → (L1, P2) → (L1, P4) →... → (L1, Pn-4) → (L1, Pn-2) → (L1, Pn) →. After sequentially reading out pixel signals from pixels belonging to one group, (L0, P1) → (L0, P3) →... → (L0, Pn-3) → (L0, Pn−1) → (L1, Pixel signals are read from the pixels belonging to the other group in the order of P1) → (L1, P3) →... → (L1, Pn-3) → (L1, Pn−1) →.

  Also by this, each pixel signal of monochrome pixels and each pixel signal of color pixels are output to the sampling circuit 102 in a time-series continuous form, so that the problem relating to the response delay is solved or reduced. Can do.

  [3] In the modification, the pixel signals of the monochrome pixels and the pixel signals of the color pixels are output to the sampling circuit 102 in a time-series continuous form, but the present invention is not limited to this. As in the embodiment shown in FIG. 2, each pixel type (monochrome pixel and R (red), G (green), and B (blue) color pixels) includes a sampling circuit, an amplification unit, and an A / D conversion unit, The pixel signals to be output to the first and second sampling circuits 11 ′ and 12 ′ may be distributed in advance in the image sensor 10 ′ and then output to the corresponding sampling circuit.

  FIG. 16 is a block diagram illustrating an electrical configuration of the imaging apparatus 200 of the present embodiment. The imaging apparatus 200 is different from the first embodiment in that the imaging element 201 is a CMOS and includes a sampling circuit corresponding to the type of pixel as described above, and the other points are substantially the same. Therefore, only the differences will be described. Note that members having the same functions as those in the first embodiment are denoted by the same reference numerals.

  As illustrated in FIG. 16, the imaging apparatus 200 includes first to fourth samplings corresponding to the monochrome pixels of the imaging element 201 and the color pixels of R (red), G (green), and B (blue). Circuits 202 to 205, first to fourth amplifiers 206 to 209, and first to fourth A / D converters 210 to 213 are provided, and pixel signals generated by each type of pixel are different signals. The signal is output to a corresponding sampling circuit via paths (signal lines) L1 to L4. The functions of the first to fourth sampling circuits 202 to 205, the first to fourth amplification units 206 to 209, and the first to fourth A / D conversion units 210 to 213 are substantially the same as those in the first embodiment. It is.

  FIG. 17 is a diagram illustrating a configuration of the image sensor 201 in the present embodiment.

  In the imaging device 201 of the present embodiment, as shown in FIG. 17A, the pixel configuration is substantially the same as the pixel configuration shown in FIG. 12 described in the modification [2], but FIG. ), Signal lines L1 to L4 are provided according to the type of pixel, and the output terminal of the transistor Tr4 in each pixel is connected to a different signal line for each type of pixel. The generated pixel signal is output to a corresponding sampling circuit via a signal line connected to the pixel.

  That is, the output terminal of the transistor Tr4 in the monochrome pixel (the pixel indicated by the letter “L”) shown in FIG. 17B is connected to the signal line L1, and the pixel signal generated by the monochrome pixel is the signal line L1. To the first sampling circuit 202. The output terminal of the transistor Tr4 in the R (red) color pixel is connected to the signal line L2, and the pixel signal generated in the R (red) color pixel is connected to the second sampling circuit 203 via the signal line L2. The output terminal of the transistor Tr4 in the G (green) color pixel is connected to the signal line L3, and the pixel signal generated in the G (green) color pixel is third sampled via the signal line L3. The output terminal of the transistor Tr4 in the B (blue) color pixel is connected to the signal line L4, and the pixel signal generated in the B (blue) color pixel is output via the signal line L4. 4 is output to the sampling circuit 205.

  In the modification [3], there is a state in which the pixel signal readout target is switched from a monochrome pixel to a G (green) color pixel, and thus the response delay occurs at the time of this switching. For example, since the pixel signals generated by each type of pixel are completely separated for each type of pixel and then output to the corresponding sampling circuit, there is no state in which the above-described pixel signal is switched, and the response delay It is possible to completely solve the problem related to

  [4] The arrangement form of the monochrome pixels and the color pixels is not limited to that shown in FIG. 4, and for example, the following arrangement form may be adopted.

  The arrangement form of the color pixels shown in FIG. 18 is a pixel group having R (red), G (green), and B (blue) color pixels in a predetermined number for each type of color filter. Each set shows an example in which the pixels are dispersedly arranged via monochrome pixels, and a color pixel group composed of four color pixels is arranged via a predetermined number (4 in FIG. 18) of monochrome pixels. In addition, the color pixels of R (red), G (green), and B (blue) are arranged in a Bayer array at a ratio of 1: 2: 1 in each color pixel group.

  In the arrangement form of the color pixels shown in FIG. 19, when numbers are assigned in the horizontal direction and the vertical direction sequentially from the upper left pixel, the positions (coordinates) in the horizontal direction and the vertical direction are (4m + 1, 4n + 1) (m and n are integers). ), Or color pixels are arranged at positions where the horizontal and vertical positions are represented by (4m + 3, 4n + 3) (m and n are integers), and the same color in the horizontal direction. Are arranged such that R (red), G (green), and B (blue) color pixels are repeatedly arranged in order in the vertical direction.

  The color pixel arrangement form shown in FIG. 20 is such that the color pixels are arranged through a predetermined number (two in FIG. 20) of monochrome pixels in the vertical and horizontal directions, and the horizontal and vertical directions in which the color pixels are arranged. When paying attention to the pixel column, the color pixels of R (red), G (green), and B (blue) are arranged in such a way as to be repeatedly arranged in any direction.

  The color pixel arrangement form shown in FIG. 21 is represented by (4m + 1, 4n + 1) (m and n are integers) when the numbers in the horizontal direction and the vertical direction are assigned in order from the upper left pixel. Color pixels are disposed at positions where horizontal positions and vertical positions are represented by (4m + 3, 4n + 3) (m and n are integers), and color pixels of the same color are disposed in the vertical direction. In the horizontal direction, R (red), G (green), and B (blue) color pixels are arranged so as to be repeatedly arranged in order.

  The color pixel arrangement form shown in FIG. 22 is a vertical arrangement in which R (red), G (green), and B (blue) color pixels are arranged at corners so as to be a Bayer arrangement when focusing only on color pixels. A plurality of n (number) × n-width (n) pixel groups (n is 3 in FIG. 22) are arranged in a horizontal direction via predetermined pixel rows (5 rows in FIG. 22). A plurality of pixel columns are arranged in a vertical direction via a predetermined number of pixel columns (three columns in FIG. 22), and the vertical n (pieces) × horizontal n (pieces) positioned vertically. ) In a positional relationship shifted by a predetermined number of pixels (one in FIG. 22) in the horizontal direction.

  In the color pixel arrangement form shown in FIG. 23, a pixel column in which color pixels of the same color are arranged in the horizontal direction via a predetermined number of monochrome pixels (two in FIG. 23) is R (red), G (green). ) And B (blue) color pixels, and pixel columns having the color pixels are arranged every n columns in the vertical direction (every other column in FIG. 23), and R ( In this configuration, the color pixels of red, G (green), and B (blue) are arranged at different positions in the horizontal direction.

  The arrangement form of the color pixels shown in FIG. 24 is a predetermined number of pixel groups in which R (red), G (green), and B (blue) color pixels are arranged one by one in the horizontal direction (three in FIG. 24). Are arranged in the horizontal direction via monochrome pixels, and a color pixel row is formed. The color pixel row is arranged in the vertical direction via a predetermined number of pixel rows (two rows in FIG. 24), and color When attention is paid only to the pixel columns, the pixel groups are alternately arranged in the horizontal direction in two color pixel columns adjacent in the vertical direction.

  The color pixel arrangement form shown in FIG. 25 is such that R (red), G (green), and B (blue) color pixels have a predetermined number of monochrome pixels (horizontal in FIG. 25) in each of the horizontal and vertical directions. 3 in the direction and 1 in the vertical direction).

  The color pixel arrangement form shown in FIG. 26 is an arrangement of R (red), G (in the vertical n (number) × n horizontal (pixel) pixel group defined when the color pixel arrangement form shown in FIG. Instead of disposing the green and B (blue) color pixels at the corners, color the pixels (pixels lined up to form a diamond) located at the center of each side of the quadrangle formed by this pixel group. This is a pixel form. In FIG. 26, in each pixel group, the pixels located at the two vertex positions on the left and right sides of the rhombus are G (green) color pixels, and the pixels located at the vertex positions on the upper side and the lower side thereof are the pixels. R (red) and B (blue) color pixels are used.

  The arrangement form of the color pixels shown in FIG. 27 is a predetermined number of pixel groups in which R (red), G (green), and B (blue) color pixels are arranged one by one in the vertical direction (three in FIG. 27). Are arranged in the vertical direction via monochrome pixels, and a color pixel row is formed. The color pixel row is arranged in the horizontal direction via a predetermined number of pixel rows (one row in FIG. 27), and color When attention is paid only to the pixel columns, the pixel groups are alternately arranged in the vertical direction in two color pixel columns adjacent in the horizontal direction.

  The arrangement of the color pixels shown in FIG. 28 is as follows: G (green) color pixels, R (red) color pixels adjacent to the color pixels on the upper side, and G (green) color pixels. A first pixel group X1 having a B (blue) color pixel located on the right side through one monochrome pixel, a G (green) color pixel, and a lower side with respect to the color pixel A second pixel having an adjacent R (red) color pixel and a B (blue) color pixel located on the right side through one monochrome pixel with respect to the G (green) color pixel The groups X2 are alternately arranged in a horizontal direction through a predetermined number of monochrome pixel rows (three rows in FIG. 28) in the two pixel rows arranged in the vertical direction. A plurality of two pixel columns having pixel groups X1 and X2 are provided in the vertical direction, and When focusing on the two upper and lower pixel groups with the two pixel columns as one pixel group, the lower pixel group has a predetermined number of pixel positions relative to the upper pixel group. In this configuration, the pixel columns (two columns in FIG. 28) are shifted in the horizontal direction (leftward in FIG. 28).

  The arrangement form of the color pixels shown in FIG. 29 is a predetermined pixel group (one in FIG. 29) in which R (red), G (green), and B (blue) color pixels are arranged one by one in the horizontal direction. A pixel row arranged in the horizontal direction is provided via monochrome pixels, and this pixel row is arranged in the vertical direction via a predetermined number of pixel rows (one row in FIG. 29), and this When attention is paid to two adjacent pixel columns among the pixel columns in which the color pixels are arranged, the pixel located at the end of each pixel group is located at the opposite end of the pixel group in the adjacent pixel row. The pixel and the pixel are arranged so as to be located at the same position in the horizontal direction.

  The arrangement form of the color pixels shown in FIG. 30 is a predetermined number of pixel groups in which R (red), G (green), and B (blue) color pixels are arranged one by one in the vertical direction (one in FIG. 30). Are arranged in a vertical direction via monochrome pixels, and the pixel rows are arranged in a horizontal direction via a predetermined number of pixel rows (one row in FIG. 30), and When attention is paid to two adjacent pixel columns among the pixel columns in which the color pixels are arranged, the pixel located at the end of each pixel group is located at the opposite end of the pixel group in the adjacent pixel row. This is a form in which the pixel and the pixel are arranged at the same position in the vertical direction.

It is a front view of an imaging device. It is a rear view of an imaging device. It is a block block diagram which shows the electrical structure of an imaging device. It is a figure which shows the arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure for demonstrating the sensitivity difference of a monochrome pixel and a color pixel. It is a block diagram of an interline type image sensor. (A) is a figure for demonstrating the order of the pixel signal output from an image pick-up element, (b) is a figure for demonstrating the order of the pixel signal sampled by a 1st sampling circuit, (c) is It is a figure for demonstrating the order of the pixel signal sampled by the 2nd sampling circuit. It is a block block diagram which shows the electrical structure of the imaging device in modification [1]. It is a figure which shows the structure of the image pick-up element corresponding to the output form of the pixel signal in modification [1]. (A) is a figure for demonstrating the order of the pixel signal sampled by the 1st sampling circuit in modification [1], (b) demonstrates the order of the pixel signal sampled by the 2nd sampling circuit. It is a figure for doing. It is a figure which shows the electrical structure of the imaging device in modification [2]. It is a figure which shows the structure of a CMOS pixel. It is a figure for demonstrating the read-out order of the pixel signal in modification [2]. It is a figure for demonstrating the reading order of the pixel signal in modification [2] similarly. It is a figure for demonstrating the reading order of the pixel signal in modification [2] similarly. It is a block diagram which shows the electric constitution of the imaging device in modification [2]. It is a figure which shows the structure of the image pick-up element in modification [2]. It is a figure which shows the other arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure which shows the other arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure which shows the other arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure which shows the other arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure which shows the other arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure which shows the other arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure which shows the other arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure which shows the other arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure which shows the other arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure which shows the other arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure which shows the other arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure which shows the other arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure which shows the other arrangement | sequence form of a color pixel and a monochrome pixel. It is a figure for demonstrating the conventional problem.

Explanation of symbols

10, 101, 201 Image sensor 11, 12, 102, 202-205 Sampling circuit 17, 103, 214 Timing generator 23 Sampling controller 1011 Photodiode

Claims (4)

An image pickup device in which a plurality of pixels including a color pixel provided with a color filter and a monochrome pixel not provided with the color filter are arranged in a matrix;
First and second sampling circuits for sampling pixel signals generated by the image sensor;
Control for controlling the operation of the imaging device and / or each sampling circuit so that the pixel signal sampled by each sampling circuit becomes the pixel signal of the monochrome pixel or the pixel signal of the color pixel that is continuous in time series. Means,
A first signal path provided between the imaging element and the first sampling circuit, and a pixel signal of the monochrome pixel flowing toward the first sampling circuit;
A second signal path that is provided between the imaging element and the second sampling circuit, and in which a pixel signal of the color pixel flows toward the second sampling circuit;
A first amplifying unit arranged corresponding to the first signal path and amplifying a pixel signal of the monochrome pixel output from the first sampling circuit at a preset gain;
Second amplifying means arranged corresponding to the second signal path and amplifying the pixel signal of the color pixel output from the second sampling circuit with an amplification factor different from that of the first amplifying means. And comprising
The control means includes
The imaging device outputs only the pixel signal of the monochrome pixel to the first signal path, and outputs only the pixel signal of the color pixel to the second signal path. unit.   The image pickup unit according to claim 1, wherein the control unit causes the image pickup element to output a pixel signal by dividing the monochrome pixel and the color pixel in time.   The imaging unit according to claim 1, wherein the imaging element is a CMOS. A photographic optical system that forms an optical image of the subject;
The imaging unit according to any one of claims 1 to 3, comprising the imaging element in which an imaging surface is disposed on an imaging surface of the photographing optical system;
Input operation means for inputting an instruction to start and end an exposure operation to the image sensor;
Image generating means for generating an image from a pixel signal obtained by an exposure operation of the image sensor;
An image display device comprising: an image display unit configured to display an image generated by the image generation unit.

Images