JP2004096790A - Electronic image pickup device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic image pickup device using a CCD image sensor of 1,000,000-pixel class capable of displaying a motion picture in a driving frequency of ≤ 20MHz. <P>SOLUTION: The interline type CCD image sensor having pixels exceeding 1,000,000 has a color filter of a Bayer arrangement suited to read all pixels by line sequential scanning. The CCD image sensor is driven in a high speed mode ordinarily and is driven in a high picture quality mode only when a trigger is pressed. In the high speed mode, the CCD image sensor adds and outputs pixel signals for vertically continued three lines. While the CCD image sensor is driven in the high speed mode, images are displayed on a liquid crystal display part in a frame rate of 60sheet/sec, and the images are recognized as a motion picture for human eyes. <P>COPYRIGHT: (C)2004,JPO

Description

The present invention relates to an electronic imaging device using a CCD image sensor, that is, an electronic still camera.

In recent years, electronic imaging devices capable of inputting image data to multimedia devices, so-called electronic still cameras, have been actively developed. An electronic still camera generally acquires an image using a CCD image sensor, displays the acquired image on an electronic viewfinder such as a liquid crystal panel, and records the image by, for example, magnetic means in response to a user pressing down a trigger. Record on the medium.

Electronic still cameras are very easy because they do not require development, but further improvements in image quality and operability are desired for future electronic still cameras. In order to respond to this demand, it is essential that an image having the same angle of view as the image to be shot can be confirmed in real time by an electronic viewfinder while using a CCD image sensor having a large number of pixels.

(4) CCD image sensors having an effective pixel number exceeding one million have been realized, and those having more pixels will be provided and put into practical use in the future. Further, among CCD image sensors for photographing still images, those in which pixel signals are read out by sequential scanning, which reads out one line at a time, instead of interlaced scanning, have become mainstream. This is to avoid a decrease in image quality due to a difference in reading time of pixel signals of adjacent lines.

Currently, the operating clock frequency of a commercially available A / D converter is about 15 to 20 MHz, and a higher driving frequency is not desirable in view of lower power consumption. The frame rate that can be realized by sequential scanning driving of a 1 million pixel class CCD image sensor at a frequency of about 15 to 20 MHz is about 10 to 15 frames / sec.

画像 Displaying an image at such a frame rate is not perceived by the human eye as a natural moving image but as a pseudo-moving image on a frame invoice. Displaying an image recognized as a natural moving image by human eyes requires a frame rate of 30 to 60 frames / sec.

An object of the present invention is an electronic image pickup apparatus using a high-pixel CCD image sensor (for example, a 1 million pixel class), which recognizes a moving image at the time of non-photographing while having a relatively low driving frequency (for example, 20 MHz or less). The present invention provides an electronic imaging device that displays an image to be displayed.

The electronic imaging apparatus according to the present invention includes a mode in which all pixel signals are taken out from the two-dimensional array of solid-state imaging devices by sequential scanning to record a still image, and a mode is added for each successive q lines in the vertical direction from the solid-state imaging device. It is characterized by having a mode for taking out the pixel signal obtained and recording a still image or processing a moving image.

Another electronic imaging apparatus according to the present invention includes a mode in which all pixel signals are taken out from a two-dimensional array of solid-state imaging devices by sequential scanning and a still image is recorded, and n lines are provided every m lines in the vertical direction from the solid-state imaging device. And a mode for taking out a pixel signal and extracting a pixel signal added for each of the continuous q lines in the vertical direction from the solid-state image sensor and recording or processing a still image. And

Another electronic imaging apparatus according to the present invention includes a mode in which all pixel signals are taken out from a two-dimensional array of solid-state imaging devices by sequential scanning and a still image is recorded, and n lines are provided every m lines in the vertical direction from the solid-state imaging device. And a mode in which a pixel signal is taken out after adding the pixel signals and a still image is recorded or processed in a moving image, and a mode in which the pixel signal added from the solid-state imaging device for every continuous q lines in the vertical direction is taken out and the still image is recorded or processed in a moving image. It is characterized by the following.

According to the present invention, the CCD image sensor is driven in a high-speed mode in which pixel signals of n lines are read every m lines in the vertical direction during non-photographing. Thus, an electronic image pickup apparatus using a 1 million pixel class CCD image sensor that displays an image recognized as an image can be obtained.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram showing a circuit configuration of an electronic imaging device according to an embodiment of the present invention. The electronic imaging device has a CCD image sensor 12, a correlated double sampling circuit (CDS) 14, a gain control amplifier (AMP) 16, and an analog-to-digital converter 18. The CCD image sensor 12 is driven according to the transfer pulse supplied from the timing generator 20, and the correlated double sampling circuit (CDS) 14 is driven according to the sample hold pulse supplied from the timing generator 20. The timing generators 20 drive in synchronization with each other according to a synchronization signal generated by the signal generator 22.

The information processing unit 26 processes the pixel signal supplied from the A / D converter 18 to form an image. The DRAM 28 temporarily stores the image data supplied from the information processing unit 26, the compression / expansion circuit 30 compresses the image data stored in the DRAM 28, and the recording medium 32 compresses the image data supplied from the compression / expansion circuit 30. The recorded image data is recorded. The compression / decompression circuit 30 decompresses the compressed image data recorded on the recording medium 32, and the DRAM 28 temporarily stores the decompressed image data supplied from the compression / decompression circuit 30.

The interface unit 36 is a terminal that enables data exchange with an external device such as a monitor or a personal computer. The interface unit 36 can output image data supplied from the information processing unit 26 or the DRAM 28 to the external device. Enables image data to be loaded into the device from an external device.

(4) The liquid crystal display unit 34 displays image data supplied from the information processing unit 26 or decompressed image data supplied from the DRAM 28.

The CPU 24 controls the timing generator 20, the signal generator 22, the lens drive system 38, and the aperture control system 42. Specifically, the drive mode of the CCD image sensor 12 is switched in accordance with a command from a trigger 46 for instructing the capture of a still image, an autofocus control for driving the lens 40 based on image data supplied from the DRAM 28, The control of changing the aperture of the aperture 44 and the control of the exposure amount of the CCD image sensor 12 are performed.

The CCD image sensor 12 is an interline CCD image sensor having more than one million pixels and has a Bayer array color filter suitable for reading all pixels by line-sequential scanning. In this specification, all-pixel reading by line-sequential scanning means reading the data of the pixels included in each line in order of the first line, the second line, the third line, and one line at a time. Means that all pixel signals are read out by the scanning of.

FIG. 2 shows the configuration of the Bayer array color filter. In the figure, R, G, and B denote filters that selectively transmit red, green, and blue, respectively, each of which is located in front of the photodiode. In this Bayer array color filter, R (red) and G (green) filters are alternately arranged in odd lines, G (green) and B (blue) filters are alternately arranged in even lines, and G ( The green filters are arranged in a checkered pattern as a whole.

(4) The CCD image sensor 12 is driven in one of the high image quality mode and the high speed mode. The switching of the drive mode is performed by changing the transfer pulse output from the timing generator 20 to the CCD image sensor 12. The high image quality mode is a driving mode in which all pixel signals of the CCD image sensor 12 are read out by line-sequential scanning, and a clear image is obtained, but it takes 1/15 to 1/10 seconds to read one image. . On the other hand, the high-speed mode is a driving mode in which the number of horizontal transfers is reduced, and is a driving mode in which pixel signals of the CCD image sensor 12 are selectively or added and read out. Can be read in 1/60 to 1/30 seconds. Therefore, an image can be obtained at a frame rate of 30 to 60 frames / second, and it is possible to support normal moving image display.

The CCD image sensor 12 is driven in the high-speed mode during normal operation, that is, during non-photographing, and is driven in high-quality mode only when the trigger 46 is depressed, that is, during photographing. While the CCD image sensor 12 is driven in the high-speed mode, an image is displayed on the liquid crystal display unit 34 at a frame rate of 30 to 60 frames / second, which is recognized as a moving image by human eyes. A clear image obtained in the high image quality mode is recorded on the recording medium 32. After the recording of the still image is completed, the reading mode of the CCD image sensor 12 returns to the high-speed mode again. This will be described later in detail with reference to FIG.

Note that the electronic imaging device may be configured to drive the CCD image sensor 12 in the high-speed mode even when the trigger 46 is depressed, unless a clear image is required to be recorded. In this case, the image displayed on the liquid crystal display unit 32 is always recognized as a moving image by human eyes.

FIG. 3 shows how pixel signals are read out in the high image quality mode. In the figure, the left column shows the pixel signals of the CCD image sensor 12 in line units, and the right column shows the pixel signals actually read out in line units. Also, in correspondence with the color filter of FIG. 2, the odd lines are represented as CR because they include red (R) color data, and the even lines are blue (B) color. It is described as CB because it contains data.

In the high image quality mode, the CCD image sensor 12 sequentially outputs pixel signals line by line. That is, the pixel signal of the first line is output first, the pixel signal of the second line is output when the output of the pixel signal of the first line is completed, and the pixel signal of the third line is output when the output of the pixel signal of the second line is completed. A pixel signal is output, and thereafter, the same processing is repeated, and finally a pixel signal of the L-th line is output.

In such line-sequential scanning, the lines (CR) containing red information and the lines (CB) containing blue information are alternately read out in association with the color filter having the Bayer arrangement, so that a high-resolution image is obtained. Is obtained. Further, since there is no difference in exposure time between pixel signals of adjacent lines, a high quality image can be obtained. However, it takes a time of 1/15 to 1/10 second to read all the pixel signals.

In the high-speed mode, various patterns can be considered depending on the reading method. More specifically, various modes are conceivable depending on how to select a line from which a pixel signal is actually read out and how to process the selected line. Hereinafter, some examples among various modes applicable to the electronic imaging apparatus will be representatively described.

FIG. 4 shows how pixel signals are read out in the first high-speed mode. In the figure, the left column shows the pixel signals of the CCD image sensor 12 in line units, and the right column shows the pixel signals actually read out in line units. Similarly to FIG. 3, a line including red (R) color data is denoted by CR, and a line including blue (B) color data is denoted by CB.

As shown in FIG. 4, in this high-speed mode, the CCD image sensor 12 sequentially outputs one line of pixel signals every two lines. In other words, one line of pixel signal is output every three lines in the vertical direction. That is, the pixel signal of the third line is output first, the pixel signal of the sixth line is output when the output of the pixel signal of the third line is completed, and the pixel signal of the ninth line is output when the output of the pixel signal on the sixth line is completed. A pixel signal is output, and thereafter, the same processing is repeated, and finally a pixel signal of the L-th line is output. FIG. 4 shows, for convenience, that the pixel signal on the L-th line is output last, in other words, L is a multiple of 3, but L is not necessarily a multiple of 3.

In general, in a CCD image sensor, the time required for horizontal transfer greatly contributes to the time required for reading pixel signals. In other words, the number of horizontal transfers determines the time required to read a pixel signal.

(4) In the high-speed mode in FIG. 4, the number of lines from which pixel signals are actually read is one third of the total. Accordingly, the number of times of horizontal transfer is one third as compared with the high image quality mode of FIG. 3, and the pixel signal is read out in substantially one third of the time. That is, a pixel signal of one image is obtained in 1/45 to 1/30 seconds. Therefore, it is possible to obtain an image at a frame rate of 30 to 45 frames / second, and this frame rate is a numerical value capable of realizing normal moving image display.

In the high-speed mode in FIG. 4, one line of pixel signal is read out for every two lines with respect to the Bayer array color filter. In other words, one line is output for every three lines in the vertical direction. Since the pixel signals are read, the read pixel signals, that is, the lines (CR) containing red information and the lines (CB) containing blue information are alternately arranged in the vertical direction in the right column of FIG. Therefore, a high-resolution image can be obtained.

In the pixel signals read out in this way, the line (CR) containing red information and the line (CB) containing blue information alternately arranged in the vertical direction are referred to as color line sequential in this specification. Also, alternate reading of the line (CR) containing red information and the line (CB) containing blue information will be referred to as color line sequential scanning.

In the high-speed mode in FIG. 4 described above, one line of pixel signal is read out for every three lines in the vertical direction, but the number of lines is not limited to this. For example, one line may be read out every five lines in the vertical direction. Alternatively, one or three lines of pixel signals may be read out every seven lines.

Also, in the case of reading out one line of pixel signal for every three lines in the vertical direction, the line to be read out is not limited to the third line. The line to be read may be the first line or the second line.

Taking these into consideration, the second high-speed mode described with reference to FIG. 4 is generalized to read out pixel signals of n lines for every m lines in the vertical direction (where m and n are both natural numbers and m> m). n is satisfied). More specifically, it can be said that the mode is a mode in which pixel signals of (2β-1) lines are read out every (2α-1) lines in the vertical direction (here, both α and β are natural numbers and satisfy α> β). In this case, the time required for reading the pixel signal is substantially n / m of the time required for reading in the high image quality mode, that is, (2β-1) / (2α-1). In addition, pixel signals are read out in color line order with respect to the Bayer array color filters.

FIG. 5 shows how pixel signals are read out in the second high-speed mode. The meaning of the drawing and the meaning of the notation of CR and CB are the same as those in FIG.

As shown in FIG. 5, in this high-speed mode, the CCD image sensor 12 sequentially outputs two lines of pixel signals every two lines. In other words, two lines of pixel signals are output every four lines in the vertical direction. That is, the pixel signal of the first line is output first, the pixel signal of the second line is output when the output of the pixel signal of the first line is completed, and the pixel signal of the fifth line is output when the output of the pixel signal of the second line is completed. A pixel signal is output, and when the output of the pixel signal of the fifth line is completed, a pixel signal of the sixth line is output. Thereafter, the same processing is repeated, and finally, an output of a pixel signal of the L-3 line is output. Subsequently, a pixel signal of the L-2 line is output. In FIG. 5, for convenience, L is depicted as being a multiple of four, but L is not necessarily a multiple of four.

(5) In the high-speed mode in FIG. 5, the number of lines from which pixel signals are actually read is one half of the total number. Therefore, the number of horizontal transfers is one half of that in the high image quality mode of FIG. 3, and the pixel signal is read out in substantially one half of the time. That is, a pixel signal of one image is obtained in 1/30 second. Therefore, it is possible to obtain an image at a frame rate of 30 frames / second, and this frame rate is a numerical value capable of realizing normal moving image display.

In the high-speed mode of FIG. 5, two lines of pixel signals are read out every two lines from the color filter of the Bayer array. In other words, two lines are read every four lines in the vertical direction. Since the pixel signal is read, the read pixel signal, that is, the right column in FIG. 5 is a color line in which lines (CR) including red information and lines (CB) including blue information are alternately arranged in the vertical direction. It is sequential. Therefore, a high-resolution image can be obtained.

(5) Further, in the high-speed mode of FIG. 5, since the pixel signals of the first and second lines are read out every four lines in the vertical direction, the read-out pixel signals include the color information of the adjacent lines. Therefore, an image with less moire can be obtained.

In the high-speed mode in FIG. 5 described above, two lines of pixel signals are read out every four lines in the vertical direction, but the number of lines is not limited to this. For example, two lines of pixel signals may be read out every six lines in the vertical direction. Alternatively, four lines of pixel signals may be read out every eight lines.

Also, in the case of reading out two lines of pixel signals every four lines in the vertical direction, the lines to be read out are not limited to the first and second lines. The second and third lines, or the third and fourth lines may be used. Alternatively, the first and fourth lines may be used.

Taking these into consideration, the second high-speed mode described with reference to FIG. 5 is generalized to read out pixel signals of n lines for every m lines in the vertical direction (where m and n are both natural numbers and m> m). n is satisfied). More specifically, it can be said that this is a mode in which pixel signals of 2β lines are read out every 2α lines in the vertical direction (here, both α and β are natural numbers and satisfy α> β). In this case, the time required for reading the pixel signal is substantially β / α of the time required for reading in the high image quality mode.

は More specifically, it can be said that the 2β line is made up of adjacent lines or lines with even-numbered lines interposed therebetween. In this case, the pixel signals are read out in a color line sequence with respect to the Bayer array color filter, and the read out pixel signals include the color information of the adjacent lines.

FIG. 6 shows how pixel signals are read out in the third high-speed mode. The meaning of the drawing and the meaning of the notation of CR and CB are the same as those in FIG.

As shown in FIG. 6, in this high-speed mode, the CCD image sensor 12 adds and outputs two lines of pixel signals for every three lines in the vertical direction. That is, first, the pixel signal of the first line and the pixel signal of the third line are added and output, then, the pixel signal of the fourth line and the pixel signal of the sixth line are added and output, and thereafter, The process is repeated, and finally, the pixel signal on the L-2 line and the pixel signal on the L line are added and output. In FIG. 6, for convenience, L is depicted as being a multiple of 3, but L is not necessarily a multiple of 3.

で は In the high-speed mode of FIG. 6, the number of lines actually read is one third of the total. Accordingly, the number of times of horizontal transfer is one third as compared with the high image quality mode of FIG. 3, and the pixel signal is read out in substantially one third of the time. A pixel signal of one image is obtained in 1/45 to 1/30 seconds. Therefore, it is possible to obtain an image at a frame rate of 30 to 45 frames / second, and this frame rate is a numerical value capable of realizing normal moving image display.

Further, in the high-speed mode in FIG. 6, two lines of pixel signals are added to every three lines in the vertical direction and read out with respect to the Bayer array color filter. The color line (CR) and the line (CB) containing blue information are arranged alternately in the vertical direction. Therefore, a high-resolution image can be obtained.

Further, in the high-speed mode of FIG. 6, since the pixel signal of the uppermost line and the pixel signal of the lowermost line are added and read every three lines in the vertical direction, the read pixel signal is Color information. Therefore, an image with less moire can be obtained.

Addition of pixel signals is performed in a vertical transfer path or a horizontal transfer path. Hereinafter, the addition in the vertical transfer path will be described first, and then the addition in the horizontal transfer path will be described.

FIG. 7 illustrates the addition of pixel signals in the vertical transfer path. In the figure, a square means a photodiode which is each pixel of the CCD image sensor, and alphabets of R, G, and B in the square mean colors recognized by the photodiode. Further, when the photodiode is divided into three lines in the vertical direction, a photodiode corresponding to a relatively same position in each of the divided lines has an uppermost line in one of the alphabets of the color, that is, R, G, or B. , A center line, and a bottom line, subscripts A, B, and C are added.

The addition of the pixel signal of the uppermost line (consisting of a photodiode indicated by an alphabet with a suffix A) and the pixel signal of the bottom line (consisting of a photodiode indicated by an alphabet with a suffix C) is performed, for example. This is performed as follows. In FIG. 7, first, the pixel signal of the photodiode having an alphabetical letter with the letter “A” is transferred to the vertical transfer path, and the charge as the pixel signal is stored in a potential well formed beside the photodiode. Thereafter, the potential well storing the charge of the pixel signal is moved down the vertical transfer path, and comes to the side of the photodiode two lines below, that is, the photodiode of the alphabet with a suffix C, and at the same time, The pixel signal of the diode, that is, the photodiode of the alphabet with the subscript C is transferred to the vertical transfer path. As a result, in the potential well (indicated by an oval encircling + in the figure), the charge transferred from the alphabetical photodiode with a suffix A and the charge transferred from the photodiode with a suffix C Are stored together. That is, the pixel signal of the photodiode on the top line and the pixel signal of the photodiode on the bottom line are added. Thereafter, the potential well storing the added pixel signal is continuously moved down the vertical transfer path, and after moving to the horizontal transfer path, is moved leftward and is read out line by line.

大 き The size of the potential well may be the same as that at the time of reading out all pixels, or may be different.

If the size of the potential well is the same as when reading all pixels, that is, if the capacity of the potential well is the same as the capacity of the photodiode when reading all pixels, adjust the substrate voltage of the overflow drain to reduce the capacity of the photodiode to the capacity of the potential well. It is preferable to change it to one-half. Stated another way, it is preferable that the photodiode be operated with a dynamic range that is one half that of reading all pixels. Such a change in the capacitance, that is, the dynamic range prevents the charge from overflowing the vertical transfer path after the addition. In this case, the dynamic range of the photodiode is limited to one half, but since the signal level after reading is the same as when reading all pixels, there is an advantage that the subsequent signal processing can be performed as it is.

Further, when the size of the potential well is different from that at the time of reading all pixels, if the photodiode is operated without changing the dynamic range, the size of the potential well is preferably twice as large as that at the time of reading all pixels. . Such setting of the size of the potential well prevents the charge from overflowing the vertical transfer path after the addition. In this case, the dynamic range of the photodiode can be fully utilized, which is advantageous in the SN ratio.

FIG. 8 is a diagram for explaining the addition of pixel signals in the horizontal transfer path. The meanings of the squares and alphabets in the figure are the same as those in FIG.

{Addition of the pixel signal of the top line and the pixel signal of the bottom line is performed as follows. In FIG. 8, first, the pixel signal of the alphabetic photodiode with the suffix A and the pixel signal of the alphabetic photodiode with the suffix C are both transferred to the vertical transfer path, and the charges as the pixel signals are transferred to the photodiode. Is stored in a potential well (shown by a white ellipse in the figure). After that, all the potential wells are uniformly moved down the vertical transfer path, and the electric charges stored in the potential well of the lowest line among the three divided lines are formed in the potential wells formed in the horizontal transfer path ( (Shown by an ellipse surrounding + in the figure), the downward movement of the potential well is continued for two lines, and the electric charge stored in the potential well of the uppermost line among the three lines is divided. Move to the potential well formed in the horizontal transfer path. As a result, in the potential well in the horizontal transfer path, the charges transferred from the alphabetical photodiodes with the suffix A and the charges transferred from the alphabetic photodiodes with the suffix C are stored. That is, the pixel signal of the photodiode on the top line and the pixel signal of the photodiode on the bottom line are added. Thereafter, the potential wells in the horizontal transfer path are moved to the left and read out line by line.

The horizontal transfer path is located outside the imaging area, unlike the vertical transfer path extending between the photodiodes. Therefore, the potential well formed in the horizontal transfer path is twice as large as the potential well of the vertical transfer path. It can have a capacity. As described above, since the horizontal transfer path can form a potential well having a large capacity, there is no concern that electric charges overflow from the horizontal transfer path even when the photodiode is operated in a full dynamic range. In this case, the dynamic range of the photodiode can be fully utilized, which is advantageous in the SN ratio.

In the high-speed mode of FIG. 6 described above, two lines of pixel signals are read out for every three lines in the vertical direction, but the number of lines is not limited to this. For example, two lines of pixel signals may be added every five lines in the vertical direction and read. Alternatively, pixel signals of two or three lines may be added every seven lines and read.

Taking these into consideration, the second high-speed mode described with reference to FIG. 6 is generalized to a mode in which pixel signals of n lines are added and read out for every m lines in the vertical direction (where m and n are both natural numbers). Satisfies m> n). More specifically, it is assumed that the mode is a mode in which pixel signals of β lines are added and read out for each (2α−1) lines in the vertical direction (here, α and β are both natural numbers and satisfy 2α−1> β> 1). I can say. In this case, the time required for reading the pixel signal is substantially n / m of the time required for reading in the high image quality mode, that is, β / (2α−1).

More specifically, it can be said that the β line includes at least the uppermost line and the lowermost line for each (2α−1) line. In this case, the read pixel signal includes the color information of the adjacent line.

More specifically, it can be said that the β line is composed of odd lines including the uppermost line and the lowermost line for every (2α−1) lines. In this case, the pixel signals are read out in a color line sequence with respect to the Bayer array color filters.

In addition, the addition described with reference to FIG. 7 is generalized to transfer the electric charge of the n-th line to the vertical transfer path in n times and to perform the vertical transfer m−1 times to vertically add the n-th line. After performing the transfer on the transfer path, it can be said that the transfer is performed on the horizontal transfer path by applying the vertical transfer clock in units of m times.

In addition, the addition described with reference to FIG. 8 is generalized to transfer the charge of the n-th line to the vertical transfer path, and then apply the vertical transfer clock in units of m times to transfer the charge to the horizontal transfer path. Is added in the horizontal transfer path.

FIG. 9 shows how pixel signals are read out in the fourth high-speed mode. The meaning of the drawing and the meaning of the notation of CR and CB are the same as those in FIG.

As shown in FIG. 9, in this high-speed mode, the CCD image sensor 12 adds and outputs three lines of pixel signals that are continuous in the vertical direction. That is, first, the pixel signal of the first line, the pixel signal of the second line, and the pixel signal of the third line are added and output, and then the pixel signal of the fourth line, the pixel signal of the fifth line, and the sixth line The pixel signal of the L-th line and the pixel signal of the L-th line are added and output. . In FIG. 9, for convenience, L is depicted as being a multiple of 3, but L is not necessarily required to be a multiple of 3.

で は In the high-speed mode in FIG. 9, the number of lines actually read is one third of the total. Accordingly, the number of times of horizontal transfer is one third as compared with the high image quality mode of FIG. 3, and the pixel signal is read out in substantially one third of the time. A pixel signal of one image is obtained in 1/45 to 1/30 seconds. Therefore, it is possible to obtain an image at a frame rate of 30 to 45 frames / second, and this frame rate is a numerical value capable of realizing normal moving image display.

Addition of pixel signals is performed in a vertical transfer path or a horizontal transfer path. Hereinafter, the addition in the vertical transfer path will be described first, and then the addition in the horizontal transfer path will be described.

FIG. 10 is a diagram for explaining the addition of pixel signals in the vertical transfer path. The meanings of the squares and alphabets in the figure are the same as those in FIG.

The addition of pixel signals is performed, for example, as follows. In FIG. 10, first, a pixel signal of a photodiode having an alphabetical letter with an A suffix is transferred to a vertical transfer path, and a charge as a pixel signal is stored in a potential well formed beside the photodiode. Thereafter, the potential well storing the charge of the pixel signal of the photodiode on the uppermost line is moved down the vertical transfer path, and comes next to the photodiode one line below, that is, the photodiode of the alphabet with a subscript B. The pixel signal of the photodiode on the next line, that is, the photodiode of the alphabet with the subscript B is transferred to the vertical transfer path. As a result, in the potential well, the charges transferred from the A-lettered alphabet photodiode and the charges transferred from the B-lettered alphabet photodiode are stored together. Subsequently, the potential wells storing the charges of the pixel signals of the uppermost line and the next line are continuously moved down the vertical transfer path, and further, the photodiodes one line below, that is, beside the photodiodes of the alphabet with C subscripts At the same time, the pixel signal of the photodiode on the bottom line, that is, the photodiode of the alphabet with the suffix C is transferred to the vertical transfer path. As a result, in the potential well (indicated by an ellipse enclosing + in the figure), the charge transferred from the A photodiode and the charge transferred from the B photodiode. And the charges transferred from the alphabetic photodiodes with the suffix C are stored together. That is, the pixel signal of the photodiode on the top line, the pixel signal of the photodiode on the second line, and the pixel signal of the photodiode on the bottom line are added. Thereafter, the potential well storing the added pixel signal is continuously moved down the vertical transfer path, and after moving to the horizontal transfer path, is moved leftward and is read out line by line.

大 き The size of the potential well may be the same as when all pixels are read, or may be different.

If the size of the potential well is the same as when reading all pixels, that is, if the capacity of the potential well is the same as the capacity of the photodiode when reading all pixels, adjust the substrate voltage of the overflow drain to reduce the capacity of the photodiode to the capacity of the potential well. Is preferably changed to one third. Stated another way, it is preferable that the photodiode be operated with a dynamic range that is one third of that when all pixels are read. Such a change in the capacitance, that is, the dynamic range prevents the charge from overflowing the vertical transfer path after the addition. In this case, the dynamic range of the photodiode is limited to one third, but since the signal level after reading is the same as when reading all pixels, there is an advantage that the subsequent signal processing can be performed as it is.

Further, when the size of the potential well is different from that at the time of reading all pixels, the size of the potential well is preferably three times that at the time of reading all pixels if the photodiode is operated without changing the dynamic range. . Such setting of the size of the potential well prevents the charge from overflowing the vertical transfer path after the addition. In this case, the dynamic range of the photodiode can be fully utilized, which is advantageous in the SN ratio.

FIG. 11 is a diagram for explaining the addition of pixel signals in the horizontal transfer path. The meanings of the squares and alphabets in the figure are the same as those in FIG.

Addition of pixel signals is performed as follows. In FIG. 11, first, the pixel signal of the alphabetic photodiode with the suffix A, the pixel signal of the alphabetic photodiode with the suffix B, and the pixel signal of the alphabetic photodiode with the suffix C are both vertical. The charges, which are transferred to the transfer path and are pixel signals, are stored in potential wells (shown by white ellipses in the figure) formed beside the photodiodes. After that, all the potential wells are uniformly moved down the vertical transfer path, and the electric charges stored in the potential well of the lowest line among the three divided lines are formed in the potential wells formed in the horizontal transfer path ( (Indicated by an ellipse surrounding + in the figure), the downward movement of the potential well is continued for two lines, and the electric charge stored in the potential well of the next line divided into three lines The electric charges stored in the potential well of the uppermost line also move to the potential well formed in the horizontal transfer path. As a result, in the potential well in the horizontal transfer path, the charge transferred from the alphabetical photodiode with the suffix A, the charge transferred from the photodiode with the alphabetic suffix B, and the suffix C are added. And the charge transferred from the photodiode of the alphabet. That is, pixel signals of three lines of photodiodes that are continuous in the vertical direction are added. Thereafter, the potential wells in the horizontal transfer path are moved to the left and read out line by line.

(4) Unlike the vertical transfer path extending between the photodiodes, the horizontal transfer path is located outside the imaging area, so that the width of the horizontal transfer path can be set large. That is, the capacity of the horizontal transfer path can be designed to be large. Therefore, the potential well formed in the horizontal transfer path can have a capacity that is three times or more the potential well of the vertical transfer path. As described above, since the horizontal transfer path can form a potential well having a large capacity, there is no concern that electric charges overflow from the horizontal transfer path even when the photodiode is operated in a full dynamic range. In this case, the dynamic range of the photodiode can be fully utilized, which is advantageous in the SN ratio.

In the high-speed mode in FIG. 9 described above, three consecutive pixel signals in the vertical direction are added and read, but the number of lines is not limited to this. For example, pixel signals of four or five lines that are continuous in the vertical direction may be added and read.

In particular, when pixel signals of even lines are added and read out in the vertical direction, the pixel signals read out for the color filters in the Bayer array include R + 2G + B color information. This is close to the structure of a luminance signal, easily obtains contrast information, and is suitable for data for autofocus control.

Taking these factors into consideration, the second high-speed mode described with reference to FIG. 9 is a generalized mode in which pixel signals of q lines that are continuous in the vertical direction are added and read out (where q is a natural number). It can be said.

In addition, the addition described with reference to FIG. 10 is generalized to transfer the charge of the q line into the vertical transfer path in q times and perform q-1 vertical transfers to vertically add the n lines. After performing the transfer on the transfer path, it can be said that the transfer is performed on the horizontal transfer path by applying the vertical transfer clock in q units.

In addition, the addition described with reference to FIG. 8 is generalized to transfer the electric charge of the q line to the vertical transfer path and then apply the vertical transfer clock in q units to perform the transfer to the horizontal transfer path. Can be said to be addition performed by a horizontal transfer path.

As described above, the CCD image sensor 12 is normally driven in the high-speed mode, and is driven in the high-quality mode only when the trigger 46 is depressed, so that a clear image is recorded on the recording medium 32. For example, as shown in FIG. 12, the liquid crystal display unit 32 normally displays one image every one frame, that is, every 1/60 second, and corresponds to six frames immediately after the trigger 46 is depressed. One image is displayed during a time period of 1/10 seconds. Display of one image per 1/60 second, that is, image display at a frame rate of 60 images / second, is generally recognized as a moving image by human eyes. For such a reason, in FIG. 12, the image obtained in the high-speed mode is described as “moving image”, and to be distinguished from the image, the image obtained in the high-quality mode is described as “still image”. In this connection, in the following description, an image obtained in the high-speed mode may be expressed as “moving image” and an image obtained in the high-quality mode may be expressed as “still image” in some cases.

Since the reading of a still image requires a time corresponding to a plurality of frames (1/10 second in FIG. 12), the still image is displayed on the liquid crystal display unit 32 for a while after the trigger is depressed. Is recorded on the recording medium 32. After the recording of the still image is completed, the reading mode of the CCD image sensor 12 returns to the high-speed mode again, and the moving image is displayed on the liquid crystal display unit 32 again.

In this electronic imaging apparatus, as shown in FIG. 13, an auto focus adjustment mechanism (AF), an automatic white balance adjustment mechanism (AWB), and an automatic exposure adjustment mechanism (AE) are provided every frame, that is, every 1/60 second. Is getting control data for. The acquisition of the control data for AF, AWB, and AE is performed by the CPU 24 based on the image data temporarily stored in the DRAM 28 in the partial image reading mode described above. That is, the CPU 24 fetches the image data temporarily stored in the DRAM 28 every frame, that is, every 1/60 second, performs appropriate arithmetic processing on the fetched image data, and executes any one of the control data for AF, AWB, and AE. Is calculated. The control data for AF, AWB, and AE are sequentially calculated for each frame, and the calculation of the control data is repeatedly performed during the display of the moving image.

The calculated AF control data is sent to the lens drive system 38, and the lens drive system 38 moves the lens 40 in the optical axis direction based on the control data. The control data for AE is sent to the aperture drive system 42, which adjusts the aperture diameter of the aperture 44 based on the control data. The control data for AWB is sent to the information processing unit 26 and used for correcting the color tone of the image.

Since control data for AF, AWB, and AE are obtained for each frame as described above, the DRAM 28 that temporarily stores image data can be used as an electric circuit for obtaining control data. Although the conventional device requires control circuits for AF, AWB, and AE at the same time and requires three dedicated circuits, this device does not require such a circuit.

The high-speed mode for displaying a moving image may be switched among the four modes described above. Further, the method of calculating the control data may be switched along with the mode switching. Switching of the read mode at the time of displaying a moving image is performed by, for example, a trigger operation. In this case, the trigger 46 is a two-step trigger, which functions as a first switch when the trigger is depressed one step, and functions as a second switch when the trigger is subsequently depressed two steps. FIG. 14 shows an example of switching of the read mode according to such a trigger operation.

Normally, the CCD image sensor 12 is driven in any one of the above-described first, second, and third high-speed modes. In FIG. 14, these are collectively referred to as “n-line” mode. During that time, control data for AF, AWB, and AE are repeatedly calculated for each frame based on image data obtained in the n-line mode, and AF control, AWB control, and AE control are performed.

(4) The CCD image sensor 12 is driven in the above-described fourth high-speed mode for at least a predetermined time after the trigger 46 is pressed down. In FIG. 14, this is described as a “q addition” mode. During that time, control data for AF is calculated for each frame based on image data obtained based on the q addition mode, and AF control is performed exclusively. That is, the predetermined time after the trigger is depressed by one step is allocated exclusively for AF control. As described above, the pixel signal read in the q-addition mode contains R + 2G + B color information and has a structure similar to that of a luminance signal, so that contrast information can be easily obtained and is suitable for calculation of AF control data. Therefore, during this time, the AF control based on the optimal control data is performed.

When the trigger 46 is depressed two steps, the CCD image sensor 12 is switched to the readout mode immediately after the predetermined time dedicated to the AF control has elapsed, or after the predetermined time has elapsed, and is driven in the high image quality mode by sequential scanning. You. Thereafter, a clear image by sequential scanning is recorded on the recording medium 32 during six frames, that is, 1/10 second. After the recording of the still image is completed, the reading mode of the CCD image sensor 12 returns to the n-line mode again.

By such switching of the readout mode and the change of the control data, the AF control is performed exclusively based on the optimum control data immediately before the recording of the still image, so that a more accurate and clear image can be effectively obtained. It is.

FIG. 15 shows another example of switching the readout mode according to the trigger operation. In this example, the CCD image sensor 12 is always driven in the q addition mode, but the number of addition lines immediately before recording a still image is twice as large as that in a normal state.

(5) Normally, the CCD image sensor 12 is driven in a q-addition mode in which pixel signals of vertically continuous α lines (α is a natural number of 2 or more) are added and read out. During that time, control data for AF, AWB, and AE are repeatedly calculated every 1/60 second based on the image data obtained in the q addition mode, and AF control, AWB control, and AE control are performed.

(4) The CCD image sensor 12 is driven in a q-addition mode in which pixel signals of 2α lines that are continuous in the vertical direction are added and read out for at least a predetermined time after the trigger 46 is pressed down one step. During that time, control data for AF is calculated every 1/120 second based on the image data obtained in the q addition mode, and AF control is performed based on this.

When the trigger 46 is depressed by two steps, the CCD image sensor 12 is switched to the readout mode immediately after the predetermined time dedicated to the AF control has elapsed or otherwise, and is driven in the high-quality mode by sequential scanning. You. Thereafter, a clear image by sequential scanning is recorded on the recording medium 32 during six frames, that is, 1/10 second. After the recording of the still image is completed, the reading mode of the CCD image sensor 12 returns to the normal q addition mode again.

By switching the readout mode and changing the control data, the AF control is performed based on control data obtained at twice the normal rate immediately before recording a still image. Acquisition of a beautiful image is effectively performed without missing a chance.

The present invention is not limited to the above-described embodiment, and includes all embodiments performed without departing from the technical idea thereof.

(4) The present invention includes the technical ideas described in the following sections.

{1. A mode in which all pixel signals are taken out by sequential scanning from a two-dimensional array of solid-state image pickup devices and a still image is recorded, and pixel signals of n lines are taken out from the solid-state image pickup device for every m lines in the vertical direction to record a still image, or An electronic imaging device having a mode for processing a moving image.

[Conventional Problems] If an interline solid-state imaging device of the 1 million pixel class is sequentially scanned and driven at 20 MHz or less, the speed becomes 10 to 15 frames / sec, and the moving image display of the finder becomes a pseudo moving image.

[Effect] The frame rate can be increased to m / n times.

{2. 2. An electronic imaging apparatus according to claim 1, wherein pixel signals of n lines are taken out for every m lines in the vertical direction, and color signals of image data to be processed for a still image or a moving image are obtained as line-sequential data.

[Problems of the Related Art] In a single-panel camera, if a filter of a solid-state imaging device is configured with an emphasis on resolution, it is advantageous to arrange color lines sequentially. However, if one line is thinned out, line-sequential data cannot be obtained.

[Effect] By obtaining color signals in a line-sequential manner, necessary color signals can be obtained while maintaining resolution.

{3. 2. The electronic imaging device according to claim 1, wherein the color filters of the solid-state imaging device are constituted by line-sequential filters.

[Problems of the Related Art] In a single-panel camera, if a filter of a solid-state imaging device is configured with an emphasis on resolution, it is advantageous to arrange color lines sequentially. However, if one line is thinned out, line-sequential data cannot be obtained.

[Effect] A line-sequential signal can be obtained for both the progressive scan output and the output for every m lines.

4. 2. The electronic imaging device according to claim 1, wherein n = 2α.

[Conventional Problem] If one line is simply thinned out, line-sequential data cannot be obtained.

効果 [Effect] By reading out even-numbered lines, color signals can be obtained line-sequentially.

5. 2. The electronic imaging device according to claim 1, wherein m = 2α + 1 and n = 1.

[Conventional Problem] If one line is simply thinned out, line-sequential data cannot be obtained.

[Effect] By reading one line for every odd-numbered line, in the case of a line-sequential filter, an image signal can be obtained in a line-sequential manner.

6. 2. The electronic imaging apparatus according to claim 1, wherein the signal subjected to the moving image processing is used as AF information, AE information, or AWB information.

[Conventional Problems] At 10 to 15 frames / sec, AF, AE, and AWB respond slowly to instantaneous still image shooting.

[Effect] AF, AE, and AWB data can be obtained at high speed at a frame rate of m / n times.

$ 7. In the first section, any of the AF, AE, and AWB control data is calculated one by one for each frame by using the moving image processed signal as AF information, AE information, or AWB information, and the calculation of the data is sequentially performed. An electronic image pickup apparatus characterized by performing repeatedly.

(5) [Conventional problem] Since the frame rate is low, it is necessary to process AF, AE, and AWB simultaneously and in parallel.

[Effect] By calculating AF, AE, and AWB data in order, it is possible to eliminate the influence of flicker on each data and to minimize necessary circuits.

8. 2. An electronic imaging apparatus according to claim 1, wherein the signal subjected to the still image processing or the moving image processing is supplied to an attached display device (for example, a liquid crystal monitor) or an external display device.

[Conventional problems] Memory is required to increase the frame rate of the display system from a small number of frames.

[Effect] Since a moving image can be displayed on the attached display device at a frame rate of m / n times, the moving image does not become a pseudo moving image.

Since only n lines are read, data suitable for a display device with a small number of lines can be obtained.

9. 2. An electronic image pickup apparatus according to claim 1, wherein the moving image processed signal is used as AF information, AE information, or AWB information, and is simultaneously supplied to an attached display device (for example, a liquid crystal monitor) or an external display device. .

[Conventional problems] Memory is required to increase the frame rate of the display system from a small number of frames.

[Effect] Even while the AF, AE, and AWB data are being calculated, the moving image signal is supplied to the display device, so that the function as a finder can be eliminated.

{10. A mode in which all pixel signals are taken out by sequential scanning from the solid-state imaging device having a two-dimensional array and a still image is recorded, and a pixel signal is taken out after adding n lines for every m lines in the vertical direction from the solid-state imaging device to take out a pixel signal. An electronic imaging device having a mode for recording or moving image processing.

[Conventional Problems] If an interline solid-state imaging device of the 1 million pixel class is sequentially scanned and driven at 20 MHz or less, the speed becomes 10 to 15 frames / sec, and the moving image display of the finder becomes a pseudo moving image.

単 純 Also, simple thinning processing causes moire.

[Effect] The frame rate can be increased by m times.

Moire can be reduced.

By adding n lines, data with a large dynamic range can be obtained as an image sensor output.

{11. 10. An electronic imaging apparatus according to claim 10, wherein a pixel signal is taken out after adding n lines for every m lines in the vertical direction, and a color signal of image data to be processed for a still image or a moving image is obtained as line sequential data. .

[Conventional Problem] Simply performing addition results in color mixing in the case of a line sequential filter.

[Effect] By obtaining color signals in a line-sequential manner, necessary color signals can be obtained while maintaining resolution.

{12. 11. The electronic imaging device according to claim 10, wherein the color filters of the solid-state imaging device are constituted by line-sequential filters.

[Conventional Problem] Simply performing addition results in color mixing in the case of a line sequential filter.

[Effect] A color signal can be obtained line-sequentially for both the progressive scan output and the output for every m lines.

{13. 11. The electronic imaging apparatus according to claim 10, wherein the n lines to be added are formed of the same color filter.

[Conventional Problem] Simply performing addition results in color mixing in the case of a line sequential filter.

[Effect] Moire can be reduced without mixing color signals.

{14. 10. An electronic imaging apparatus according to claim 10, wherein the n lines to be added are the same color filter, and the color filters of the n lines to be added are different for every m lines.

[Conventional Problem] Simply performing addition results in color mixing in the case of a line sequential filter.

[Effect] A line-sequential color signal is obtained for every m lines.

{15. Item 10. The electronic imaging device according to Item 10, wherein m = 2α + 1.

[Conventional Problem] Simply performing addition results in color mixing in the case of a line sequential filter.

[Effect] When line-sequential color signals are obtained for every n lines by adding n lines for every odd number line, the line data closest to the block of the adjacent m lines is used. Is less likely to occur.

{16. In the tenth embodiment, the charge of the n-th line is transferred to the vertical transfer path in n times, and the vertical transfer is performed m−1 times. An electronic image pickup apparatus wherein a transfer to a horizontal transfer path is performed by giving a vertical transfer clock in units.

[Problems of the Related Art] In the conventional all-pixel read-out CCD, since the purpose is to read out all the pixels independently, it is not possible to add the pixels through the vertical transfer path.

[Effect] Since addition can be performed in the solid-state imaging device, an external adder is not required.

{17. Item 16. An electronic imaging apparatus according to Item 16, wherein a substrate voltage for controlling overflow is made different from that during sequential scanning when adding the n lines and transferring the data to the horizontal transfer path.

[Conventional Problem] When the addition is performed in the dynamic range setting at the time of the sequential scanning, the charge overflows from the transfer path because the capacity of the vertical transfer path is small.

効果 [Effect] By making the substrate voltage different, a dynamic range can be set according to the charge amount at the time of addition and sequential scanning, and S / N is improved.

{18. 10. In the tenth aspect, after transferring the charge of the n-th line to the vertical transfer path, applying the vertical transfer clock in units of m times and transferring the charge to the horizontal transfer path, the addition of the n-line is performed on the horizontal transfer path. Electronic imaging device characterized by the following.

[Conventional Problem] If the addition is simply performed on the horizontal transfer path, all the lines are subject to addition.

(4) If the addition is performed in the dynamic range setting at the time of the sequential scanning, the charge overflows from the transfer path because the capacity of the vertical transfer path is small.

(4) [Effect] Since addition can be performed by the solid-state imaging device, an external adder is not required.

(4) Since the horizontal transfer path is used, the capacity of the added data can be made larger than the vertical transfer path addition.

{19. Item 18. An electronic imaging apparatus according to Item 18, wherein exposure control is performed such that the amount of exposure charge per pixel when adding n lines is equal to or less than z / n times the transfer path capacitance z.

[Conventional problem] If the addition is performed in the exposure setting at the time of the sequential scanning, the charge overflows from the transmission path when the capacity of the horizontal transfer path is exceeded.

[Effect] Prevent overflow in the horizontal transfer path.

{20. In the tenth aspect, it is preferable that the exposure control is performed such that the amount of exposure charge per pixel when adding n lines is 1 / n times the amount of exposure charge in a mode for extracting all pixel signals by the sequential scanning. Electronic imaging device characterized by the following.

(5) [Conventional problem] If the addition is performed in the exposure setting at the time of the sequential scanning, the charge overflows from the transfer path when the capacity of the horizontal transfer path is exceeded.

露出 The exposure level no longer varies depending on the [Effect] mode.

{21. 11. The electronic imaging apparatus according to claim 10, wherein the signal subjected to the moving image processing is used as AF information, AE information, or AWB information.

[Conventional Problems] At 10 to 15 frames / sec, AF, AE, and AWB respond slowly to instantaneous still image shooting.

[Effect] AF, AE, and AWB data can be obtained at a high speed with a frame rate of m times.

{22. 10. In the tenth aspect, a signal subjected to moving image processing is used as AF information, AE information, or AWB information, and one of AF, AE, and AWB control data is calculated one by one for each frame, and the calculation of the data is sequentially performed. An electronic imaging apparatus characterized by performing the processing repeatedly.

(5) [Conventional problem] Since the frame rate is low, it is necessary to process AF, AE, and AWB simultaneously and in parallel.

[Effect] By calculating AF, AE, and AWB data in order, it is possible to eliminate the influence of flicker on each data.

{23. 11. The electronic imaging device according to claim 10, wherein the signal subjected to the still image processing or the moving image processing is supplied to an attached display device (for example, a liquid crystal monitor) or an external display device.

[Conventional problems] Memory is required to increase the frame rate of the display system from a small number of frames.

[Effect] Since a moving image can be displayed on the attached display device with a frame rate of m times, it does not become a pseudo moving image.

Since n lines are added, data suitable for a display device with a small number of lines can be obtained.

{24. 11. An electronic imaging apparatus according to claim 10, wherein the signal subjected to the moving image processing is used as AF information, AE information, or AWB information, and is supplied to an attached display device (for example, a liquid crystal monitor) or an external display device.

[Conventional problems] Memory is required to increase the frame rate of the display system from a small number of frames.

[Effect] Even while the AF, AE, and AWB data are being calculated, the moving image signal is supplied to the display device, so that it can function as a finder.

{25. A mode in which all the pixel signals are taken out by sequential scanning from the two-dimensional array of solid-state image pickup devices to record a still image, and a pixel image in which the pixel signals added for every continuous q lines in the vertical direction are taken out from the solid-state image pickup device to record a still image Alternatively, an electronic imaging device having a mode for performing moving image processing.

[Conventional Problems] If an interline solid-state imaging device of the 1 million pixel class is sequentially scanned and driven at 20 MHz or less, the speed becomes 10 to 15 frames / sec, and the moving image display of the finder becomes a pseudo moving image.

[Effect] The frame rate can be increased q times.

By adding the q line, data with a large dynamic range can be obtained as an image sensor output.

{26. A mode in which all pixel signals are taken out by sequential scanning from a two-dimensional array of solid-state image pickup devices and a still image is recorded, and a n-line pixel signal is taken out every m lines in the vertical direction from the solid-state image pickup device to record a still image or a moving image. An electronic imaging apparatus comprising: a processing mode; and a mode for extracting a pixel signal added for each successive q lines in the vertical direction from the solid-state imaging device and recording a still image or processing a moving image.

[Conventional Problems] If an interline solid-state imaging device of the 1 million pixel class is sequentially scanned and driven at 20 MHz or less, the speed becomes 10 to 15 frames / sec, and the moving image display of the finder becomes a pseudo moving image.

[Effect] The frame rate can be increased to m / n times and q times.

(4) Since the data to be added is different for each mode, it is possible to obtain data with different combinations of color filters to be added.

By adding the q line, data with a large dynamic range can be obtained as an image sensor output.

{27. A mode in which all pixel signals are taken out by sequential scanning from the solid-state imaging device having a two-dimensional array and a still image is recorded, and a pixel signal is taken out after adding n lines for every m lines in the vertical direction from the solid-state imaging device to take out a pixel signal. An electronic image pickup apparatus, comprising: a mode for recording or moving image processing; and a mode for taking out a pixel signal added for each successive q lines in the vertical direction from the solid-state imaging device and recording or moving image processing of a still image.

[Conventional Problems] If an interline solid-state imaging device of the 1 million pixel class is sequentially scanned and driven at 20 MHz or less, the speed becomes 10 to 15 frames / sec, and the moving image display of the finder becomes a pseudo moving image.

[Effect] The frame rate can be increased by m times and q times.

(4) Since the data to be added is different for each mode, it is possible to obtain data with different combinations of color filters to be added.

デ ー タ By adding the n-line and the q-line, data with a large dynamic range can be obtained as an image sensor output.

{28. 28. An electronic imaging apparatus according to any one of paragraphs 25, 26, and 27, wherein the color filters of the solid-state imaging device are constituted by line-sequential filters.

[Problem of the Related Art] If a simple addition is performed, only a mixed color signal can be obtained in the case of a line sequential filter.

[Effect] The combination of color filters to be added can be different for each mode.

{29. Item 27. The electronic imaging apparatus according to Item 27, wherein the n lines to be added are formed of the same color filter.

[Conventional Problem] Simply performing addition results in color mixing in the case of a line sequential filter.

[Effect] Moire can be reduced without mixing color signals.

{30. 27. An electronic imaging apparatus according to claim 27, wherein the n lines to be added are the same color filter, and the color filters of the n lines to be added are different for every m lines.

[Conventional Problem] Simply performing addition results in color mixing in the case of a line sequential filter.

[Effect] A line-sequential color signal is obtained for every m lines.

{31. 29. The electronic imaging device according to paragraph 26, wherein n = 2α.

[Conventional Problem] If one line is simply thinned out, line-sequential data cannot be obtained.

効果 [Effect] By reading out even-numbered lines, color signals can be obtained line-sequentially.

{32. 29. The electronic imaging device according to paragraph 26, wherein m = 2α + 1 and n = 1.

[Conventional Problem] If one line is simply thinned out, line-sequential data cannot be obtained.

[Effect] By reading n lines for each odd line, in the case of a line-sequential filter, an image signal can be obtained in a line-sequential manner.

{33. 28. The electronic imaging device according to paragraph 27, wherein m = 2α + 1.

[Conventional Problem] If one line is simply thinned out, line-sequential data cannot be obtained.

[Effect] When a line-sequential color signal is obtained for every m lines by adding n lines for each odd line, line data closest to a block of adjacent m lines is used, and a false color occurs at the time of synchronization. It becomes difficult to do.

$ 34. 29. The electronic imaging device according to paragraph 26, wherein m / n = q.

[Conventional problem] If the number of additions is different, the frame rate will be different.

[Effect] The frame rate can be the same in different moving image processing modes.

$ 35. In any one of the paragraphs 25, 26, and 27, the charge of the q line is transferred to the vertical transfer path in q times, and the vertical transfer of q lines is performed by performing q-1 vertical transfers. An electronic imaging apparatus, wherein after performing addition in a vertical transfer path, a vertical transfer clock is applied in q units to perform transfer to a horizontal associative path.

[Problems of the Related Art] In the conventional all-pixel read-out CCD, since the purpose is to read out all the pixels independently, it is not possible to add the pixels through the vertical transfer path.

[Effect] Since addition can be performed in the solid-state imaging device, an external adder is not required.

{36. In the twenty-seventh aspect, when n lines are added for every m lines, the charge of the n lines is transferred to the vertical transfer path in n times, and the n lines are added by performing m-1 vertical transfers. Is performed on the vertical transfer path, then the transfer to the horizontal transfer path is performed by applying a vertical transfer clock in units of m times, and the charge of the q line is divided into q times by the vertical transfer path when the addition is performed for every q lines. The vertical transfer is performed q-1 times, the addition of q lines is performed in the vertical transfer path, and then the transfer to the horizontal transfer path is performed by applying a vertical transfer clock in q units. Electronic imaging device.

[Problems of the Related Art] In the conventional all-pixel read-out CCD, since the purpose is to read out all the pixels independently, it is not possible to add the pixels through the vertical transfer path.

[Effect] Since addition can be performed in the solid-state imaging device, an external adder is not required.

{37. Item 36. The electronic imaging apparatus according to Item 36, wherein, when adding the n-line or the q-line and transferring the data to the horizontal transfer path, the substrate voltage for controlling the overflow is made different from that during the sequential scanning.

[Conventional Problem] If the addition is simply performed on the horizontal transfer path, all the lines are subject to addition.

(4) If the addition is performed in the dynamic range setting at the time of the sequential scanning, the charge overflows from the transfer path because the capacity of the vertical transfer path is small.

効果 [Effect] By making the substrate voltage different, a dynamic range can be set according to the charge amount at the time of addition and sequential scanning, and S / N is improved.

$ 38. In any one of the paragraphs 25, 26 and 27, after transferring the electric charge of the q line to the vertical transfer path, transferring the electric charge to the horizontal transfer path by applying a vertical transfer clock in q units. Wherein the addition of q lines is performed in a horizontal transfer path.

[Conventional Problem] When the addition is performed in the dynamic range setting at the time of the sequential scanning, the charge overflows from the transfer path because the capacity of the vertical transfer path is small.

効果 [Effect] Since addition can be performed in the solid-state imaging device, an external adder is not required. Since addition can be performed in the solid-state imaging device, an external adder is not required.

(4) Since the horizontal transfer path is used, the capacity of the added data can be made larger than the vertical transfer path addition.

{39. In the twenty-seventh embodiment, in the case where n lines are added every m lines, the charges on the n lines are transferred to the vertical transfer path, and then the transfer to the horizontal transfer path is performed by applying a vertical transfer clock in units of m times. When the addition of n lines is performed on the horizontal transfer path and the addition is performed for each q line, the charge of the q line is transferred to the vertical transfer path, and then the transfer to the horizontal transfer path is performed by applying a vertical transfer clock in q units. An electronic image pickup apparatus wherein the addition of q lines is performed by a horizontal transfer path.

[Conventional Problem] When the addition is performed in the dynamic range setting at the time of the sequential scanning, the charge overflows from the transfer path because the capacity of the vertical transfer path is small.

効果 [Effect] Since addition can be performed in the solid-state imaging device, an external adder is not required.

(4) Since the horizontal transfer path is used, the capacity of the added data can be made larger than the vertical transfer path addition.

{40. In any one of the paragraphs 25, 26, and 27, the exposure amount when adding q lines is 1 / q times the exposure amount in a mode in which all pixel signals are extracted by the sequential scanning. An electronic imaging apparatus characterized in that exposure control is performed as described above.

(5) [Conventional problem] If the addition is performed in the exposure setting at the time of the sequential scanning, the charge overflows from the transfer path when the capacity of the horizontal transfer path is exceeded.

[Effect] Prevent the horizontal transfer path from overflowing.

{41. 28. An electronic imaging apparatus according to any one of paragraphs 25, 26, and 27, wherein a signal subjected to moving image processing in any mode is used as AF information, AE information, or AWB information.

[Conventional Problems] At 10 to 15 frames / sec, AF, AE, and AWB respond slowly to instantaneous still image shooting.

[Effect] AF, AE, and AWB data can be obtained at a high speed when the frame rate is m / n times, m times or q times.

{42. In any one of the paragraphs 25, 26, and 27, a signal subjected to moving image processing in any mode is used as AF information, AE information, or AWB information, and any of AF, AE, and AWB control data is used. An electronic imaging apparatus, wherein the calculation is performed one by one for each frame, and the calculation of the data is repeatedly performed in order.

(5) [Conventional problem] Since the frame rate is low, it is necessary to process AF, AE, and AWB simultaneously and in parallel.

[Effect] By calculating AF, AE, and AWB data in order, it is possible to eliminate the influence of flicker on each data.

(4) Extraction of image sensor data optimal for AF, AE, and AWB can be switched for each frame.

{43. In any one of paragraphs 25, 26, and 27, supplying a still image processing or moving image processing signal in any mode to an attached display device (for example, a liquid crystal monitor) or an external display device. An electronic imaging device characterized by the above-mentioned.

[Conventional problems] Memory is required to increase the frame rate of the display system from a small number of frames.

[Effect] Since a moving image can be displayed on the attached display device at a frame rate of m / n times, m times or q times, it does not become a pseudo moving image.

の み Since only n lines are read or n or q lines are added, data suitable for a display device with a small number of lines can be obtained.

$ 44. In any one of the paragraphs 25, 26, and 27, a signal processed with a moving image in any one of the modes is used as AF information, AE information, or AWB information, and an attached display device (for example, a liquid crystal monitor) or An electronic imaging device, which supplies the image to an external display device.

[Conventional problems] Memory is required to increase the frame rate of the display system from a small number of frames.

[Effect] Since a moving image can be displayed on an external display device at a frame rate of m / n times, m times or q times, it is possible to obtain AF, AE, and AWB data at a high speed without a pseudo moving image.

$ 45. In Item 25, the number of q lines to be added is determined when the signal processed by the moving image is used as AF information, AE information, or AWB information, or when the signal is supplied to an attached display device (for example, a liquid crystal monitor) or an external display device. An electronic imaging device characterized by differentiating.

[Conventional problem] When special addition such as color mixing is performed, it cannot be output to a display device as it is.

[Effect] When obtaining AF, AE, and AWB data, the frame rate can be increased irrespective of the angle of view, so that the operation can be performed at a higher speed than the display.

$ 46. 26. In the paragraph 26, when obtaining a moving image processed signal to be supplied to an attached display device (for example, a liquid crystal monitor) or an external display device or used as AE information or AWB information, pixels of n lines are provided for every m lines in the vertical direction. When selecting a mode for extracting a signal and obtaining a moving image processed signal to be used as AF information or AE information, it is necessary to have a switching unit for selecting a mode for extracting a pixel signal added for every successive q lines in the vertical direction. Electronic imaging device characterized by the following.

[Conventional problems] Memory is required to increase the frame rate of the display system from a small number of frames.

[Effect] Since a moving image can be displayed on an external display device at a frame rate of m / n times, a pseudo moving image is not generated. When obtaining AF, AE, and AWB data, the frame rate is set to q times regardless of the angle of view. Therefore, the operation can be performed at a higher speed than the display.

{47. In Item 26, when obtaining a moving image processed signal to be supplied to an attached display device (for example, a liquid crystal monitor) or an external display device or used as AE information or AWB information, n lines are added for every m lines in the vertical direction. In the case of selecting a mode for extracting a pixel signal after the processing and obtaining a moving image processed signal to be used as AF information or AE information, a switching unit for selecting a mode for extracting a pixel signal added for every q lines in the vertical direction is provided. An electronic imaging device characterized by having.

[Conventional problems] Memory is required to increase the frame rate of the display system from a small number of frames.

[Effect] Since a moving image can be displayed on an external display device at a frame rate of m times, the frame rate is set to q times regardless of the angle of view when obtaining AF, AE, and AWB data without generating a pseudo moving image. Therefore, the operation can be performed at a higher speed than the display.

1 is a block diagram illustrating a circuit configuration of an electronic imaging device according to an embodiment of the present invention. 3 shows a configuration of a Bayer array color filter. The state of reading pixel signals in the high image quality mode is shown. The state of reading pixel signals in the first high-speed mode is shown. The state of reading pixel signals in the second high-speed mode is shown. The state of reading pixel signals in the third high-speed mode is shown. FIG. 7 is a diagram illustrating addition of pixel signals in a vertical transfer path regarding the mode of FIG. 6. FIG. 7 is a diagram illustrating addition of pixel signals in a horizontal transfer path for the mode of FIG. 6. The state of reading pixel signals in the fourth high-speed mode is shown. FIG. 10 is a diagram illustrating addition of pixel signals in a vertical transfer path for the mode of FIG. 9. FIG. 10 is a diagram illustrating addition of pixel signals in a horizontal transfer path for the mode of FIG. 9. 9 illustrates a state of switching images displayed on a liquid crystal display unit. The figure shows how control data for AF, AWB, and AE are obtained in order for each frame. An example of switching of the readout mode according to a trigger operation is shown. 9 shows another example of switching of the readout mode according to a trigger operation.

Explanation of reference numerals

12: CCD image sensor, 20: timing generator, 22: signal generator, 24: CPU, 26: information processing unit, 28: DRAM, 30: compression / expansion circuit, 32: recording medium, 34: liquid crystal display unit, 46: trigger .

Claims (23)

A mode in which all the pixel signals are taken out by sequential scanning from the two-dimensional array of solid-state image pickup devices to record a still image, and a pixel image in which the pixel signals added for every continuous q lines in the vertical direction are taken out from the solid-state image pickup device to record a still image Alternatively, an electronic imaging device having a mode for performing moving image processing. A mode in which all pixel signals are taken out by sequential scanning from a two-dimensional array of solid-state image pickup devices and a still image is recorded, and a n-line pixel signal is taken out every m lines in the vertical direction from the solid-state image pickup device to record a still image or a moving image. An electronic imaging apparatus comprising: a mode for processing; and a mode for extracting a pixel signal added for each successive q lines in the vertical direction from the solid-state imaging device and recording a still image or processing a moving image. A mode in which all pixel signals are taken out by sequential scanning from the solid-state imaging device having a two-dimensional array and a still image is recorded, and a pixel signal is taken out after adding n lines for every m lines in the vertical direction from the solid-state imaging device to take out a pixel signal. An electronic image pickup apparatus, comprising: a mode for recording or moving image processing; and a mode for taking out a pixel signal added for each successive q lines in the vertical direction from the solid-state imaging device and recording or moving image processing of a still image. (4) The electronic imaging device according to any one of (1), (2) and (3), wherein the color filters of the solid-state imaging device are constituted by line-sequential filters. The electronic imaging device according to claim 3, wherein the n lines to be added are formed of the same color filter. The electronic imaging apparatus according to claim 3, wherein the n lines to be added are the same color filter, and the color filters of the n lines to be added are different for every m lines. An electronic imaging apparatus according to claim 2, wherein n = 2α. An electronic imaging device according to claim 2, wherein m = 2α + 1 and n = 1. An electronic imaging device according to claim 3, wherein m = 2α + 1. An electronic imaging device according to claim 2, wherein m / n = q. In any one of claims 1, 2, and 3, the q-line charge is transferred to the vertical transfer path in q times, and q-1 times of vertical transfer are performed. An electronic image pickup apparatus, wherein after performing addition in a vertical transfer path, a vertical transfer clock is applied in q units to transfer to a horizontal associative path. In claim 3, when n lines are added for every m lines, the charge of the n lines is transferred to the vertical transfer path in n times, and the n lines are added by performing m-1 vertical transfers. Is performed on the vertical transfer path, then the transfer to the horizontal transfer path is performed by applying a vertical transfer clock in units of m times, and the charge of the q line is divided into q times by the vertical transfer path when the addition is performed for every q lines. The vertical transfer is performed q-1 times, the addition of q lines is performed in the vertical transfer path, and then the transfer to the horizontal transfer path is performed by applying a vertical transfer clock in q units. Electronic imaging device. 13. An electronic imaging apparatus according to claim 12, wherein when adding the n-line or the q-line and transferring the data to the horizontal transfer path, the substrate voltage for controlling the overflow is made different from that during the sequential scanning. In any one of claims 1, 2 and 3, after transferring the electric charge of the q line to the vertical transfer path, the transfer to the horizontal transfer path is performed by applying a vertical transfer clock in q units. Wherein the addition of q lines is performed in a horizontal transfer path. In claim 3, when n lines are added for every m lines, the charge of the n lines is transferred to the vertical transfer path, and then the transfer to the horizontal transfer path is performed by applying a vertical transfer clock in units of m times. When the addition of n lines is performed on the horizontal transfer path and the addition is performed for each q line, the charge of the q line is transferred to the vertical transfer path, and then the transfer to the horizontal transfer path is performed by applying a vertical transfer clock in q units. An electronic image pickup apparatus wherein the addition of q lines is performed by a horizontal transfer path. In any one of the first, second, and third aspects, the amount of exposure when adding q lines is 1 / q times the amount of exposure in a mode for extracting all pixel signals by the sequential scanning. An electronic imaging apparatus characterized in that exposure control is performed as described above. (4) An electronic imaging apparatus according to any one of (1), (2), and (3), wherein a signal subjected to moving image processing in any mode is used as AF information, AE information, or AWB information. The signal according to any one of claims 1, 2, and 3, wherein a signal processed in any one of the modes is used as AF information, AE information, or AWB information, and any one of AF, AE, and AWB control data is used. An electronic image pickup apparatus comprising: calculating the data one frame at a time; and repeatedly calculating the data in order. The electronic device according to any one of claims 1, 2, and 3, wherein a signal subjected to still image processing or moving image processing in any mode is supplied to an attached display device or an external display device. Image pickup device. A signal according to any one of claims 1, 2, and 3, wherein the signal processed in any one of the modes is used as AF information, AE information, or AWB information, and is supplied to an attached display device or an external display device. An electronic imaging device, characterized by supplying. 2. The method according to claim 1, wherein the number of q lines to be added is different between a case where the signal subjected to the moving image processing is used as AF information, AE information or AWB information and a case where the signal is supplied to an attached display device or an external display device. Electronic imaging device. In claim 2, a mode for extracting n-line pixel signals for every m lines in the vertical direction when obtaining a moving image processed signal to be supplied to an attached display device or an external display device or used as AE information or AWB information. In the case of selecting and obtaining a moving image processed signal to be used as AF information or AE information, the electronic apparatus has a switching unit for selecting a mode for extracting a pixel signal added for every successive q lines in the vertical direction. Imaging device. In claim 2, when obtaining a moving image processed signal to be supplied to an attached display device or an external display device or used as AE information or AWB information, a pixel signal is added after adding n lines for every m lines in the vertical direction. When selecting a mode to extract and obtaining a moving image processed signal used as AF information or AE information, a switching means for selecting a mode to extract a pixel signal added for every continuous q lines in the vertical direction is provided. Electronic imaging device.

Images