JP3846860B2 - Imaging apparatus and imaging method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention is an image pickup apparatus that uses an interlace transfer type image pickup device that divides a plurality of fields and includes at least RGB or YeCyMgG color signals in transfer data of each field when transferring charges accumulated in the image pickup device. And an imaging method.
[0002]
[Prior art]
In an image pickup apparatus used in a conventional digital camera, charge from an image pickup element is transferred by an interlace method in which reading is performed in two steps or a progressive method in which reading is performed once. Each of these schemes has advantages or disadvantages. For example, some digital cameras described in JP 2001-285688 A have both an interlace transfer method and a progressive transfer method. According to this description, in the interlace transfer method, a single shooting mode using a shutter requires a processing time but provides a high-quality image. In the progressive transfer method, a single pixel column is arranged in a plurality of pixel columns without using a shutter. Although the smear or the like is caused by the continuous shooting mode for transferring signals, high-speed continuous shooting is possible.
[0003]
[Problems to be solved by the invention]
However, in the image pickup apparatus using the interlace transfer type image pickup device having such a configuration, when transferring the charge accumulated in the image pickup device, in the case of a primary color filter, the R, Gr signal and the B, Gb signal are converted. In the case of a separate or complementary color filter, the signals are divided into Ye and Cy signals and Mg and G signals, and transfer is performed by two fields of the first and second fields (see FIG. 7). In this method, data necessary for image processing of RGB signals or YeCyMgG signals cannot be obtained until transfer for the first and second fields is completed, and it takes time for image processing. There is a problem in that it takes time since the same processing is performed in the creation of thumbnails and thumbnail images.
[0004]
The present invention is directed to solving the above-mentioned problems of the prior art, and uses an interlaced transfer type image sensor, and image data is transferred by transfer data of the number of fields corresponding to the number of recording pixels by setting the mode of image processing. It is an object of the present invention to provide an imaging apparatus and an imaging method that perform processing to shorten an image processing time from shooting to next shooting.
[0005]
[Means for Solving the Problems]
To this end, the imaging device according to 請 Motomeko 1 of the present invention, was divided into a plurality of fields of data transfer charges when transferring the charges of the total number of pixels accumulated in the image pickup device, An image pickup apparatus using an image pickup device provided with a plurality of color filters, and an image to be created with an interlace transfer type image pickup device that includes at least RGB or YeCyMgG color signals in transfer data of each field for transferring electric charge. characterized by comprising an image processing means for further image processing to transfer data of an arbitrary number of fields depending on the compression ratio.
[0008]
Further, according to claims 2 and 3 , in the imaging apparatus of claim 1 , the image processing means is based on transfer data transferred in the first field among transfer data transferred in a plurality of fields. you create a photographic confirmation image to be displayed immediately after shooting, also in the transfer and transferred data is in the plurality of fields, characterized in that to create a thumbnail image based on the transfer data transferred by the first field And
[0009]
Also, the description of the claims 4-8, in the imaging apparatus according to claim 1 to 3, the image processing means, that the image processing by any number of fields of the transfer data corresponding to the resolution of the image to be created, also, the transfer When creating an image from data, aspect conversion is performed, and the number of transfers for transferring charges divided into a plurality of fields is performed three times. In each field, all pixels are reduced to 1/3 in the vertical direction. The thinning interlace transfer method is used, and the color filter provided in the image sensor is a color filter that is an RGB primary color system or a color filter that is a complementary color system of YeCyMgG.
[0012]
According to a ninth aspect of the present invention, there is provided an image pickup device in which charge data transfer is divided into a plurality of fields and a plurality of color filters are provided when transferring the charges of the total number of pixels accumulated in the image pickup device. An image pickup method using an image pickup device, wherein the transfer data of each field for transferring electric charges from an interlace transfer type image pickup device includes a color signal composed of at least RGB or YeCyMgG, and an image to be created by an image processing means The image processing is performed with transfer data having an arbitrary number of fields in accordance with the compression rate.
[0013]
Further, according to claims 10 and 11 , in the imaging method of claim 9 , the image processing means is based on transfer data transferred in the first field among transfer data transferred in a plurality of fields. you create a photographic confirmation image to be displayed immediately after shooting, also in the transfer and transferred data is in the plurality of fields, characterized in that to create a thumbnail image based on the transfer data transferred by the first field And
[0014]
Also, the description of the claims 12-14, the imaging method of claims 9 to 11, an image processing means, that the image processing by any number of fields of the transfer data corresponding to the resolution of the image to be created, also, the transfer When creating an image from data, aspect conversion is performed, and the number of transfers for transferring charges divided into a plurality of fields is performed three times. In each field, all pixels are reduced to 1/3 in the vertical direction. It is a decimation interlace transfer method.
[0015]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0016]
FIG. 1 is a block diagram showing a schematic configuration of a digital camera having an imaging device according to an embodiment of the present invention. Here, in the present embodiment, when the charge accumulated in the image sensor is transferred, imaging using a 3: 1 interlace transfer type image sensor that is divided into three fields and each field includes all of the RGB signals. Take the device as an example.
[0017]
In FIG. 1, 1 is an image pickup element (hereinafter referred to as a CCD) that is provided with primary color RGB color filters and performs charge transfer divided into three times, and 2 is incident through an image pickup lens group and a shutter. An image processing unit (CDS (correlated double sampling circuit), AGC (automatic gain control circuit), A / D (analog / analog) which takes out an image formed on the CCD surface as an analog image signal and converts it into a digital image signal. (Digital conversion circuit), TG (timing generation circuit) and the like) 3 is a signal processing unit that performs processing for storing a digital image signal in the storage unit (SDRAM) 4 via the CCD-I / F 3a and the memory controller 3b 5 is a control unit (CPU) for controlling each unit, 6 is a display unit for displaying a shooting confirmation image and a thumbnail image, and 7 is an operation unit for inputting each setting of the digital camera. That.
[0018]
FIG. 2 also shows a 3: 1 interlaced transfer primary color filter that divides the image into three fields and includes all RGB signals when transferring the charge accumulated in the CCD in this embodiment. FIG. 3A is a front view showing an external appearance of a digital camera having an image pickup apparatus according to the present embodiment, FIG. 3B is a side view, and FIG. It is a top view.
[0019]
As shown in FIG. 2, in a frame to be transferred considering three vertical lines as one group, first, data transfer is performed using a line in which the numeral “1” is written as the first field. This first field contains all the components of the RGB signal. Thus, the image data can be acquired by the transfer data including all the RGB signals when the transfer of the first field is completed. Then, after the transfer of the first field is completed, the second and third fields are transferred. It is also possible to replace the primary color R, Gr, B, and Gb signals shown in FIG. 2 with complementary color Ye, Cy, Mg, and G signals (see FIG. 4).
[0020]
Hereinafter, the operation of the present embodiment will be described with reference to the flowchart of FIG. 5 with reference to FIG. First, data of a first field divided into three fields is transferred as charge data accumulated in the CCD 1 in accordance with an image to be photographed, and the CCD-I of the signal processing unit 3 is passed through the imaging processing unit 2. The transfer data is stored in the storage unit 4 via / F3a and the memory controller 3b (S1). The completion of the data transfer in the first field is confirmed (S2), and when it is completed (Yes in S2), the presence / absence of the setting for displaying the shooting confirmation image is confirmed (S3). Since the transfer data from the first field includes all the data of the RGB signals of the pixels, image processing can be performed at the time when the transfer is completed.
[0021]
When it is set to display the shooting confirmation image in the process S3 (Yes in S3), image processing for creating the shooting confirmation image based on the transfer data of the first field is performed (S4). Further, when it is not set to display the shooting confirmation image in the process S3 (No in S3), or after the process S4 ends, an image process for creating a thumbnail image is performed (S5). Further, it is confirmed whether or not the resolution of the image to be created is set to “low” (S6), and when the “low” resolution is set (Yes in S6), image processing is performed using the transfer data of the first field. (S7).
[0022]
If the “low” resolution is not set (No in S6), the completion of the data transfer in the second field is confirmed (S8), and whether or not the resolution of the image to be created is set to “medium”. Confirm (S9). When the “medium” resolution is set (Yes in S9), image processing is performed using the transfer data in the first and second fields (S10).
[0023]
Furthermore, when the “medium” resolution is not set in step S9 (No in S9), the completion of data transfer in the third field is confirmed (S11), and the transfer data in the first, second, and third fields are used. Image processing for high resolution is performed (S12).
[0024]
As described above, as the image processing of each resolution, the transfer data from the CCD 1 is transferred to the CCD-I / F 3a of the signal processing unit 3 and the memory controller via the imaging processing unit 2 in the order of the first, second and third fields. 3b is stored in the storage unit 4 (RAW-RGB area). As described with reference to FIG. 5, the transfer data of each field is obtained by detecting the completion of transfer of each field in accordance with the user's setting of the shooting confirmation image and the resolution “low”, “medium”, and “high”. The RGB signal data stored in the storage unit 4 (RAW-RGB region) via 3b is converted into YUV signal data by the YUV (luminance color difference signal) conversion unit 3c, and again stored in the storage unit 4 (YUV region). Stored.
[0025]
For example, a shooting confirmation image and a thumbnail image created by the transfer data in the first field are displayed on the display unit 6 via the display unit I / F 3e. Further, when the resolution is set to “low”, the YUV signal data is read again from the storage unit 4 and compressed into the JPEG format by the compression processing unit 3d and stored in the storage unit 4 (JPEG area). In addition, when storing in the storage unit 4 (JPEG area), header data or the like is added to the JPEG-compressed data and is stored in the external storage unit 4 ′ by the control unit 5 as JPEG image data.
[0026]
Further, when the resolution is set to “medium”, image processing is performed using the transfer data of the first and second fields upon detection of completion of the data transfer of the second field. When the resolution is set to “high”, the data of the third field is used. Image processing using the transfer data of the first, second, and third fields is performed when transfer completion is detected.
[0027]
Specifically, when a 3 million pixel CCD with horizontal 2048 pixels and vertical 1536 pixels is used, in the interlaced transfer method in which divided transfer is performed three times, data of horizontal 2048 pixels and vertical 512 pixels is obtained by one transfer. Will be transferred. Therefore, when recording a horizontal 640 pixel and vertical 480 pixel (VGA) size, an image can be generated by the number of transfer pixels in the first field. Furthermore, by using the transfer pixel numbers in the first and second fields (twice), the data becomes horizontal 2048 pixels and vertical 1024 pixels, and the horizontal 1024 pixels and vertical 768 pixels (XGA) size and horizontal 1280 pixels and vertical 1024 pixels are obtained. A size image can be generated.
[0028]
When the transfer data of the first field and the first and second fields are used, the horizontal pixel and the vertical pixel have different aspect ratios and the image becomes a long image in the horizontal direction. This is converted by the YUV conversion unit. At this time, the aspect ratio is adjusted by performing processing such as reading out from the storage unit.
[0029]
Here, if the purpose is to record an image of the VGA size similar to the shooting confirmation image or the thumbnail image, the transfer processing of the first field is sufficient for the processing of the shot image, so the data transfer of the second and third fields is sufficient. You can speed up the process by stopping the process and moving to the next shooting. That is, using the field transfer data necessary for image processing according to the resolution setting, the next shooting can be started and the processing speeded up without performing unnecessary field data transfer.
[0030]
In addition, selecting the transfer data of the first, second, and third fields transferred from the CCD and performing image processing may be performed in accordance with the compression rate setting. For example, when it is desired to record early and transmit quickly, a high compression rate is often selected. Therefore, when a high compression rate is set, image processing is performed using the transfer data in the first field, and the first and second fields are used for the medium compression rate, and the first, second, and third fields are used for the low compression rate. Select to use transfer data.
[0031]
FIG. 6 is a diagram showing a display example of a selection screen for setting the resolution on the liquid crystal monitor which is a display unit of the digital camera. As shown in FIG. 6, display “off” or display times “1 second” and “3 seconds” are set in the shooting confirmation image item in the recording setting screen, and “high” and “3” are set in the recording image resolution item. Enter “Middle” and “Low” from the operation panel. Further, the image compression rate can be set by the user's selection with the same display.
[0032]
In the above description, data transfer divided into three fields has been described as an example. However, in the future, the number of pixels of the image sensor increases, the transfer time of the total number of pixels increases, and one divided field If the VGA size can be obtained from the number of transfer pixels, the number of fields to be divided may be increased, such as dividing into five fields and transferring data.
[0033]
As described above, high-speed image processing can be performed by selecting an optimum process according to the set image output setting.
[0034]
【The invention's effect】
As described above, according to the present invention, when transferring the electric charge accumulated in the image pickup device, an interlace transfer type image pickup device in which all color signals are included in one field is used. Once the data transfer of one field is completed, the image data can be created, the processing time required for confirming the captured image, the start of the next shooting, and the convenience of the user can be improved. Play.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a schematic configuration of a digital camera having an imaging device according to an embodiment of the present invention. FIG. 2 is divided into three fields when transferring charges accumulated in a CCD according to the embodiment of the present invention. FIG. 3 is a schematic diagram of data transfer of a 3: 1 interlace transfer type image pickup device (CCD) including all RGB signals in each field. FIG. 3A is an external view of a digital camera having an image pickup apparatus according to the present embodiment. FIG. 4B is a side view, and FIG. 4C is a top view. FIG. 4 Color filters of primary color R, Gr signal, B, Gb signal and complementary color Ye, Cy signal, Mg, G signal FIG. 5 is a flowchart showing the operation of the embodiment of the present invention. FIG. 6 is a diagram showing a display example of the recording setting screen of the digital camera in the embodiment of the present invention. Schematic diagram of data transfer of the image sensor (CCD) of the system [Description of symbols]
1 Image sensor (CCD)
2 Imaging processing unit 3 Signal processing unit 3a CCD-I / F
3b Memory controller 3c YUV conversion unit 3d Compression processing unit 3e Display unit I / F
4 Storage unit (SDRAM)
4 'External storage (memory card)
5 Control unit (CPU)
6 Display unit 7 Operation unit

Claims (14)

An image pickup apparatus using an image pickup element that performs data transfer of the charge divided into a plurality of fields and transfers a plurality of color filters when transferring charges of all pixels accumulated in the image pickup element,
At least the image sensor of the interlaced transfer method including color signal composed of RGB or YeCyMgG, more image processing on any number of fields in the transmitted data according to the compression ratio of the image to create the transfer data of each field for transferring the charges And an image processing means. Wherein the image processing means, in the transfer and transferred data is in the plurality of fields, wherein the benzalkonium create a photographic confirmation image to be displayed immediately after shooting based on the transfer data transferred by the first field The imaging device according to claim 1 . 2. The imaging apparatus according to claim 1 , wherein the image processing unit creates a thumbnail image based on the transfer data transferred in the first field among the transfer data transferred in a plurality of fields . Wherein the image processing means, the imaging apparatus according to any one of claims 1 to 3, characterized in that more image processing on any number of fields of the transfer data corresponding to the resolution of the image to be created. Wherein the image processing means, when creating an image from transfer data, the imaging apparatus according to any one of claims 1 to 4, characterized in that the aspect ratio conversion. 2. The interlace transfer method in which the number of transfers for transferring charges divided into the plurality of fields is performed three times, and each field is an interlace transfer method in which all pixels are thinned out to 1/3 in the vertical direction . The imaging device according to any one of 5. The image pickup apparatus according to claim 1, wherein the color filter provided in the image pickup element is a color filter that is a primary color system of RGB . A color filter provided in the imaging device, an imaging apparatus according to any one of claims 1 to 6, characterized in that the color filter is a complementary color system YeCyMgG. An image pickup method for an image pickup apparatus using an image pickup device in which the charge data transfer is divided into a plurality of fields and a plurality of color filters are provided when transferring the charges of all the pixels accumulated in the image pickup device. And
The transfer data of each field for transferring the electric charge from the image sensor of the interlace transfer method includes a color signal composed of at least RGB or YeCyMgG, and the image processing means has an arbitrary number of fields according to the compression rate of the image to be created. iMAGING how to characterized in that the image processing by the transfer data. The image processing means creates a shooting confirmation image to be displayed immediately after shooting based on the transfer data transferred in the first field among the transfer data transferred in a plurality of fields. 9. The imaging method according to 9 . In the image processing means, in the transferred transfer data are in the field of multiple imaging method according to claim 9, wherein creating a thumbnail image based on the transfer data transferred by the first field . The imaging method according to any one of claims 9 to 11, wherein the image processing means performs image processing with transfer data having an arbitrary number of fields corresponding to the resolution of an image to be created . The imaging method according to claim 9, wherein the image processing unit performs aspect conversion when creating an image from transfer data . Performed before Kifuku number field three times the number of transfers for transferring divided and charged in, and each field claims, characterized in that interlace transfer method for thinning 1/3 all the pixels in the vertical direction The imaging method according to any one of 9 to 13.

Images