JP2006320010A - Imaging apparatus and imaging method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To shorten processing time by processing an image on the basis of transfer data having the number of fields corresponding to the number of recorded pixels for mode setting, using an interlaced transfer type imaging device. <P>SOLUTION: Transfer data from a CCD 1 are stored into a storage part 4 via an imaging processing part 2 and a signal processing part 3 in the order of first, second and third fields. In accordance with a photographing confirmation image and resolution "low", "middle", "high" setting, for the transfer data of the respective fields, RGB signals in the storage part 4 are converted into YUV signals by a YUV conversion part 3c by detection of transfer completion. The photographing confirmation image and the thumbnail image of transfer data of the first field are displayed on a display part 6, YUV signals are read from the storage part 4 at the resolution "low", and header data or the like are added to compressed data of a JPEG format by a compression processing part 3d and stored in an external storage part 4'. Image processing is performed for the transfer data of the first and second fields at the resolution "middle" and second field transfer completion, and image processing is performed for transfer data of the first, second and third fields at to the resolution "high" and third field data transfer completion. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention is an image pickup apparatus that uses an interlace transfer type image pickup device that divides a plurality of fields and includes at least RGB or YeCyMgG color signals in transfer data of each field when transferring charges accumulated in the image pickup device. And an imaging method.

In an image pickup apparatus used in a conventional digital camera, charge from an image pickup element is transferred by an interlace method in which reading is performed in two steps or a progressive method in which reading is performed once. Each of these schemes has advantages or disadvantages. For example, some digital cameras described in Patent Document 1 have both an interlace transfer method and a progressive transfer method. According to this description, in the interlace transfer method, a single shooting mode using a shutter requires a processing time but provides a high-quality image. In the progressive transfer method, a single pixel column is arranged in a plurality of pixel columns without using a shutter. Although the smear or the like is caused by the continuous shooting mode for transferring signals, high-speed continuous shooting is possible.
JP 2001-285688 A

  However, in the image pickup apparatus using the interlace transfer type image pickup device having such a configuration, when transferring the charge accumulated in the image pickup device, in the case of a primary color filter, the R, Gr signal and the B, Gb signal are converted. In the case of a separate or complementary color filter, the signals are divided into Ye and Cy signals and Mg and G signals, and transfer is performed by two fields of the first and second fields (see FIG. 7). In this method, data necessary for image processing of RGB signals or YeCyMgG signals cannot be obtained until transfer for the first and second fields is completed, and it takes time for image processing. There is a problem in that it takes time since the same processing is performed in the creation of thumbnails and thumbnail images.

  The present invention is directed to solving the above-mentioned problems of the prior art, and uses an interlaced transfer type image sensor, and image data is transferred by transfer data of the number of fields corresponding to the number of recording pixels by setting the mode of image processing. It is an object of the present invention to provide an imaging apparatus and an imaging method that perform processing to shorten an image processing time from shooting to next shooting.

  In order to achieve this object, an image pickup apparatus according to claim 1 of the present invention performs charge data transfer divided into a plurality of fields when transferring charges of the total number of pixels accumulated in the image pickup element, and An image pickup apparatus using an image pickup device provided with a plurality of color filters, wherein an interlace transfer type image pickup device including a color signal composed of at least RGB or YeCyMgG in transfer data of each field for transferring electric charge, and a plurality of fields Image transfer means for creating a thumbnail image based on the transfer data transferred in the first field among the transferred data.

  The image pickup apparatus according to any one of claims 2 to 6 is the image pickup apparatus according to claim 1, wherein the image processing means performs image processing with transfer data having an arbitrary number of fields corresponding to the resolution of the image to be created. When creating an image from data, aspect conversion is performed, and the number of transfers for transferring charges divided into a plurality of fields is performed three times. In each field, all pixels are reduced to 1/3 in the vertical direction. The thinning interlace transfer method is used, and the color filter provided in the image sensor is a color filter that is an RGB primary color system or a color filter that is a complementary color system of YeCyMgG.

  According to another aspect of the present invention, there is provided an imaging device in which charge data transfer is divided into a plurality of fields when transferring the charges of the total number of pixels accumulated in the imaging device, and a plurality of color filters are provided. An image pickup method using an image pickup apparatus, wherein the transfer data of each field for transferring electric charges from an interlace transfer type image pickup device includes a color signal composed of at least RGB or YeCyMgG. Among the transferred data, the thumbnail image is created based on the transferred data transferred in the first field.

  The imaging method according to claims 8 to 10 is the imaging method according to claim 7, wherein the image processing means performs image processing with transfer data of an arbitrary number of fields corresponding to the resolution of the image to be created. When creating an image from data, aspect conversion is performed, and the number of transfers for transferring charges divided into a plurality of fields is performed three times. In each field, all pixels are reduced to 1/3 in the vertical direction. It is a decimation interlace transfer method.

  According to the present invention, when transferring the electric charge accumulated in the image sensor, data transfer in one field can be performed by using an interlace transfer type image sensor in which all color signals are included in one field. If completed, the image data can be created, and it is possible to check the captured image, shorten the processing time until the start of the next shooting, and improve the usability of the user.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing a schematic configuration of a digital camera having an imaging device according to an embodiment of the present invention. Here, in the present embodiment, when the charge accumulated in the image sensor is transferred, imaging using a 3: 1 interlace transfer type image sensor that is divided into three fields and each field includes all of the RGB signals. Take the device as an example.

  In FIG. 1, 1 is an image pickup element (hereinafter referred to as a CCD) that is provided with primary color RGB color filters and performs charge transfer divided into three times, and 2 is incident through an image pickup lens group and a shutter. An image processing unit (CDS (correlated double sampling circuit), AGC (automatic gain control circuit), A / D (analog / analog) which takes out an image formed on the CCD surface as an analog image signal and converts it into a digital image signal. (Digital conversion circuit), TG (timing generation circuit) and the like) 3 is a signal processing unit that performs processing for storing a digital image signal in the storage unit (SDRAM) 4 via the CCD-I / F 3a and the memory controller 3b 5 is a control unit (CPU) for controlling each unit, 6 is a display unit for displaying a shooting confirmation image and a thumbnail image, and 7 is an operation unit for inputting each setting of the digital camera. That.

  FIG. 2 also shows a 3: 1 interlaced transfer primary color filter that divides the image into three fields and includes all RGB signals when transferring the charge accumulated in the CCD in this embodiment. FIG. 3A is a front view showing an external appearance of a digital camera having an image pickup apparatus according to the present embodiment, FIG. 3B is a side view, and FIG. It is a top view.

  As shown in FIG. 2, in a frame to be transferred considering three vertical lines as one group, first, data transfer is performed using a line in which the numeral “1” is written as the first field. This first field contains all the components of the RGB signal. Thus, the image data can be acquired by the transfer data including all the RGB signals when the transfer of the first field is completed. Then, after the transfer of the first field is completed, the second and third fields are transferred. It is also possible to replace the primary color R, Gr, B, and Gb signals shown in FIG. 2 with complementary color Ye, Cy, Mg, and G signals (see FIG. 4).

  Hereinafter, the operation of the present embodiment will be described with reference to the flowchart of FIG. 5 with reference to FIG. First, data of a first field divided into three fields is transferred as charge data accumulated in the CCD 1 in accordance with an image to be photographed, and the CCD-I of the signal processing unit 3 is passed through the imaging processing unit 2. The transfer data is stored in the storage unit 4 via / F3a and the memory controller 3b (S1). The completion of the data transfer in the first field is confirmed (S2), and when it is completed (Yes in S2), the presence / absence of the setting for displaying the shooting confirmation image is confirmed (S3). Since the transfer data from the first field includes all the data of the RGB signals of the pixels, image processing can be performed at the time when the transfer is completed.

  When it is set to display the shooting confirmation image in the process S3 (Yes in S3), image processing for creating the shooting confirmation image based on the transfer data of the first field is performed (S4). Further, when it is not set to display the shooting confirmation image in the process S3 (No in S3), or after the process S4 ends, an image process for creating a thumbnail image is performed (S5). Further, it is confirmed whether or not the resolution of the image to be created is set to “low” (S6), and when the “low” resolution is set (Yes in S6), image processing is performed using the transfer data of the first field. (S7).

  If the “low” resolution is not set (No in S6), the completion of the data transfer in the second field is confirmed (S8), and whether or not the resolution of the image to be created is set to “medium”. Confirm (S9). When the “medium” resolution is set (Yes in S9), image processing is performed using the transfer data in the first and second fields (S10).

  Furthermore, when the “medium” resolution is not set in step S9 (No in S9), the completion of data transfer in the third field is confirmed (S11), and the transfer data in the first, second, and third fields are used. Image processing for high resolution is performed (S12).

  As described above, as the image processing of each resolution, the transfer data from the CCD 1 is transferred to the CCD-I / F 3a of the signal processing unit 3 and the memory controller via the imaging processing unit 2 in the order of the first, second and third fields. 3b is stored in the storage unit 4 (RAW-RGB area). As described with reference to FIG. 5, the transfer data of each field is obtained by detecting the completion of transfer of each field in accordance with the user's setting of the shooting confirmation image and the resolution “low”, “medium”, and “high”. The RGB signal data stored in the storage unit 4 (RAW-RGB region) via 3b is converted into YUV signal data by the YUV (luminance color difference signal) conversion unit 3c, and again stored in the storage unit 4 (YUV region). Stored.

  For example, a shooting confirmation image and a thumbnail image created by the transfer data in the first field are displayed on the display unit 6 via the display unit I / F 3e. Further, when the resolution is set to “low”, the YUV signal data is read again from the storage unit 4 and compressed into the JPEG format by the compression processing unit 3d and stored in the storage unit 4 (JPEG area). Further, when storing in the storage unit 4 (JPEG area), header data or the like is added to the JPEG-compressed data and stored as JPEG image data in the external storage unit 4 ′ by the control unit 5.

  Further, when the resolution is set to “medium”, image processing is performed using the transfer data of the first and second fields upon detection of completion of the data transfer of the second field. When the resolution is set to “high”, the data of the third field is used. Image processing using the transfer data of the first, second, and third fields is performed when transfer completion is detected.

  Specifically, when a 3 million pixel CCD with horizontal 2048 pixels and vertical 1536 pixels is used, in the interlaced transfer method in which divided transfer is performed three times, data of horizontal 2048 pixels and vertical 512 pixels is obtained by one transfer. Will be transferred. Therefore, when recording a horizontal 640 pixel and vertical 480 pixel (VGA) size, an image can be generated by the number of transfer pixels in the first field. Furthermore, by using the transfer pixel numbers in the first and second fields (twice), the data becomes horizontal 2048 pixels and vertical 1024 pixels, and the horizontal 1024 pixels and vertical 768 pixels (XGA) size and horizontal 1280 pixels and vertical 1024 pixels are obtained. A size image can be generated.

  When the transfer data of the first field and the first and second fields are used, the horizontal pixel and the vertical pixel have different aspect ratios and the image becomes a long image in the horizontal direction. This is converted by the YUV conversion unit. At this time, the aspect ratio is adjusted by performing processing such as reading out from the storage unit.

  Here, if the purpose is to record an image of the VGA size similar to the shooting confirmation image or the thumbnail image, the transfer processing of the first field is sufficient for the processing of the shot image, so the data transfer of the second and third fields is sufficient. You can speed up the process by stopping the process and moving to the next shooting. That is, using the field transfer data necessary for image processing according to the resolution setting, the next shooting can be started and the processing speeded up without performing unnecessary field data transfer.

  In addition, selecting the transfer data of the first, second, and third fields transferred from the CCD and performing image processing may be performed in accordance with the compression rate setting. For example, when it is desired to record early and transmit quickly, a high compression rate is often selected. Therefore, when a high compression rate is set, image processing is performed using the transfer data in the first field, and the first and second fields are used for the medium compression rate, and the first, second, and third fields are used for the low compression rate. Select to use transfer data.

  FIG. 6 is a diagram showing a display example of a selection screen for setting the resolution on the liquid crystal monitor which is a display unit of the digital camera. As shown in FIG. 6, display “off” or display times “1 second” and “3 seconds” are set in the shooting confirmation image item in the recording setting screen, and “high” and “3” are set in the recording image resolution item. Enter “Middle” and “Low” from the operation panel. Further, the image compression rate can be set by the user's selection with the same display.

  In the above description, data transfer divided into three fields has been described as an example. However, in the future, the number of pixels of the image sensor increases, the transfer time of the total number of pixels increases, and one divided field If the VGA size can be obtained from the number of transfer pixels, the number of fields to be divided may be increased, such as dividing into five fields and transferring data.

  As described above, high-speed image processing can be performed by selecting an optimum process according to the set image output setting.

  The image pickup apparatus and the image pickup method according to the present invention use an interlace transfer type image pickup device in which all color signals are included in one field when transferring charges accumulated in the image pickup device. When the field data transfer is completed, image data can be created, the captured image can be confirmed, the processing time until the start of the next shooting can be shortened, and user convenience can be improved. This is useful as an apparatus and method that uses an interlaced transfer type image sensor that includes a color signal composed of at least RGB or YeCyMgG in the transfer data of each field when transferring the charges accumulated in the field.

1 is a block diagram showing a schematic configuration of a digital camera having an imaging device according to an embodiment of the present invention. Outline of data transfer of a 3: 1 interlace transfer type image pickup device (CCD) that divides into three fields and includes all RGB signals when transferring charges accumulated in the CCD according to the embodiment of the present invention. Figure (A) is a front view showing an external appearance of a digital camera having an imaging device according to the present embodiment, (b) is a side view, and (c) is a top view. The figure which shows the color filter of R, Gr signal, B, Gb signal of a primary color system, and Ye, Cy signal, Mg, G signal of a complementary color system The flowchart which shows operation | movement of embodiment of this invention. The figure which shows the example of a display of the recording setting screen of the digital camera in embodiment of this invention Schematic diagram of conventional interlace transfer type image sensor (CCD) data transfer

Explanation of symbols

1 Image sensor (CCD)
2 Imaging processing unit 3 Signal processing unit 3a CCD-I / F
3b Memory controller 3c YUV conversion unit 3d Compression processing unit 3e Display unit I / F
4 Storage unit (SDRAM)
4 'External storage (memory card)
5 Control unit (CPU)
6 Display unit 7 Operation unit

Claims (10)

An image pickup apparatus using an image pickup element that performs data transfer of the charge divided into a plurality of fields and transfers a plurality of color filters when transferring charges of all pixels accumulated in the image pickup element,
An interlaced transfer type image sensor that includes at least RGB or YeCyMgG color signals in the transfer data of each field for transferring the charge, and transfer in the first field among the transferred data in the plurality of fields. An image processing apparatus comprising image processing means for creating a thumbnail image based on the transferred data.   2. The imaging apparatus according to claim 1, wherein the image processing means performs image processing using transfer data having an arbitrary number of fields corresponding to the resolution of an image to be created.   3. The imaging apparatus according to claim 1, wherein the image processing unit performs aspect conversion when creating an image from transfer data.   2. The interlace transfer method in which the number of transfers for transferring charges divided into the plurality of fields is performed three times, and each field is an interlace transfer method in which all pixels are thinned out to 1/3 in the vertical direction. 4. The imaging device according to any one of 3.   5. The image pickup apparatus according to claim 1, wherein the color filter provided in the image pickup element is a color filter that is a primary color system of RGB.   The image pickup apparatus according to claim 1, wherein the color filter provided in the image pickup element is a color filter that is a complementary color system of YeCyMgG. An image pickup method for an image pickup apparatus using an image pickup device in which the charge data transfer is divided into a plurality of fields and a plurality of color filters are provided when transferring the charges of all the pixels accumulated in the image pickup device. And
The transfer data of each field for transferring the charge from the image sensor of the interlace transfer method includes a color signal composed of at least RGB or YeCyMgG, and the image processing means includes among the transferred data transferred in the plurality of fields. An imaging method characterized by creating a thumbnail image based on transfer data transferred in the first field.   8. The imaging method according to claim 7, wherein the image processing means performs image processing with transfer data having an arbitrary number of fields corresponding to the resolution of an image to be created.   9. The imaging method according to claim 7, wherein the image processing means performs aspect conversion when creating an image from transfer data. 8. The interlace transfer method in which the number of transfers for transferring charges divided into the plurality of fields is performed three times, and each field is an interlace transfer method in which all pixels are thinned out to 1/3 in the vertical direction. 10. The imaging method according to any one of 9 above.

Images