JP4455545B2 - Imaging apparatus and imaging method - Google Patents

Description

  The present invention is an image pickup apparatus that uses an interlace transfer type image pickup device that divides a plurality of fields and includes at least RGB or YeCyMgG color signals in transfer data of each field when transferring charges accumulated in the image pickup device. And an imaging method.

In an image pickup apparatus used in a conventional digital camera, charge from an image pickup element is transferred by an interlace method in which reading is performed in two steps or a progressive method in which reading is performed once. Each of these schemes has advantages or disadvantages. For example, some digital cameras described in Patent Document 1 have both an interlace transfer method and a progressive transfer method. According to this description, in the interlace transfer method, a single shooting mode using a shutter requires a processing time but provides a high-quality image. In the progressive transfer method, a single pixel column is provided for a plurality of pixel columns without using a shutter. Although the smear or the like occurs due to the continuous shooting mode in which signals are transferred, high-speed continuous shooting is possible.
JP 2001-285688 A

  However, in the image pickup apparatus using the interlace transfer type image pickup device having such a configuration, when transferring the charge accumulated in the image pickup device, in the case of a primary color filter, the R, Gr signal and the B, Gb signal are converted. In the case of a separate or complementary color filter, the signals are divided into Ye and Cy signals and Mg and G signals, and transfer is performed by two fields of the first and second fields (see FIG. 7). In this method, data necessary for image processing of RGB signals or YeCyMgG signals cannot be obtained until transfer for the first and second fields is completed, and it takes time for image processing. There is a problem in that it takes time since the same processing is performed in the creation of thumbnails and thumbnail images.

  The present invention is directed to solving the above-mentioned problems of the prior art, and uses an interlaced transfer type image sensor, and image data is transferred by transfer data of the number of fields corresponding to the number of recording pixels by setting the mode of image processing. It is an object of the present invention to provide an imaging apparatus and an imaging method that perform processing to shorten an image processing time from shooting to next shooting.

In order to achieve this object, an image pickup apparatus according to claim 1 of the present invention performs charge data transfer divided into a plurality of fields when transferring charges of the total number of pixels accumulated in the image pickup element, and An image pickup apparatus using an image pickup device provided with a plurality of color filters, wherein an interlace transfer type image pickup device including a color signal composed of at least RGB or YeCyMgG in transfer data of each field for transferring charges , transfer means for transferring charge, whether an image processing means for creating the images based on at least one field transfer data in the transferred transfer data was in a plurality of fields, the transfer of each field is completed and a determining means for determining whether, after starting the transfer of the charge of the entire number of pixels from the image sensor by the transfer means, first by determining means When it is determined that the field transfer has been completed, the image processing means creates a thumbnail image based on the transfer data transferred in the first field, and the transfer means further selects any resolution required for the resolution of the image to be created. The transfer operation of the charge from the image sensor is continued until the transfer of the number of fields is completed, and when the determination unit determines that the transfer of the arbitrary number of fields necessary for the resolution of the image to be created is completed, the transfer unit captures an image. The transfer operation of the charge from the element is stopped, and the image processing means creates an image having a set resolution using transfer data of an arbitrary number of fields corresponding to the resolution of the created image .

Also, splitting the imaging apparatus according to claim 2-5, in the imaging apparatus according to claim 1, the image processing means, when creating an image from transfer data, it performs aspect ratio conversion, and a plurality of fields Then, the number of transfers for transferring the charge is performed three times, and each field is an interlace transfer method in which all the pixels are thinned down to 1/3 in the vertical direction. The color filter is a primary color system or a color filter that is a complementary color system of YeCyMgG.

The imaging method according to claim 6, was divided into a plurality of fields of data transfer charges when transferring the charges of the total number of pixels accumulated in the image pickup device, and an imaging device having a plurality of color filters an imaging method of an imaging apparatus using the at least RGB or including data transfer process color signal consisting YeCyMgG to transfer data of each field for transferring charges from the imaging device of interlace transfer method, a plurality of fields An image processing step of creating an image based on transfer data of at least one field of the transferred transfer data in the medium , and a determination step of determining whether or not the transfer of each field is completed. In the transfer process, the transfer of the first field is completed by the determination process after starting the transfer of charges of all the pixels from the image sensor. Once disconnection, to create a thumbnail image based on the transfer data transferred by the first field by the image processing step, further, the data transfer process, any number of fields in the transfer is complete required resolution of the image to be created Until it is determined that the transfer of an arbitrary number of fields necessary for the resolution of the image created by the determination process is completed, the data transfer process performs the transfer of the charge from the image sensor. The transfer operation is stopped, and the image processing step creates an image having a resolution set by using transfer data having an arbitrary number of fields corresponding to the resolution of the image to be created .

Also, the division pickup method according to claim 7 and 8, in the imaging method according to claim 6, in the image processing step, when creating an image from transfer data, performs aspect ratio conversion, and a plurality of fields Then, the number of transfers for transferring charges is performed three times, and each field is characterized by an interlace transfer method in which all pixels are thinned out to 1/3 in the vertical direction.

  According to the present invention, when transferring the electric charge accumulated in the image sensor, data transfer in one field can be performed by using an interlace transfer type image sensor in which all color signals are included in one field. If completed, the image data can be created, and it is possible to check the captured image, shorten the processing time until the start of the next shooting, and improve the usability of the user.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing a schematic configuration of a digital camera having an imaging device according to an embodiment of the present invention. Here, in the present embodiment, when the charge accumulated in the image sensor is transferred, imaging using a 3: 1 interlace transfer type image sensor that is divided into three fields and each field includes all of the RGB signals. Take the device as an example.

  In FIG. 1, 1 is an image pickup element (hereinafter referred to as a CCD) that is provided with primary color RGB color filters and performs charge transfer divided into three times, and 2 is incident through an image pickup lens group and a shutter. An image processing unit (CDS (correlated double sampling circuit), AGC (automatic gain control circuit), A / D (analog / analog) which takes out an image formed on the CCD surface as an analog image signal and converts it into a digital image signal. (Digital conversion circuit), TG (timing generation circuit) and the like) 3 is a signal processing unit that performs processing for storing a digital image signal in the storage unit (SDRAM) 4 via the CCD-I / F 3a and the memory controller 3b 5 is a control unit (CPU) for controlling each unit, 6 is a display unit for displaying a shooting confirmation image and a thumbnail image, and 7 is an operation unit for inputting each setting of the digital camera. That.

  FIG. 2 also shows a 3: 1 interlaced transfer primary color filter that divides the image into three fields and includes all RGB signals when transferring the charge accumulated in the CCD in this embodiment. FIG. 3A is a front view showing an external appearance of a digital camera having an image pickup apparatus according to the present embodiment, FIG. 3B is a side view, and FIG. It is a top view.

  As shown in FIG. 2, in a frame to be transferred considering three vertical lines as one group, first, data transfer is performed using a line in which the numeral “1” is written as the first field. This first field contains all the components of the RGB signal. Thus, the image data can be acquired by the transfer data including all the RGB signals when the transfer of the first field is completed. Then, after the transfer of the first field is completed, the second and third fields are transferred. It is also possible to replace the primary color R, Gr, B, and Gb signals shown in FIG. 2 with complementary color Ye, Cy, Mg, and G signals (see FIG. 4).

  Hereinafter, the operation of the present embodiment will be described with reference to the flowchart of FIG. 5 with reference to FIG. First, data of a first field divided into three fields is transferred as charge data accumulated in the CCD 1 in accordance with an image to be photographed, and the CCD-I of the signal processing unit 3 is passed through the imaging processing unit 2. The transfer data is stored in the storage unit 4 via / F3a and the memory controller 3b (S1). The completion of the data transfer in the first field is confirmed (S2), and when it is completed (Yes in S2), the presence / absence of the setting for displaying the shooting confirmation image is confirmed (S3). Since the transfer data from the first field includes all the data of the RGB signals of the pixels, image processing can be performed at the time when the transfer is completed.

  When it is set to display the shooting confirmation image in the process S3 (Yes in S3), image processing for creating the shooting confirmation image based on the transfer data of the first field is performed (S4). Further, when it is not set to display the shooting confirmation image in the process S3 (No in S3), or after the process S4 ends, an image process for creating a thumbnail image is performed (S5). Further, it is confirmed whether or not the resolution of the image to be created is set to “low” (S6), and when the “low” resolution is set (Yes in S6), image processing is performed using the transfer data of the first field. (S7).

  If the “low” resolution is not set (No in S6), the completion of the data transfer in the second field is confirmed (S8), and whether or not the resolution of the image to be created is set to “medium”. Confirm (S9). When the “medium” resolution is set (Yes in S9), image processing is performed using the transfer data in the first and second fields (S10).

  Furthermore, when the “medium” resolution is not set in step S9 (No in S9), the completion of data transfer in the third field is confirmed (S11), and the transfer data in the first, second, and third fields are used. Image processing for high resolution is performed (S12).

  As described above, as the image processing of each resolution, the transfer data from the CCD 1 is transferred to the CCD-I / F 3a of the signal processing unit 3 and the memory controller via the imaging processing unit 2 in the order of the first, second and third fields. 3b is stored in the storage unit 4 (RAW-RGB area). As described with reference to FIG. 5, the transfer data of each field is obtained by detecting the completion of transfer of each field in accordance with the user's setting of the shooting confirmation image and the resolution “low”, “medium”, and “high”. The RGB signal data stored in the storage unit 4 (RAW-RGB region) via 3b is converted into YUV signal data by the YUV (luminance color difference signal) conversion unit 3c, and again stored in the storage unit 4 (YUV region). Stored.

  For example, a shooting confirmation image and a thumbnail image created by the transfer data in the first field are displayed on the display unit 6 via the display unit I / F 3e. Further, when the resolution is set to “low”, the YUV signal data is read again from the storage unit 4 and compressed into the JPEG format by the compression processing unit 3d and stored in the storage unit 4 (JPEG area). Further, when storing in the storage unit 4 (JPEG area), header data or the like is added to the JPEG-compressed data and stored as JPEG image data in the external storage unit 4 ′ by the control unit 5.

  Further, when the resolution is set to “medium”, image processing is performed using the transfer data of the first and second fields upon detection of completion of the data transfer of the second field. When the resolution is set to “high”, the data of the third field is used. Image processing using the transfer data of the first, second, and third fields is performed when transfer completion is detected.

  Specifically, when a 3 million pixel CCD with horizontal 2048 pixels and vertical 1536 pixels is used, in the interlaced transfer method in which divided transfer is performed three times, data of horizontal 2048 pixels and vertical 512 pixels is obtained by one transfer. Will be transferred. Therefore, when recording a horizontal 640 pixel and vertical 480 pixel (VGA) size, an image can be generated by the number of transfer pixels in the first field. Furthermore, by using the transfer pixel numbers in the first and second fields (twice), the data becomes horizontal 2048 pixels and vertical 1024 pixels, and the horizontal 1024 pixels and vertical 768 pixels (XGA) size and horizontal 1280 pixels and vertical 1024 pixels are obtained. A size image can be generated.

  When the transfer data of the first field and the first and second fields are used, the horizontal pixel and the vertical pixel have different aspect ratios and the image becomes a long image in the horizontal direction. This is converted by the YUV conversion unit. At this time, the aspect ratio is adjusted by performing processing such as reading out from the storage unit.

  Here, if the purpose is to record an image of the VGA size similar to the shooting confirmation image or the thumbnail image, the transfer processing of the first field is sufficient for the processing of the shot image, so the data transfer of the second and third fields is sufficient. You can speed up the process by stopping the process and moving to the next shooting. That is, using the field transfer data necessary for image processing according to the resolution setting, the next shooting can be started and the processing speeded up without performing unnecessary field data transfer.

  In addition, selecting the transfer data of the first, second, and third fields transferred from the CCD and performing image processing may be performed in accordance with the compression rate setting. For example, when it is desired to record early and transmit quickly, a high compression rate is often selected. Therefore, when a high compression rate is set, image processing is performed using the transfer data in the first field, and the first and second fields are used for the medium compression rate, and the first, second, and third fields are used for the low compression rate. Select to use transfer data.

  FIG. 6 is a diagram showing a display example of a selection screen for setting the resolution on the liquid crystal monitor which is a display unit of the digital camera. As shown in FIG. 6, display “off” or display times “1 second” and “3 seconds” are set in the shooting confirmation image item in the recording setting screen, and “high” and “3” are set in the recording image resolution item. Enter “Middle” and “Low” from the operation panel. Further, the image compression rate can be set by the user's selection with the same display.

  In the above description, data transfer divided into three fields has been described as an example. However, in the future, the number of pixels of the image sensor increases, the transfer time of the total number of pixels increases, and one divided field If the VGA size can be obtained from the number of transfer pixels, the number of fields to be divided may be increased, such as dividing into five fields and transferring data.

  As described above, high-speed image processing can be performed by selecting an optimum process according to the set image output setting.

  The image pickup apparatus and the image pickup method according to the present invention use an interlace transfer type image pickup device in which all color signals are included in one field when transferring charges accumulated in the image pickup device. When the field data transfer is completed, image data can be created, the captured image can be confirmed, the processing time until the start of the next shooting can be shortened, and user convenience can be improved. This is useful as an apparatus and method that uses an interlaced transfer type image sensor that includes a color signal composed of at least RGB or YeCyMgG in the transfer data of each field when transferring the charges accumulated in the field.

1 is a block diagram showing a schematic configuration of a digital camera having an imaging device according to an embodiment of the present invention. Outline of data transfer of a 3: 1 interlace transfer type image pickup device (CCD) that divides into three fields and includes all RGB signals when transferring charges accumulated in the CCD according to the embodiment of the present invention. Figure (A) is a front view showing an external appearance of a digital camera having an imaging device according to the present embodiment, (b) is a side view, and (c) is a top view. The figure which shows the color filter of R, Gr signal, B, Gb signal of a primary color system, and Ye, Cy signal, Mg, G signal of a complementary color system The flowchart which shows operation | movement of embodiment of this invention. The figure which shows the example of a display of the recording setting screen of the digital camera in embodiment of this invention Schematic diagram of conventional interlace transfer type image sensor (CCD) data transfer

Explanation of symbols

1 Image sensor (CCD)
2 Imaging processing unit 3 Signal processing unit 3a CCD-I / F
3b Memory controller 3c YUV conversion unit 3d Compression processing unit 3e Display unit I / F
4 Storage unit (SDRAM)
4 'External storage (memory card)
5 Control unit (CPU)
6 Display unit 7 Operation unit

Claims (8)

An image pickup apparatus using an image pickup element that performs data transfer of the charge divided into a plurality of fields and transfers a plurality of color filters when transferring the charges of the total number of pixels accumulated in the image pickup element,
An image sensor of an interlace transfer method including a color signal composed of at least RGB or YeCyMgG in transfer data of each field for transferring the charge;
Transfer means for transferring charges from the image sensor;
Image processing means for creating the images based on the transfer data of at least one field in the transferred transfer data was in the plurality of fields,
Determining means for determining whether or not the transfer of each field has been completed ,
After the transfer means starts transferring charges of the total number of pixels from the image sensor, the image processing means is transferred in the first field when the determination means determines that the transfer of the first field is completed. A thumbnail image is created based on the transfer data, and the transfer means continues the transfer operation of charges from the image sensor until transfer of an arbitrary number of fields necessary for the resolution of the image to be created is completed, When it is determined by the determination means that the transfer of an arbitrary number of fields necessary for the resolution of the image to be created is completed, the transfer means stops the charge transfer operation from the image sensor, and the image processing means creates An imaging apparatus that creates an image having a resolution set using transfer data having an arbitrary number of fields corresponding to the resolution of the image . The imaging apparatus according to claim 1, wherein the image processing unit performs aspect conversion when creating an image from transfer data . 2. The interlace transfer method according to claim 1, wherein the number of transfers for transferring charges divided into the plurality of fields is performed three times, and each field is an interlaced transfer method in which all pixels are thinned out to 1/3 in the vertical direction. 2. The imaging device according to 2. The image pickup apparatus according to claim 1, wherein the color filter provided in the image pickup element is a color filter that is a primary color system of RGB . A color filter provided in the imaging device, an imaging apparatus according to any one of claims 1 to 3, characterized in that the color filter is a complementary color system YeCyMgG. In the was divided into a plurality of fields of data transfer of the charge, and an imaging method of an imaging apparatus using an imaging device provided with a plurality of color filters in transferring stored in an imaging device to charge the total number of pixels There,
A data transfer process including at least a color signal composed of RGB or YeCyMgG in the transfer data of each field for transferring the electric charge from the image sensor of the interlace transfer method; and at least of the transferred transfer data in the plurality of fields An image processing step of creating an image based on transfer data of one field, and a determination step of determining whether or not transfer of each field is completed,
In the data transfer step, after starting transfer of charges of the total number of pixels from the image sensor, if it is determined by the determination step that transfer of the first field is completed, transfer is performed in the first field by the image processing step. A thumbnail image is created based on the transferred data, and the data transfer step continues the transfer operation of charges from the image sensor until the transfer of an arbitrary number of fields necessary for the resolution of the created image is completed. When it is determined that the transfer of an arbitrary number of fields necessary for the resolution of the image created by the determination step is completed, the data transfer step stops the transfer operation of charges from the image sensor, and the image processing step to, characterized in that to create the image of the set using any number of fields of the transfer data in accordance with the resolution of the image to create the resolution Imaging method. The imaging method according to claim 6 , wherein in the image processing step, aspect conversion is performed when an image is created from transfer data . Three times the number of transfers for transferring charges divided into the plurality of fields, and each field, according to claim 6 or, characterized in that it is interlaced transfer method for thinning 1/3 all the pixels in the vertical direction 8. The imaging method according to 7.

Images