JP2010252089A - Image capturing apparatus and image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology capable of improving high color separability of image without deteriorating an S/N. <P>SOLUTION: An image capturing apparatus includes an image sensor, a selection means and a control means. In the image sensor, a plurality of pixels are provided in a matrix shape on a light receiving surface and the image sensor is comprised of a plurality of color filters which are disposed on a front surface of the light receiving surface corresponding to each of the plurality of pixels. The selection means selects either a first mode or a second mode. In the first mode, an image is generated using pixel values of the plurality of color filters and in the second mode, an image is generated by adding the pixel values of the plurality of color filters on a predetermined number basis and determining pixel values corresponding to spectral characteristics of a plurality of predetermined color filters. The control means performs control to generate an image by output of the pixel values of the plurality of color filters when the first mode is selected by the selection means, and to generate an image by adding the pixel values of the plurality of color filters on the predetermined number basis and for output of the pixel values corresponding to the spectral characteristics, that the plurality of predetermined color filters have, when the second mode is selected. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging apparatus and an image processing program capable of switching between imaging and image processing with high sensitivity or high color separation.

  Conventionally, various techniques for improving high color separation (or color reproducibility) of a subject image have been developed in digital cameras, digital video cameras, and the like having a single-plate image sensor.

  For example, Patent Document 1 captures a subject image using an imaging element provided with a color filter array including five or more color filters having different average wavelengths of spectral transmittance characteristics in order to improve high color separation. In addition, by performing an interpolation process based on the output signal of the neighboring pixels, a signal having a color different from the output signal output from each pixel, thereby improving the color separation and increasing the sensitivity to brightness. Is disclosed.

JP 2005-286649 A

  However, in the conventional technique such as Patent Document 1, the amount of light that can be captured by each color filter is reduced by increasing the number of five or more color filters in order to improve high color separation. As a result, the S / N ratio is deteriorated and it is difficult to increase the sensitivity to brightness.

  In view of the problems of the above-described conventional techniques, an object of the present invention is to provide a technique capable of improving the high color separation of an image without deteriorating the SN ratio.

  In order to solve the above-described problem, an imaging apparatus according to the present invention includes a plurality of color filters in which a plurality of pixels are provided in a matrix on the light receiving surface and are arranged on the front surface of the light receiving surface so as to correspond to each of the plurality of pixels. An image sensor provided with a color filter array comprising: a first mode for generating an image using pixel values of a plurality of color filters; and pixel values of a plurality of color filters are added every predetermined number, A selection unit that selects a second mode in which an image is generated by obtaining pixel values corresponding to the spectral characteristics of a plurality of predetermined color filters; and when the first mode is selected by the selection unit, When the second mode is selected by the selection means by outputting the pixel values of the plurality of color filters, the pixel values of the plurality of color filters are predetermined for the image sensor. It is added to each, and a control unit that performs control to generate an image by outputting a pixel value corresponding to the spectral characteristics possessed by the plurality of predetermined color filter, the.

  In addition, the plurality of color filters may form an adjacent area for each color filter used for adding and reproducing the spectral characteristics of each predetermined color filter, and the areas may be arranged in a predetermined pattern. .

  In addition, when the first mode is selected by the selection unit, the control unit assigns the pixel value of another color filter different from the color filter corresponding to the position of each pixel to the region adjacent to each pixel. Interpolating means for interpolating using pixel values of pixels having other color filters in each of the plurality of regions, and spectral characteristics of a plurality of predetermined color filters using pixel values of the plurality of color filters in each region Calculating means for calculating pixel values corresponding to the respective values;

  The image processing program of the present invention receives an input step of reading image data captured by the imaging apparatus of the present invention and an instruction to perform either the first mode or the second mode for the image data. In response to the instruction input step and the instruction received in the instruction input step, an image using pixel values of the plurality of color filters is generated, or pixel values of the plurality of color filters are added every predetermined number, An image generation step of generating an image by obtaining a pixel value corresponding to a spectral characteristic of a predetermined color filter, and causing the computer to execute it.

  According to the present invention, it is possible to improve the high color separation of an image without deteriorating the SN ratio.

1 is a schematic diagram illustrating a configuration example of a digital camera 100 according to an embodiment of the present invention. The figure which shows a part of pixel arrangement | sequence of the image pick-up element 3 of the digital camera 100 concerning one Embodiment. The figure which shows an example which divides | segments the color filter R used as a reference into the color filters R1-R4 which have the peak of four different spectral characteristics. 7 is a flowchart showing an imaging operation by the digital camera 100 according to an embodiment. The schematic diagram which shows the structural example of the computer 200 which concerns on other embodiment of this invention. The flowchart which shows the image processing by the computer 200 which concerns on other embodiment.

<< One Embodiment >>
FIG. 1 is a configuration diagram of a digital camera 100 according to an embodiment of the present invention.

  The digital camera 100 includes an imaging lens 1, an optical low-pass filter (OLPF) 2, an imaging device 3, an A / D conversion unit 4, a CPU 5, a buffer memory 6, a card interface (card I / F) 7, an operation member 9, and a storage unit. 10 and a display unit 11. The CPU 5, the buffer memory 6, the card I / F 7, the operation member 9, the storage unit 10, and the display unit 11 are connected via a bus 12 so that information can be transmitted. FIG. 1 shows only the main part of the digital camera 100. For example, in FIG. 1, a timing generator that emits timing pulses for imaging instructions to the image sensor 3 and the A / D converter 4 according to a command from the CPU 5, a color filter array provided in front of the light receiving surface of the image sensor 3, and the like are omitted. ing.

  The imaging lens 1 is composed of a plurality of optical lenses, and forms a subject image on the light receiving surface of the imaging device 3 via the OLPF 2.

  The OLPF 2 removes noise such as moire by cutting the vicinity of the sampling frequency of incident light from the subject image via the imaging lens 1. In this embodiment, since 2 pixels × 2 pixels are handled as one pixel as will be described later, the separation width of the OLPF 2 is as shown by the pixel array (part) of the image sensor 3 shown in FIG. The pixel pitch d2 is used as a reference instead of the pixel pitch d1.

  As the imaging device 3, a CCD or CMOS semiconductor image sensor or the like is appropriately selected and used. However, in this embodiment, as shown in FIG. 2, each color filter R (red), G (green), and B (blue) constituting the color filter array provided in front of the light receiving surface of the image sensor 3 is When 2 pixels × 2 pixels are taken as one pixel, they are arranged to be a Bayer array type. Furthermore, in this embodiment, each of the color filters R, G, and B has a spectral characteristic spectrum of the color filter R that has four different spectral characteristics as in the case of the color filter R shown in FIG. The color filters R1 to R4 having peaks are divided. The same applies to the other color filters G and B. Thereby, the image sensor 3 corresponds to a color filter array having 12 color filters, and can achieve high color separation. Further, by adding each of the color filters R1 to R4, the color filters G1 to G4, and the color filters B1 to B4, it is possible to reproduce a spectrum having a spectral characteristic peak of each color filter R, G, and B. High sensitivity can also be achieved.

  As shown in FIG. 3, the peaks and spectral widths of the four color filters R1 to R4 are different from each other, but they may all have the same peak value and spectral width except for the peak position. FIG. 2 shows a part of the pixel array of the image sensor 3. The leading symbols R, G, and B of each pixel indicate a reference color filter, and the subsequent numbers are as shown in FIG. , Indicates whether the reference color filter is divided. Further, the subsequent two-digit number indicates the position of the pixel and is based on the upper left.

  The image sensor 3 operates based on timing pulses generated by a timing generator (not shown) in response to a command from the CPU 5 and acquires a subject image formed by the imaging lens 1 provided in front. The image signal output from the image sensor 3 is converted into a digital signal by the A / D converter 4. The digital image signal is temporarily recorded in a frame memory (not shown) and then recorded in the buffer memory 6. Note that, as will be described later, the image pickup device 3 according to the present embodiment outputs image signals from all the pixels, that is, the color filters R1 to R4, the color filters G1 to G4, and the pixel values of the color filters B1 to B4. There are two modes: a separation mode and a high sensitivity mode in which 2 pixels × 2 pixels of the color filters R1 to R4, the color filters G1 to G4, and the color filters B1 to B4 are added as one pixel and an image signal is output. As the buffer memory 6, any non-volatile memory among semiconductor memories can be appropriately selected and used.

  When the user presses the power button on the operation member 9, the CPU 5 turns on the digital camera 100. The CPU 5 reads the control program and the image processing program stored in the storage unit 10 and initializes the digital camera 100. When the CPU 5 receives an instruction from the user via the operation member 9, the CPU 5 outputs a subject imaging command to a timing generator (not shown) based on the control program, and the captured image based on the image processing program. Control of white balance correction, pixel value interpolation processing, image processing such as γ correction and gradation correction, recording in the card memory 8 and recording unit 10, and display on the display unit 11 is performed. As the CPU 5, a general central processing unit can be used.

  A card memory 8 is detachably attached to the card I / F 7. The image recorded in the buffer memory 6 is subjected to image processing by the CPU 5 and then recorded in the card memory 8 as a file in JPEG format or YUV format.

  The operation member 9 outputs an operation signal corresponding to the content of the member operation by the user to the CPU 5. The operation member 9 includes, for example, operation members such as a power button, a mode setting button such as a shooting mode, and a release button. The operation member 9 may be a touch panel type button provided on the front surface of the screen of the display unit 11 to be described later.

  The storage unit 10 records image data captured by the digital camera 100 and stores various programs such as a control program and an image processing program for the CPU 5 to control the digital camera 100. Programs and data stored in the storage unit 10 can be referred to as appropriate from the CPU 5 via the bus 12. As the storage unit 10, a general hard disk device, a magneto-optical disk device, an arbitrary nonvolatile semiconductor memory, or the like can be appropriately selected and used.

  The display unit 11 displays a low-resolution image (so-called through image) for composition confirmation, a captured image, a mode setting screen, or the like. A liquid crystal monitor or the like can be appropriately selected and used for the display unit 11.

  Next, the imaging operation of the digital camera 100 according to the present embodiment will be described with reference to the flowchart of FIG.

  When the power button of the operation member 9 is pressed by the user, the CPU 5 reads the control program and the image processing program stored in the storage unit 10 of the digital camera 100, initializes the digital camera 100, and performs the processing from step S10. I do. In the following description, pixel value processing for the pixels R1_33, R2_34, R3_43, and R4_44 illustrated in FIG. 2 will be described as an example. The same processing is performed for other pixels.

  Step S10: The CPU 5 sets the high-color separation mode or the high-sensitivity mode together with the setting of the photographing mode such as portrait and landscape through the operation of the mode setting button of the operation member 9 by the user. When the shooting mode is set, the setting of the high color separation mode or the high sensitivity mode may be determined accordingly.

  Step S11: The CPU 5 determines whether or not the high color separation mode is selected and set by the user. When it is determined that the high color separation mode is set, the CPU 5 proceeds to step S12 (YES side), and when it is determined that the high sensitivity mode is set, the CPU 5 proceeds to step S18 (NO side).

  Step S12: The CPU 5 stands by until an instruction to capture a subject image is issued from the user. When the release button of the operation member 9 is pressed by the user, the CPU 5 determines that an imaging instruction has been issued, and instructs the timing generator (not shown) of the imaging command in the high color separation mode to the imaging device 3. A pulse is emitted to cause the image sensor 3 to acquire a subject image formed by the imaging lens 1. The image sensor 3 outputs an image signal of pixel values of all pixels based on a timing pulse instructing output of pixel values of all pixels emitted from a timing generator (not shown), and via the A / D converter 4. To be recorded in the buffer memory 6. Note that the CPU 5 performs image processing on image data, which is RAW data recorded in the buffer memory 6, in order to perform image processing similar to that of the present embodiment in a computer 200 according to another embodiment of the present invention described later, A RAW image file to which the high color separation mode is added as header information together with imaging information such as exposure time and ISO sensitivity may be recorded in the card memory 8 or the storage unit 10.

  Step S13: The CPU 5 reads the image data captured in the high color separation mode from the buffer memory 6 via the bus 12, and records it in a memory (not shown) in the CPU 5. The CPU 5 performs white balance processing on the image data according to the image processing program.

Step S14: The CPU 5 acquires pixel values of other color filters different from the color filter corresponding to each pixel based on the interpolation process. Specifically, the CPU 5 regards the pixel values of the color filter G and the color filter B at the position of R1_33 as, for example, the pixels R1_33, R2_34, R3_43, and R4_44 as 2 pixels × 2 pixels as one region. The pixel values of the G and B regions adjacent to the pixel are calculated using the following equations (1) and (2).
G1_33 = (G1_31 + G1_13 + G1_35 + G1_53) / 4 (1)
G2_34 = (G2_32 + G2_14 + G2_36 + G2_54) / 4
G3_43 = (G3_41 + G3_23 + G3_45 + G3_63) / 4
G4_44 = (G4_42 + G4_24 + G4_46 + G4_64) / 4
B1_33 = (B1_11 + B1_15 + B1_55 + B1_51) / 4 (2)
B2_34 = (B2_12 + B2_16 + B2_56 + B2_52) / 4
B3_43 = (B3_21 + B3_25 + B3_65 + B3_61) / 4
B4_44 = (B4_22 + B4_26 + B4_66 + B4_62) / 4
In the present embodiment, in the expressions (1) and (2), for example, at the position of the pixel R1_33, the same as the position where the pixel is located in a plurality of other areas adjacent to the area including the pixel. Interpolation is performed using pixel values of pixels (G1_31, B1_11, etc.) having other color filters at positions.

  Step S15: The CPU 5 obtains, for example, (R1_33, G1_33, B1_33), (R2_34, G2_34, B2_34), (R3_43, G3_43, B3_43), and (R4_44) at each pixel position obtained by the interpolation processing in step S14. The pixel values of G4_44, B4_44) are substituted into the following equation (3) and added to form a 2 pixel × 2 pixel region composed of pixels R1_33, R2_34, R3_43, and R4_44 as one pixel, and high color separation processing is performed. The pixel values of the color filters R33, G33 and B33 serving as the reference are calculated.

ここで、行列の各パラメータｍ_ｉｊ（ｉ＝１，２，３、ｊ＝１，２，…，１２）の値は、製造段階で予め決められる。また、Ｒ３３、Ｇ３３及びＢ３３は、画素Ｒ１_３３、Ｒ２_３４、Ｒ３_４３及びＲ４_４４からなる２画素×２画素の領域の加算した画素値を表し、その領域の位置を表すためにその領域のうち左上にある画素の位置の２桁の番号を用いて表している。この式（３）による加算処理によって、高色分解を維持するとともに、４画素を１画素として加算することにより、高感度性も図ることができる。

Here, the value of each parameter m _ij (i = 1, 2, 3, j = 1, 2,..., 12) of the matrix is predetermined in the manufacturing stage. R33, G33, and B33 represent pixel values obtained by adding a 2 pixel × 2 pixel region composed of pixels R1_33, R2_34, R3_43, and R4_44, and the pixel located in the upper left of the region to indicate the position of the region. This is expressed using a two-digit number at the position. High color separation can be maintained by the addition processing according to Expression (3), and high sensitivity can be achieved by adding four pixels as one pixel.

  Step S16: The CPU 5 performs image processing such as γ correction and gradation correction on the image data processed in step S15 or step S20 described later.

  Step S17: The CPU 5 converts the processed image data recorded in a memory (not shown) in the CPU 5 into a file such as a JPEG format or a YUV format, and the card memory via the bus 12 and the card I / F 7 8, the processed image data is displayed on the display unit 11, and the series of operations is completed.

Step S18: The CPU 5 stands by until an instruction for capturing a subject image from the user is issued. When the release button of the operation member 9 is pressed by the user, the CPU 5 determines that an imaging instruction has been issued, and sends a timing pulse of an imaging command in the high sensitivity mode to the imaging device 3 to a timing generator (not shown). To cause the image sensor 3 to acquire the subject image formed by the imaging lens 1. Based on the timing pulse generated by the timing generator (not shown), the imaging device 3 uses, for example, the pixel value of the region of 2 pixels × 2 pixels including the pixels R1_33, R2_34, R3_43, and R4_44 using the following equation (4). Then, the image signal added as the pixel value of one pixel is output and recorded in the buffer memory 6 via the A / D converter 4. Note that the CPU 5 performs image processing on image data, which is RAW data recorded in the buffer memory 6, in order to perform image processing similar to that of the present embodiment in a computer 200 according to another embodiment of the present invention described later, A RAW image file to which the high sensitivity mode is added as header information together with imaging information such as exposure time and ISO sensitivity may be recorded in the card memory 8 or the storage unit 10.
R33 = R1_33 + R2_34 + R3_43 + R4_44 (4)
R33 represents the pixel value of the color filter R as a reference obtained by adding a 2 pixel × 2 pixel area composed of the pixels R1_33, R2_34, R3_43, and R4_44, and the upper left of the area represents the position of the area. The two-digit number of the position of the pixel in

  Step S19: The CPU 5 reads the image data captured in the high sensitivity mode from the buffer memory 6 via the bus 12, and records it in a memory (not shown) in the CPU 5. The CPU 5 performs white balance processing on the image data according to the image processing program.

Step S20: The CPU 5 acquires pixel values of other color filters different from the color filters in each region based on the interpolation process. Specifically, the CPU 5 sets the pixel values of the color filters G and B serving as the reference at the position of the region R33, for example, the pixel values of the color filters G and B adjacent to the region R33, using the following formula (5 ) And the following interpolation formula (6).
G33 = (G31 + G13 + G35 + G53) / 4 (5)
B33 = (B11 + B15 + B55 + B51) / 4 (6)
CPU5 transfers to step S16, performs the process of step S16 and step S17, and complete | finishes a series of work.

  As described above, in this embodiment, each of the color filters R, G, and B having the reference spectral characteristics is replaced with the color filters R1 to R4, the color filters G1 to G4, and the color filters having four different spectral characteristics. The image is picked up by the image pickup device 3 having a color filter array arranged in a Bayer pattern, and divided into 2 pixels × 2 pixels. By treating and processing as one pixel, high sensitivity can be maintained and high color separation can be improved without deteriorating the SN ratio.

Further, with one digital camera 100, the subject image can be picked up by appropriately switching according to the setting of the high color separation mode and high sensitivity mode or the setting of the shooting mode by the user.
<< Other Embodiments >>
FIG. 5 is a conceptual diagram when an image processing program according to another embodiment of the present invention is applied to a computer 200.

  A computer 200 shown in FIG. 1 includes a CPU 20, a storage unit 30, an input / output interface (input / output I / F) 40 and a bus 50, and the CPU 20, the storage unit 30 and the input / output I / F 40 are connected via the bus 50. Connected so that information can be transmitted. The computer 200 is connected to an output device 60 that displays the progress of image processing and processing results, and an input device 70 that receives input from the user via the input / output I / F 40. As the output device 60, a general liquid crystal monitor, a printer, or the like can be used. As the input device 70, a keyboard, a mouse, or the like can be appropriately selected and used.

  The CPU 20 reads an image processing program stored in the storage unit 30 based on an instruction from the user received by the input device 70 and performs image processing on the image data stored in the storage unit 30. The CPU 20 displays the image processing result of the image data on the output device 60. A general central processing unit can be used for the CPU 20.

The storage unit 30 records RAW image data of a subject image captured by the digital camera 100 according to an embodiment, an image processing program for the image data, and the like. In addition, the storage unit 30 stores each parameter m _ij (i = 1, 2, 3, j = 1, 2,..., 12) of a matrix determined in advance in the manufacturing stage of the expression (3) used in the embodiment. The value of is also recorded. Data, programs, and the like stored in the storage unit 30 can be appropriately referred to from the CPU 20 via the bus 50. A storage device such as a general hard disk device or a magneto-optical disk device can be selected and used for the storage unit 30.

  In the present embodiment, the RAW image data captured by the digital camera 100 according to one embodiment recorded in the storage unit 30 is not shown, but the card I provided in the input / output I / F 40 is not shown. The memory unit 30 is transferred to the computer 200 by inserting the card memory 8 into / F, or by connecting the digital camera 100 and the input / output I / F 40 according to one embodiment with a USB cable or the like. To be recorded. 5 is incorporated in the computer 200, it may be an external storage device. In this case, the storage unit 30 is connected to the computer 200 via the input / output I / F 40 with a USB cable or the like.

  Next, the procedure of image processing by the computer 200 according to the present embodiment will be described with reference to the flowchart of FIG.

A user inputs an image processing program command or double-clicks an icon of the program using the input device 70, and issues a program start command. The CPU 20 accepts the command via the input / output I / F 40, and reads and executes the image processing program stored in the storage unit 30 and the matrix parameter _mij in Expression (3). As a result, the processing from step S30 in FIG. 6 is performed. In the following description, pixel value processing for the pixels R1_33, R2_34, R3_43, and R4_44 illustrated in FIG. 2 will be described as an example. The same processing is performed for other pixels.

  Step S30: The CPU 20 accepts the file name of which RAW image data based on the input operation of the input device 70 by the user. The CPU 20 reads RAW image data having a file name designated by the input device 70 by the user from the storage unit 30 and records it in a memory (not shown) in the CPU 20.

  Step S31: The CPU 20 determines whether or not the high color separation mode is selected and set by referring to the header information of the read RAW image data. When determining that the high color separation mode is set, the CPU 20 proceeds to step S32 (YES side), and when determining that the high sensitivity mode is set, the CPU 20 proceeds to step S37 (NO side).

  Step S32: The CPU 20 performs white balance processing on the RAW image data in accordance with the image processing program.

  Step S33: The CPU 20 uses the expression (1) and the expression (2) for pixel values of other color filters different from the color filter of each pixel, based on the same processing as that of step S14 of one embodiment. Obtained by interpolation processing.

  Step S34: The CPU 20 obtains, for example, (R1_33, G1_33, B1_33), (R2_34, G2_34, B2_34), (R3_43, G3_43, B3_43), and (R4_44,) at each pixel position obtained by the interpolation processing in step S33. The pixel value of G4_44, B4_44) is substituted into Expression (3) and added, so that a 2 pixel × 2 pixel region composed of the pixels R1_33, R2_34, R3_43, and R4_44 is one pixel and subjected to high color separation processing. Pixel values of the color filters R33, G33, and B33 serving as the reference are calculated.

  Step S35: The CPU 20 performs image processing such as γ correction and gradation correction on the image data processed in step S34 or step S38 described later.

  Step S36: The CPU 20 converts the processed image data recorded in a memory (not shown) in the CPU 20 into a file such as a JPEG format or a YUV format, and records it in the storage unit 30 via the bus 50. The processed image data is displayed on the output device 60 via the input / output I / F 40, and the series of operations is completed.

  Step S37: The CPU 20 performs white balance processing on the RAW image data in accordance with the image processing program.

  Step S38: The CPU 20 uses the expression (5) and the expression (6) for the pixel values of the other color filters different from the color filters in each region based on the same process as the step S20 in the embodiment. Obtained by interpolation processing. CPU20 transfers to step S35, performs the process of step S35 and step S36, and complete | finishes a series of work.

As described above, in this embodiment, each of the color filters R, G, and B having the reference spectral characteristics is replaced with the color filters R1 to R4, the color filters G1 to G4, and the color filters having four different spectral characteristics. RAW image data picked up by the image pickup device 3 having a color filter array arranged in a Bayer type array by dividing the image into B1 to B4 and forming an area of 2 × 2 pixels. By performing image processing that treats two pixels as one pixel, high sensitivity can be maintained and high color separation can be improved without deteriorating the SN ratio.
≪Supplementary items for the embodiment≫
In one embodiment and other embodiments, each of the color filters R, G, and B having the reference spectral characteristic is replaced with the color filters R1 to R4, the color filters G1 to G4 having four different spectral characteristic peaks, and Although divided into color filters B1 to B4, the present invention is not limited to this, and may be divided into an arbitrary number of color filters such as 2, 9, or 16. Accordingly, it is preferable to handle 2 pixels, 3 pixels × 3 pixels, 4 pixels × 4 pixels, or the like as one pixel. Moreover, it is preferable to use an OLPF 2 having a separation width designed to have a three-pixel pitch or the like.

  In one embodiment and other embodiments, in the interpolation processing of image data captured in the high color separation mode in step S14 or step S33, for example, at the position of the pixel R1_33, adjacent to the region including the pixel Interpolation is performed using pixel values of pixels (G1_31, B1_11, etc.) having other color filters that are in a plurality of other regions and in the same position as the pixel is located. However, the present invention is not limited to this. Alternatively, the pixel R1_33 may be obtained by interpolation using pixel values (for example, G2_32 or B1_15) of a pixel having another color filter at a position different from the position where the pixel R1_33 is located.

  In one embodiment and other embodiments, image processing is performed on still image data. However, the present invention is not limited to this, and can also be applied to moving images and through images.

  In another embodiment, in step S31, the CPU 20 determines whether or not the high color separation mode is selected and set by referring to the header information of the read RAW image data. It is not limited to. For example, since the number of pixels of the RAW image data in the high color separation mode is larger than the number of pixels in the high sensitivity mode, the number of pixels may be used as a determination criterion, or directly from the user via the input device 70. The designation of the high color separation mode or the high sensitivity mode may be accepted.

  The present invention can be implemented in various other forms without departing from the spirit or the main features thereof. For this reason, the above-described embodiment is merely an example in all respects and should not be construed in a limited manner. Further, all modifications and changes belonging to the equivalent scope of the claims are within the scope of the present invention.

1 imaging lens, 2 OLPF, 3 imaging device, 4 A / D conversion unit, 5 CPU, 6 buffer memory, 7 card I / F, 8 card memory, 9 operation member, 10 storage unit, 11 display unit, 12 bus, 100 digital camera

Claims (4)

An image sensor in which a plurality of pixels are provided in a matrix on the light receiving surface, and a color filter array including a plurality of color filters disposed on the front surface of the light receiving surface so as to correspond to each of the plurality of pixels. When,
Pixels corresponding to spectral characteristics of a plurality of predetermined color filters by adding a first mode for generating an image using pixel values of the plurality of color filters and a predetermined number of pixel values of the plurality of color filters. Selection means for selecting a second mode for obtaining a value and generating an image;
When the first mode is selected by the selection unit, an image is generated by outputting pixel values of the plurality of color filters to the image sensor, and the second mode is selected by the selection unit. In this case, the pixel values of the plurality of color filters are added to the image sensor every predetermined number, and the pixel values corresponding to the spectral characteristics of the plurality of predetermined color filters are output to generate an image. Control means for performing control,
An imaging apparatus comprising: The imaging device according to claim 1,
The plurality of color filters form an adjacent area for each color filter used for adding and reproducing the spectral characteristics of the predetermined color filters, and the areas are arranged in a predetermined pattern. An imaging apparatus characterized by that. The imaging device according to claim 2,
The control means includes
When the first mode is selected by the selection means,
The pixel value of another color filter different from the color filter corresponding to the position of each pixel is set to the value of the pixel having the other color filter in each of a plurality of other regions adjacent to the region including the pixels. Interpolation means for performing interpolation using pixel values;
Calculating means for calculating pixel values corresponding to spectral characteristics of the plurality of predetermined color filters using pixel values of the plurality of color filters in the respective regions;
An imaging apparatus comprising: An input step of reading image data captured by the imaging device according to any one of claims 1 to 3,
An instruction input step for receiving an instruction to perform either the first mode or the second mode on the image data;
In response to the instruction received in the instruction input step, an image using pixel values of a plurality of color filters is generated, or pixel values of the plurality of color filters are added for each predetermined number to generate a plurality of predetermined colors. An image generation step of generating an image by obtaining a pixel value corresponding to a spectral characteristic of the filter;
An image processing program that is executed by a computer.

Images