JP5153293B2 - Image processing apparatus and image processing program - Google Patents

Description

  The present invention relates to an image processing apparatus and an image processing program.

  2. Description of the Related Art Conventionally, an image processing apparatus such as an electronic camera that records and reproduces a still image or a moving image captured by an image sensor such as a CCD or CMOS using a memory card having a memory element as a recording medium is commercially available.

  Some of these electronic cameras record unprocessed image data (hereinafter referred to as “RAW data”) composed of pixel data as it is output from the image sensor as a captured image on a recording medium.

  The raw data cannot be displayed as it is on a display unit of an information processing apparatus such as a personal computer, and image processing such as pixel interpolation processing is required for the display. For this reason, information at the time of shooting is added to the RAW data as an image parameter (see Patent Document 1), and can be displayed by an image processing program installed in the information processing apparatus.

  Further, in an image processing apparatus such as an electronic camera, automation and multi-functionalization such as AE (auto exposure: automatic exposure) and AF (auto focus: auto focus) are achieved, and good photographing can be easily performed. ing. There are several methods for focus detection, such as those disclosed in Patent Document 2 and Patent Document 3.

  The imaging device described in Patent Document 2 is configured such that a part of the photoelectric conversion unit group receives a light beam that passes through a specific region of the pupil of the photographing lens. Then, the focus state of the photographing lens is detected based on the phase difference between the first image signal and the second image signal obtained from the outputs of these specific photoelectric conversion units. Here, the phase difference is a relative positional relationship between two image signals. When a normal image is captured, the image is generated by a photoelectric conversion unit group excluding the photoelectric conversion unit that receives a light beam that passes through a specific region of the photographing lens. Then, after interpolating ranging pixels of the image sensor from surrounding color pixels, signal processing and image compression processing are performed to generate and record data in JPEG format or TIFF format.

Patent Document 3 also discloses an imaging apparatus that performs pupil division type focus detection. In this imaging apparatus, the pixels having the same color filter arranged in a row adjacent to each other are arranged on a straight line passing through the center of the microlens, and the adjacent pixels are shifted in the opposite direction with respect to the center of the microlens. A light beam passing through a specific region of the lens pupil is received. The focus state of the photographing lens is detected based on the phase difference between the first image signal and the second image signal obtained from the outputs of these specific photoelectric conversion units.
JP 2003-324745 A JP 2000-156823 A JP 2005-303409 A

  In Patent Document 2, when a focus detection pixel is formed by a pixel corresponding to a G color filter and an image signal is formed, a video signal of a G color filter portion of the focus detection pixel is used by using peripheral pixels. Interpolated.

  Further, in Patent Document 3, when a focus detection pixel is formed by a G color filter portion and an image signal is formed, the image signal is formed as a video signal received by the G color filter of the focus detection pixel. doing. For this reason, the light beam is received by the focus detection pixel when in the vicinity of the focus, but there is a problem that the light beam is not received by the focus detection pixel when it is not in the vicinity of the focus. Therefore, the video signal of the G color filter portion of the focus detection pixel that is not in the vicinity of the focus is interpolated using the peripheral pixels.

  Thus, at the time of RAW data recording, since the focus detection pixel is scratched by the user, it is desirable to record the RAW data after interpolation. However, according to the conventional technique, when the RAW data after flaw correction is recorded, the distance measurement information does not remain when the RAW data is recorded.

  The present invention has been made in view of the above problems, and an object of the present invention is to perform flaw correction of RAW data and to secure distance information of focus detection pixels.

A first aspect of the present invention relates to an image processing apparatus, wherein a first pixel that receives a light beam that has passed through an exit pupil of a photographing lens and a light beam in which a part of the exit pupil of the photographing lens is shielded are received. An imaging device in which two pixels are arrayed, separation means for separating a pixel signal of the second pixel from an output signal of the imaging device, and position information of the second pixel based on positional information of the second pixel. Generation means for interpolating a pixel signal at the position of the second pixel in the output signal to generate RAW data, and focus information used for autofocus processing from the pixel signal of the second pixel separated by the separation means Focus information creating means for creating, and recording means for recording a pixel signal of the second pixel and position information of the second pixel as a file in association with the generated RAW data. Toss .

A second aspect of the present invention relates to an image processing apparatus, wherein a first pixel that receives a light beam that has passed through an exit pupil of a photographing lens and a light beam that is partially shielded from the exit pupil of the photographing lens. An image sensor in which two pixels are arrayed, separation means for separating the pixel signal of the second pixel from the output signal of the image sensor, and the position of the second pixel in the output signal of the image sensor Focusing information corresponding to each of the plurality of regions based on the pixel signal of the second pixel separated by the separation unit and divided into a plurality of regions by generating means for interpolating the pixel signals and generating RAW data And a recording means for recording the pixel signal of the second pixel and the position information of the second pixel as a file in association with the generated RAW data. Characterize

According to a third aspect of the present invention, there is provided an image processing program, wherein the computer executes a step of processing the focus information created by the focus information creating unit and displaying the result on a display unit. .

  According to the present invention, it is possible to perform flaw correction of RAW data and to secure distance measurement information or distance information of focus detection pixels.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram of an image processing apparatus according to a preferred first embodiment of the present invention. A subject image incident through the lens 100 is photoelectrically converted into an electric signal by the image sensor 101. Here, the imaging element 101 includes imaging pixels (R, G, B) for forming image data and focus detection pixels (a, b) for performing phase difference AF, as shown in FIG. Is arranged.

  The A / D conversion unit 103 converts the electrical signal (output signal) output from the image sensor 101 into a digital signal. The digital signal processing unit 104 converts the digital signal output from the A / D conversion unit 103 into image data in the YUV data format. The A / D conversion unit 103 can be configured by a WB circuit, a γ correction circuit, a matrix conversion circuit, and the like.

  The CPU 108 controls each unit of the image processing apparatus. For example, the CPU 108 obtains the pixel signal of the focus detection pixel (a, b) from the digital signal output from the A / D conversion unit 103 based on the position information of the focus detection pixel recorded in the ROM in the CPU 108. It can function as a separating means for separating. The CPU 108 also functions as a generation unit that generates RAW data by interpolating the pixel signal of the focus detection pixel among the digital signals output from the A / D conversion unit 103 based on the position information of the focus detection pixel. sell. Such interpolation processing is performed by determining the position of the focus detection pixel based on the position information of the focus detection pixel and interpolating the pixel signal of this portion from the surrounding pixels. For example, when a in FIG. 3 is interpolated, a known bicubic method or the like may be used using pixel signals of peripheral R pixels. The CPU 108 can also function as distance measurement information creating means for creating distance measurement information in which the pixel signal of the separated focus detection pixel and the position information of the focus detection pixel are associated with each other. Further, the CPU 108 divides the pixel signal of the separated focus detection pixels into a plurality of areas, calculates a focal distance, and creates distance information that associates the calculated focal distance with the position information for each of the plurality of areas. It can also function as a creation means. Further, the CPU 108 serves as a file generation unit that generates a RAW file from the RAW data and the distance measurement information, and a recording unit that records the distance measurement information and the RAW file in the memory 107 such as a recording medium via the memory I / F 106. Can also work.

  Note that the digital signal processing unit 104 may have separation means for separating the pixel signals of the focus detection pixels (a, b) functioning in the CPU 108. Also, the digital signal processing unit 104 has functions such as a generation unit that generates pixel data by interpolating pixel signals of focus detection pixels, a distance measurement information generation unit that generates distance measurement information, and a distance information generation unit that generates distance information. You may have it.

  The phase difference detection unit 105 performs phase difference detection by a known method based on the pixel signals of the focus detection pixels (a, b) separated by the digital signal processing unit 104 or the CPU 108. The phase difference detection result obtained by the phase difference detection unit 105 is sent to the CPU 108. The CPU 108 outputs a control signal to the lens barrel control unit 111 based on the detection result sent from the phase difference detection unit 105.

  The operation unit 112 includes a button for switching the shooting mode between still image shooting and moving image shooting, a setting switch such as a shutter switch, and the like. The CPU 108 sends a control signal to the timing control unit 109 according to the shooting mode set by the operation unit 112. The timing generator 110 generates a read drive signal for image data based on a control signal from the timing control unit 109.

  The image data in the YUV data format output from the digital signal processing unit 104 is temporarily stored in the memory 107 via the memory I / F 106 for EVF display. The LCD I / F 113 converts the image data in the YUV data format stored in the memory 107 into a display format of the LCD 114 as a display unit via the memory I / F 106. The LCD 114 performs EVF display based on the image data output from the LCD I / F 113.

  Further, during image recording, image data in the YUV data format output from the digital signal processing unit 104 is subjected to compression processing in accordance with a standard such as JPEG in the compression recording unit 115 via the memory I / F 106 and stored in the memory 116.

  FIG. 2 is a flowchart from start-up to photographing of the image processing apparatus according to the preferred first embodiment of the present invention.

  In S100, the operation unit 112 turns on the power.

  In S <b> 101, the CPU 108 determines whether the shutter SW <b> 1 of the operation unit 112 is half pressed. If it is determined in S101 that the shutter SW1 has been pressed ("YES" in S101), the process proceeds to S102.

  In S102, the CPU 108 controls the phase difference detection unit 105 to perform AF processing. As the AF processing, for example, it is preferable to use the technique described in Patent Document 2. The AF process described in Patent Document 2 will be described with reference to FIGS. FIG. 3 shows a pixel array of an image sensor such as a CCD or CMOS. The basic pixel array constituting this pixel array is composed of a Bayer array of green pixels, red pixels, and blue pixels. Each pixel has an opening, and the light beam that has passed through the opening is received by the photoelectric conversion unit.

  In FIG. 3, the green pixel is G, the red pixel is R, and the blue pixel is B. The green pixel G is provided with a color filter that allows a green light beam to pass therethrough, the red pixel R is provided with a color filter that allows a red light beam to pass through, and the blue pixel B is provided with a color filter that allows a blue light beam to pass therethrough. A photoelectric conversion unit is disposed below the opening of each pixel. Thus, one pixel is composed of one photoelectric conversion unit, a color filter disposed thereon, and a microlens disposed further thereon. In addition, among the green pixels lined up diagonally, at least one row is a focus detection pixel row, and the other pixels are imaging pixels. A color filter is not arranged in the focus detection pixel column. By providing a light-shielding layer at a part of the openings of the focus detection pixels arranged in a row adjacent to each other, the exit pupil of the photoelectric conversion unit is configured to be biased with respect to the optical axis of the photographing lens. The direction of the bias is opposite between adjacent focus detection pixels. Further, a and b are focus detection pixels, and signals obtained by receiving the light beams that have passed through a and b are an A image signal and a B image signal.

  The focus detection pixels that receive the A image signal-B image signal are arranged on the same line as shown in FIG. The A image signal-B image signal is an image signal based on light emitted from the same line of the subject. Therefore, when the focus detection state is detected, the A image signal-B image signal has a substantially matched shape. To perform focus detection, a correlation calculation is performed on the A image signal-B image signal, and the defocus amount of the photographing lens is calculated from the shift amount of the two image signals. Based on the defocus amount calculated in the defocus amount calculation, the photographing lens is driven to perform focusing.

  Here, the correlation calculation process in the defocus amount calculation will be described. Assuming that an A image signal and a B image signal as shown in FIG. 4 are obtained, the phase difference between the two generated image signals varies depending on the imaging state (focused state, front pin state, rear pin state) of the photographic lens. To do. There is no phase difference between the two image signals when the photographic lens is in focus, and phase differences in different directions occur between the front pin state and the rear pin state. Further, the phase difference between the two image signals has a certain relationship with the defocus amount of the photographing lens. Here, the defocus amount is the distance between the position where the subject image is formed by the photographing lens and the top surface of the microlens. The defocus amount of the photographing lens is obtained from the phase difference between the two image signals, and the focus detection is performed by calculating the lens driving amount that brings the photographing lens into a focused state.

  The phase difference between the two image signals can be obtained by correlating the two image signals. The correlation is called the “MIN algorithm”, where the output data of the A image signal is A [1] to A [n] and the output data of the B image signal is B [1] to B [n]. The correlation amount U0 is expressed as Equation 1.

…（数式１）
ここでｍｉｎ（ａ、ｂ）はａ、ｂの小さい方の値のことである。まずこのＵ０を計算する。次に図４に示すように、Ａ像信号を信号電圧の１ビットシフトしたデータとＢ像信号のデータの相関量Ｕ１を計算する。このＵ１は数式２のように表される。

... (Formula 1)
Here, min (a, b) is the smaller value of a and b. First, U0 is calculated. Next, as shown in FIG. 4, the correlation amount U1 between the data obtained by shifting the A image signal by 1 bit of the signal voltage and the data of the B image signal is calculated. This U1 is expressed as Equation 2.

…（数式２）
このように１ビットずつシフトした相関量を次々に計算する。２つの像信号が一致していればこの相関量は最大値をとるので、その最大値をとるシフト量を求め、その前後のデータから相関量の真の最大値を補間して求め、そのシフト量を２つの像信号の位相差とする。この２つの像信号の位相差から撮影レンズのデフォーカス量を求め、撮影レンズが合焦状態になるようなレンズ駆動量を算出することで焦点検出を行う。ＡＦ処理後、被写体にピントが合った状態となる。

... (Formula 2)
Thus, the correlation amount shifted by one bit is calculated one after another. If the two image signals match, this correlation amount takes the maximum value, so the shift amount that takes the maximum value is obtained, the true maximum value of the correlation amount is interpolated from the data before and after that, and the shift is obtained. Let the amount be the phase difference between the two image signals. The defocus amount of the photographing lens is obtained from the phase difference between the two image signals, and the focus detection is performed by calculating the lens driving amount that brings the photographing lens into a focused state. After AF processing, the subject is in focus.

  In S103, when the CPU 108 determines that the shutter SW2 of the operation unit 112 is changed from the half-pressed state to the fully-pressed state, the process proceeds to S104. When the shutter SW1 and the shutter SW2 are turned off in S103, the process returns to S101, and the CPU 108 waits for the shutter SW1 to be turned on again. In S <b> 104, the CPU 108 performs shooting processing described later with reference to FIG. 5.

  FIG. 5 is a flowchart showing the photographing process shown in step 104 of FIG.

  In step S401, the CPU 108 controls the timing control unit 109 and the timing generator 110 to output pixel signals from an image sensor such as a CCD or CMOS having focus detection pixels.

  In S402, the A / D converter 103 A / D converts the pixel signal to generate image data including focus detection pixel data. FIG. 6 shows image data including focus detection pixel data.

  FIG. 6 shows image data composed of lines having a plurality of focus detection pixels with normal Bayer arrays G, R, and B. G is a green pixel, R is a red pixel, and B is a blue pixel, and these constitute a Bayer array. Reference symbols a1, a2, a3, a4, b1, b2, b3, and b4 are focus detection pixels.

  In S403, the CPU 108 determines whether or not the RAW data shooting is performed. If it is not RAW data shooting (“NO” in S403), the process proceeds to S407. If it is determined in S403 that the shooting is RAW data (“YES” in S403), the process proceeds to S404.

  In step S404, the CPU 108 performs focus detection pixel separation processing (hereinafter referred to as “focus detection pixel separation processing”). The focus detection pixel separation process will be described later.

  In step S405, the CPU 108 performs a scratch correction process including the focus detection pixels. During the flaw correction process, flaw correction is performed from the neighboring green pixels based on the position information of the focus detection area stored in advance in an EEPROM (electrically erasable programmable ROM) by an adjustment process or the like, or the position information of defective pixels of the image sensor. Do. FIG. 7 shows image data after flaw correction. In FIG. 7, Ga1, Ga2, Ga3, Ga4, Gb1, Gb2, Gb3, and Gb4 are green pixels that have been flaw corrected from their neighboring pixels.

  In S406, the CPU 108 performs file processing. In the file processing, information at the time of shooting is added as an image parameter. The information at the time of shooting includes data such as white balance, sharpness, and contrast. The image processing program includes all information necessary for displaying the RAW file on the display unit.

  In S407, the CPU 108 corrects the focus detection pixels as flaws.

  In step S408, the digital signal processing unit 104 performs image signal processing (white balance, sharpness, and the like), and performs compression processing in, for example, the JPEG format, the TIFF format, and the like.

  In S409, the CPU 108 performs a recording process. In S409, as shown in FIG. 8, RAW data and ranging information are recorded in one of the following two formats while maintaining compatibility with the current RAW format. First, as shown in the first file format 701, distance measurement information is recorded as a separate file separately from the RAW file. As shown in the next file format 700, ranging information is added after the RAW data. Which file format is used for recording can be arbitrarily set by the user. In 700, information indicating the presence or absence of ranging information can be added to the header of the RAW file. In 701, information (for example, a distance measurement information file name) indicating that there is a pair of distance measurement information files can be added to the header of the RAW file. Since the file format 700 includes RAW data and distance measurement information in the same file, there is an advantage that file management is easy for the user. When the file format 701 is stored in the personal computer and the user determines not to use the distance measurement information, the amount of recording medium used in the personal computer can be reduced.

  Next, the focus detection pixel separation process shown in S404 of FIG. 5 will be described. FIG. 9 is a flowchart of focus detection pixel separation processing.

  In step S <b> 801, the CPU 108 reads position information (sensor information) of the focus detection area stored in advance in the EEPROM by an adjustment process or the like.

  In S802, the CPU 108 reads out the focus detection pixel from the position information read in S801.

  In step S <b> 803, the CPU 108 stores the pixel information of the focus detection pixels and the position information thereof in the memory 107.

  In step S <b> 804, the CPU 108 determines whether or not reading has been completed up to the last line of image data (the last line of position information). If the reading is not completed (“NO” in S804), the process returns to S801. When all the focus detection pixels have been read (“YES” in S804), the focus detection pixel separation process is terminated.

  When the focus detection pixel separation process ends, the distance measurement information shown in FIG. 10 is generated. As shown in FIG. 10, the distance measurement information is obtained by associating the pixel signal of the focus detection pixel shown in FIG. 6 with its position information (sensor information). In the present embodiment, the distance measurement information is generated for each focus detection pixel having the same row number. However, the present invention is not limited to this as long as the pixel signal of the focus detection pixel is associated with the position information.

(Second Embodiment)
Next, a preferred second embodiment of the present invention will be described with reference to FIGS. The second embodiment is different from the first embodiment in focus detection pixel separation processing. Since others are the same as those of the first embodiment, their description is omitted.

  In step S <b> 1001, the CPU 108 reads position information (sensor information) of the focus detection area stored in advance in the EEPROM by an adjustment process or the like.

  In S1002, the CPU 108 reads out pixel information (pixel signal) of the focus detection pixels used in the distance calculation in S1003 from the position information read in S1001.

In step S1003, the CPU 108 divides the focus detection pixel information into small blocks of a plurality of pixels (for example, 8 pixels in the X (row) direction and 6 pixels in the Y (column) direction). Then, as in the AF process of the first embodiment, the defocus amount and direction are calculated, and the lens extension amount of the photographing lens is determined. Assuming that the subject distance in this small block is D, the taking-out amount of the photographing lens, and the focal length are P and f, respectively, the subject distance of the photographed image corresponding to the small block is obtained from the relationship of D≈f ² / P. be able to. Note that another calculation method may be used as the calculation method of the subject distance.

  In step S <b> 1004, the CPU 108 stores the small block calculation result and the address on the small block map in the memory 107.

  In step S <b> 1005, the CPU 108 determines whether reading has been completed up to the last line of image data (the last line of position information). If the reading has not been completed (“NO” in S1005), the process returns to S1001. When all the focus detection pixels have been read (“YES” in S1005), the focus detection pixel separation process is terminated.

  When the focus detection pixel separation process ends, the distance measurement information shown in FIG. 12 is generated. As shown in FIG. 12, this distance measurement information (map information) divides the image sensor into blocks each composed of a plurality of pixels, and associates the distance to the subject and block position information (map address) for each block. It is a thing. FIG. 12 is generated by distance measurement information from the focus detection pixel array of FIG. In the present embodiment, the small block is 8 × 6 pixels, but a smaller block or a larger block may be used as a unit to reduce the processing load.

(Third embodiment)
The third preferred embodiment of the present invention is an image processing program using a RAW file generated in the first embodiment or a file that is a combination of a RAW file and a ranging information file. explain. Each step S1201 to 1214 of this program is executed by an information processing apparatus such as a CPU (computer) 108 or a personal computer.

  In S1201, an image file is selected.

  In S1202, the RAW data is subjected to image processing using image parameters and displayed.

  In step S1203, it is determined whether image editing is performed. When image editing is performed (“YES” in S1203), the process proceeds to S1204. When image editing is not performed (“NO” in S1203), the process proceeds to S1212.

  In step S1204, edit content determination is performed. If the edited content of image editing is a map display, the process proceeds to S1205. If the edited content of image editing is a focus frame display, the process proceeds to S1209.

  In S1205, ON / OFF of the map display is determined. If it is ON (“ON” in S1205), the process proceeds to S1206. If it is OFF (“OFF” in S1205), the process proceeds to S1208.

  In S1206, map information creation processing is performed. The map information is performed in the same manner as the subject distance calculation method in the focus detection pixel separation process of the second embodiment. In this case, the information unique to the image processing apparatus such as an electronic camera used for the calculation of the subject distance may be included in the image program or may be held in the model information of the RAW file.

  Further, when the RAW file or the RAW file + ranging information file generated in the second embodiment is used, the map information creation process of S1206 is not performed.

  In S1207, the map information is displayed on the LCD 114 as a display unit. The displayed map information is shown in FIG. Reference numeral 1301 denotes an example of small block map information calculated in S1206. The value displayed in each small block is a distance to the subject (unit: meters) simplified for convenience. However, a small block for which no value is displayed means that the distance is infinite.

  If it is determined in S1205 that the map display is OFF, the display of the map information is cleared in S1208. In this case, the image display is left as it is.

  In step S1209, ON / OFF determination of focus frame display is performed. If the focus frame display is ON, the process proceeds to S1210. If the focus frame display is OFF, the process proceeds to S1211.

  In S1210, focus frame display is performed. In the focus frame display, the phase difference is calculated based on the distance measurement information in the same manner as the subject distance calculation method in the focus detection pixel separation process of the second embodiment, and a block frame having no phase difference is displayed on the screen.

  An example of the focus frame display is shown in FIG. Reference numeral 1401 denotes a focus frame, which is in focus during shooting. In this example, only one frame is displayed, but a plurality of frames may be displayed.

  In S1211, when it is determined in S1209 that the focus frame display is OFF, the focus frame display is cleared. In this case, the image display is left as it is. In addition, although not shown, the editing content determination in S1204 includes general image editing functions in addition to the map display determination in S1205 and the focus frame display determination in S1209. Examples of such an image editing function include enlargement / reduction, white balance / sharpness / contrast adjustment, printing, and a function of recording image data on a recording medium (hard disk, SD card, etc.). Also, by displaying the distance map and focus frame, it is easy to adjust sharpness, contrast, white balance, etc., and fine adjustment is possible.

  In step S1212, determination is made whether image editing has ended. If not completed (“NO” in S1212), the process returns to the image editing determination in S1203, and the process is repeated. If it is determined in S1212 that the image editing has been completed (“YES” in S1212), the process proceeds to S1213.

  In S1213, the displayed image data is cleared.

  In step S1214, it is determined whether the image processing program is finished. If completed ("YES" in S1214), the image processing program is terminated. If not completed ("NO" in S1214), the process returns to S1201 image selection and repeats the process.

  The present invention has been specifically described above based on the first to third embodiments. However, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention. Is possible.

1 is a block diagram of an image processing apparatus according to a preferred first embodiment of the present invention. 3 is a flowchart from start-up to image capturing of the image processing apparatus according to the preferred first embodiment of the present invention. It is a figure which shows the pixel arrangement | sequence of the image pick-up element which concerns on the suitable 1st Embodiment of this invention. It is explanatory drawing of the correlation calculation process which concerns on the suitable 1st Embodiment of this invention. It is a flowchart of the imaging | photography process which concerns on suitable 1st Embodiment of this invention. It is an image data conceptual diagram of an image sensor signal according to a preferred first embodiment of the present invention. FIG. 3 is a conceptual diagram of image data after flaw correction according to a preferred first embodiment of the present invention. It is a figure which shows the RAW file format which concerns on suitable 1st Embodiment of this invention. It is a flowchart of the pixel separation process for focus detection which concerns on suitable 1st Embodiment of this invention. It is a figure which shows the ranging information file format which concerns on suitable 1st Embodiment of this invention. It is a flowchart of separation processing (map information) for focus detection according to a preferred second embodiment of the present invention. It is a figure which shows the ranging information (map information) file format which concerns on suitable 2nd Embodiment of this invention. It is a flowchart of the image processing program which concerns on suitable 3rd Embodiment of this invention. It is a conceptual diagram of subject distance display according to a preferred third embodiment of the present invention. It is a key map of a focus frame display concerning a suitable 3rd embodiment of the present invention.

Explanation of symbols

101 Imaging element 107 Memory R, G, B Imaging pixel a, b Focus detection pixel

Claims (4)

An imaging device in which a first pixel that receives a light beam that has passed through an exit pupil of a photographing lens and a second pixel that receives a light beam in which a part of the exit pupil of the photographing lens is shielded;
Separating means for separating the pixel signal of the second pixel from the output signal of the image sensor;
Generating means for interpolating the pixel signal at the position of the second pixel among the output signals of the image sensor based on the position information of the second pixel to generate RAW data;
Focus information creating means for creating focus information used for autofocus processing from the pixel signal of the second pixel separated by the separating means;
Recording means for recording a pixel signal of the second pixel and position information of the second pixel as a file in association with the generated RAW data;
An image processing apparatus comprising: An imaging device in which a first pixel that receives a light beam that has passed through an exit pupil of a photographing lens and a second pixel that receives a light beam in which a part of the exit pupil of the photographing lens is shielded;
Separating means for separating the pixel signal of the second pixel from the output signal of the image sensor;
Generating means for interpolating the pixel signal at the position of the second pixel among the output signals of the image sensor to generate RAW data;
Focus information creating means for creating focus information corresponding to each of the plurality of areas based on pixel signals of the second pixels separated by the separating means and divided into the plurality of areas;
Recording means for recording a pixel signal of the second pixel and position information of the second pixel as a file in association with the generated RAW data;
An image processing apparatus comprising: The image processing apparatus according to claim 1, further comprising recording means for recording the file on a recording medium.   An image processing program for causing a computer to execute a step of processing focus information created by the focus information creating means according to claim 1 or 2 and displaying the result on a display unit.

Images