JP2013255188A - Imaging element, imaging apparatus, imaging method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To achieve both a live view image of high image quality and highly accurate phase difference detection.SOLUTION: A pixel array section includes: a first image generation pixel being an image generation pixel driven on the basis of a first synchronization signal for detection of a phase difference or generation of a recording image; a phase difference detection pixel driven on the basis of the first synchronization signal; and a second image generation pixel being an image generation pixel which is driven on the basis of a second synchronization signal different from the first synchronization signal being a synchronization signal for generating a live view image and whose number is smaller than that of the first image generation pixels. A first output section outputs pixel data of the first image generation pixel and the phase difference detection pixel to outside. A second output section outputs pixel data of the second image generation pixel to outside.

Description

  The present technology relates to an imaging device, and more particularly, to an imaging device that performs phase difference detection, an imaging device, an imaging method, and a program that causes a computer to execute the method.

  In recent years, an imaging apparatus such as a digital still camera that captures an image of a subject such as a person to generate a captured image and records the generated captured image has become widespread. In addition, as an imaging apparatus, an imaging apparatus having an auto focus (AF) function for automatically adjusting a focus (focus) at the time of imaging is widely used in order to simplify a user's shooting operation. Yes.

  As such an image pickup apparatus, for example, an image pickup apparatus that picks up a plurality of images while shifting the focus position and performs autofocus by a contrast detection method in which the focus position with the highest contrast is the in-focus position has been proposed. Also, a phase difference detection method for determining the position of the imaging lens by forming a pair of images by dividing the pupil of the light that has passed through the imaging lens, and measuring the interval between the formed images (detecting the phase difference) An image pickup apparatus that performs autofocus has also been proposed.

  Further, an imaging apparatus having both functions of a contrast detection method and a phase difference detection method has been proposed. As such an imaging apparatus, for example, both pixels, which are pixels that split the pupil of light that has passed through the imaging lens (phase difference detection pixels) and pixels for generating a captured image (image generation pixels), are combined into a single imaging device. Has been proposed (see, for example, Patent Document 1).

JP 2008-134389 A

  In the above-described conventional technology, both the phase difference detection pixel and the image generation pixel are provided in one image sensor, so that both the phase difference detection and the image generation can be performed with only one image sensor.

  Although both phase difference detection and image generation can be performed, the exposure time appropriate for the phase difference detection pixel and the exposure time appropriate for the image generation pixel are often different. Therefore, it is important to achieve both high-quality live view images and highly accurate phase difference detection.

  The present technology has been created in view of such a situation, and an object thereof is to achieve both high-quality live view images and high-accuracy phase difference detection.

  The present technology has been made to solve the above-described problems, and a first aspect of the present technology is an image generation pixel that is driven based on a first synchronization signal for phase difference detection or generation of a recorded image. A first image generation pixel, a phase difference detection pixel driven based on the first synchronization signal, and a second synchronization different from the first synchronization signal, which is a synchronization signal for generating a live view image A pixel array unit configured by second image generation pixels that are driven based on signals and have fewer image generation pixels than the first image generation pixels, and the first image generation pixels and the phase difference detection pixels The image sensor includes a first output unit that outputs the pixel data to the outside and a second output unit that outputs the pixel data of the second image generation pixel to the outside. Thereby, the pixel data of the image generation pixel and the phase difference detection pixel driven based on the first synchronization signal are output from the first output unit, and the pixel data of the image generation pixel driven based on the second synchronization signal is output. An effect of being output from the second output unit is brought about.

  In the first aspect, the pixel array section includes a first line constituted only by the second image generation pixel, and a second line constituted by the first image generation pixel and the phase difference detection pixel. And a third line composed only of the first image generation pixels, and the total number of the second line and the third line may be larger than the number of the first lines. As a result, the first line composed only of the second image generation pixel, the second line composed of the first image generation pixel and the phase difference detection pixel, and the third line composed only of the first image generation pixel. Are arranged in the pixel array portion.

  In the first aspect, the pixel array unit may be arranged such that the first line is arranged every odd number of lines, and one of the second line and the third line is arranged on another line. Also good. As a result, the first line is arranged every odd number of lines, and one of the second line and the third line is arranged on the other lines.

  In the first aspect, the second line may be disposed adjacent to the first line. This brings about the effect | action that a 2nd line is arrange | positioned adjacent to a 1st line.

  The second aspect of the present technology provides a first image generation pixel that is an image generation pixel driven based on a first synchronization signal for phase difference detection or generation of a recorded image, and the first synchronization signal. Driven based on a phase difference detection pixel driven based on a second synchronization signal that is a synchronization signal for generating a live view image and is different from the first synchronization signal. A pixel array unit configured by second image generation pixels that are image generation pixels with a small number, a first output unit that outputs pixel data of the first image generation pixels and the phase difference detection pixels to the outside, and An image sensor including a second output unit that outputs pixel data of the second image generation pixel to the outside, and the pixel that is output from the second output unit by driving a line in which the second image generation pixel is arranged Data generated In addition, when the phase difference detection is performed, the line on which the phase difference detection pixels are arranged is driven to generate the pixel data output from the first output unit, thereby generating the recorded image. In this case, the imaging apparatus includes a control unit that performs control to generate the pixel data output from the first output unit by driving a line in which the first image generation pixel is arranged. Thereby, the pixel data of the image generation pixel and the phase difference detection pixel driven based on the first synchronization signal are output from the first output unit, and the pixel data of the image generation pixel driven based on the second synchronization signal is output. Using the image sensor output from the second output unit, the live view image is generated and the pixel data for detecting the phase difference or the pixel data for generating the recorded image is output.

  In the second aspect, when the phase difference is detected, the first synchronization signal is generated based on the exposure time corresponding to the phase difference detection, and the recorded image is generated. A first synchronization signal generator for generating the first synchronization signal based on an exposure time corresponding to the generation of the recorded image, and a second synchronization signal based on the exposure time corresponding to the generation of the live view image. You may make it further comprise the 2nd synchronizing signal production | generation part to produce | generate. As a result, the second synchronization signal is generated based on the exposure time corresponding to the generation of the live view image, and when the phase difference detection is performed, the first synchronization signal is based on the exposure time corresponding to the phase difference detection. When the recording image is generated, the first synchronization signal is generated based on the exposure time corresponding to the generation of the recording image.

  In the second aspect, when the control unit displays the live view image on the display unit during continuous shooting, the control unit displays a reduced image of the recorded image generated during the continuous shooting. You may make it display with a live view image. As a result, when a live view image is displayed on the display unit during continuous shooting, a reduced image of the recorded image generated during continuous shooting is displayed together with the live view image.

  A third aspect of the present technology provides a first image generation pixel that is an image generation pixel that is driven based on a first synchronization signal for phase difference detection or generation of a recorded image, and the first synchronization signal. Driven based on a phase difference detection pixel driven based on a second synchronization signal that is a synchronization signal for generating a live view image and is different from the first synchronization signal. A pixel array unit configured by second image generation pixels that are image generation pixels with a small number, a first output unit that outputs pixel data of the first image generation pixels and the phase difference detection pixels to the outside, and In addition to the generation of the live view image in which the line on which the second image generation pixel is arranged is driven in an imaging device including a second output unit that outputs pixel data of the second image generation pixel to the outside, In the case of performing difference detection, a first control procedure for performing control for driving the line where the phase difference detection pixels are arranged to generate the pixel data used for the phase difference detection, and the first in the image sensor. When generating the recorded image together with the generation of the live view image in which the line where the two image generation pixels are arranged is driven, the line where the first image generation pixel is arranged is driven to An imaging method including a second control procedure for performing control for generating the pixel data used for generating a recorded image, and a program for causing a computer to execute the method. Accordingly, a live view image is generated by driving based on the second synchronization signal, and pixel data used for phase difference detection or pixel data used for generating a recorded image is generated by driving based on the first synchronization signal. Bring.

  According to the present technology, it is possible to achieve an excellent effect that both high-quality live view images and high-accuracy phase difference detection can be achieved.

It is a block diagram which shows an example of a function structure of the imaging device 100 in embodiment of this invention. It is sectional drawing which shows typically the cross-sectional structural example of the imaging device in the imaging device 100 of embodiment of this invention. It is a block diagram which shows the basic structural example of the image sensor 200 in embodiment of this invention. It is a schematic diagram which shows an example of arrangement | positioning of the pixel with which the image sensor 200 in embodiment of this invention is equipped. It is a figure which shows typically the relationship between the pixel with which the image sensor 200 in embodiment of this invention is equipped, and the signal line connected to each pixel. It is a timing chart which shows typically an example of the relation between live view display operation and still picture imaging operation at the time of picturizing a still picture using imaging device 100 of an embodiment of the invention. 6 is a timing chart schematically showing an example of a relationship between a live view display operation and a phase difference detection operation when focus adjustment is performed in the imaging apparatus 100 according to the embodiment of the present invention. 11 is a flowchart illustrating an example of a processing procedure when live view image display processing is performed by driving an LV line pixel by the imaging apparatus according to the embodiment of the present technology. 11 is a flowchart illustrating an example of a processing procedure when phase difference detection or still image capturing is performed by driving an STL line pixel by the image capturing apparatus 100 according to the embodiment of the present technology. As a modification of the embodiment of the present technology, it is a diagram schematically illustrating an example of a display in which both a live view image and a captured image can be easily confirmed during continuous shooting. It is a figure showing typically an example in the case of displaying a plurality of record pictures on display in a display of a record picture in a live view picture in a modification of an embodiment of this art.

Hereinafter, modes for carrying out the present technology (hereinafter referred to as embodiments) will be described. The description will be made in the following order.
1. Embodiment (Imaging control: an example of an imaging device in which exposure time for live view image and exposure time for phase difference detection can be set separately, and exposure is possible at the same time)
2. Modified example

<1. Embodiment of the present technology>
[Functional configuration example of imaging device]
FIG. 1 is a block diagram illustrating an example of a functional configuration of the imaging apparatus 100 according to the embodiment of the present invention.

  The imaging device 100 is an imaging device that captures an image of a subject, generates image data (captured image), and records the generated image data as image content (still image content or moving image content). In the following, an example in which still image content (still image file) is recorded as image content (image file) will be mainly shown.

  The imaging apparatus 100 includes a lens unit 110, an operation reception unit 125, an image sensor 200, a control unit 120, a first synchronization signal generation unit 130, a first signal processing unit 140, and a second synchronization signal generation unit 150. A second signal processing unit 160, a focus determination unit 170, a lens driving unit 175, a recording unit 181, and a display unit 182.

  The lens unit 110 collects light from the subject (subject light). The lens unit 110 includes a zoom lens 111, a diaphragm 112, and a focus lens 113.

  The zoom lens 111 adjusts the magnification of the subject included in the captured image by moving in the optical axis direction to change the focal length.

  The diaphragm 112 is a shield for adjusting the amount of subject light incident on the image sensor 200 by changing the degree of opening.

  The focus lens 113 adjusts the focus by moving in the optical axis direction by driving the lens driving unit 175.

  The operation reception unit 125 receives an operation from the user. For example, when the shutter button 126 (shown in FIG. 2) is pressed, the operation receiving unit 125 supplies a signal related to the pressing to the control unit 120 as an operation signal.

  The image sensor 200 is an image sensor that photoelectrically converts received subject light into an electrical signal. The image sensor 200 is realized by, for example, a complementary metal oxide semiconductor (CMOS) sensor or a charge coupled device (CCD) sensor. The image sensor 200 includes a pixel (image generation pixel) that generates a signal for generating a captured image based on the received subject light, and a pixel (phase difference detection pixel) that generates a signal for performing phase difference detection. And are arranged. The image sensor 200 includes a row of pixels (hereinafter referred to as an LV (Live View) line) driven to capture a live view image (a real-time image of a subject image received by the image sensor), A row of pixels (hereinafter referred to as an STL (STiLl) line) driven for capturing a still image (recorded image) or detecting a phase difference is arranged. Only image generation pixels are arranged in the LV line. There are two patterns of pixel arrangement of the STL line, which are constituted by a line where only image generation pixels are arranged and a line where both image generation pixels and phase difference detection pixels are arranged. Since the number of LV lines is smaller than the number of STL lines, the number of pixels of the live view image is smaller than the number of pixels of the still image.

  The image sensor 200 includes a driving circuit for driving the pixels on the LV line and a driving circuit for driving the pixels on the STL line, respectively, and the LV line pixels and the STL line pixels are independent of each other. Drive with timing. That is, the LV line and the STL line can be exposed simultaneously with different exposure times. The image sensor 200 will be described with reference to FIGS. 3 and 4. The image sensor 200 supplies an electrical signal generated by photoelectric conversion of the pixels on the LV line to the second signal processing unit 160 via the signal line 169. Further, the image sensor 200 supplies an electrical signal generated by photoelectric conversion of the pixels of the STL line to the first signal processing unit 140 via the signal line 149. The image sensor 200 is an example of an image sensor described in the claims.

  The control unit 120 controls each unit operation in the imaging apparatus 100. In FIG. 1, as an example of a control signal line related to the imaging operation of the imaging apparatus 100, the image sensor 200, the first synchronization signal generation unit 130, the first signal processing unit 140, and the second synchronization signal generation unit 150 A signal line of a control signal supplied from the control unit 120 to the second signal processing unit 160 is shown. For example, the control unit 120 supplies a signal for controlling the operation of the image sensor 200 (for example, setting of a row of pixels to be read) to the image sensor 200 via the signal line 121.

  In addition, when the shutter button is pressed and an operation signal for starting capturing a still image (recorded image) is received, the control unit 120 outputs various control signals for executing still image capturing. The first synchronization signal generator 130, the first signal processor 140, and the image sensor 200 are supplied. Note that the control unit 120 calculates an exposure time suitable for still image capturing when the still image is captured, and supplies the calculated exposure time to the first synchronization signal generation unit 130. This calculation is performed using the pixel data of the image generation pixel of the LV line immediately before the shutter button is pressed or the pixel data of the image generation pixel of the STL line.

  In addition, when adjusting the focus by detecting the phase difference, the control unit 120 transmits various control signals for executing the focus adjustment by detecting the phase difference to the first synchronization signal generating unit 130 and the first signal processing unit. 140, the image sensor 200, the focus determination unit 170, and the lens driving unit 175. In addition, when performing the phase difference detection, the control unit 120 calculates an exposure time appropriate for the exposure of the phase difference detection pixel from the pixel data of the phase difference detection pixel supplied from the first signal processing unit 140, and calculates the calculation time. The exposed exposure time is supplied to the first synchronization signal generator 130.

  In addition, when displaying a live view image, the control unit 120 transmits various control signals for executing live view display to the second synchronization signal generation unit 150, the second signal processing unit 160, and the image sensor. 200. In addition, the control unit 120 calculates an exposure time appropriate for generating a live view image based on the pixel data of the image generation pixels of the LV line supplied from the second signal processing unit 160 during live view display. Then, the calculated exposure time is supplied to the second synchronization signal generator 150.

  The first synchronization signal generation unit 130 generates a synchronization signal (STL synchronization signal) for driving the pixels of the STL line in the image sensor 200. When a control signal for executing still image capturing is supplied from the control unit 120, the first synchronization signal generating unit 130 performs image processing according to the exposure time for still image capturing calculated by the control unit 120. An STL synchronization signal is generated so that the sensor 200 is driven. In addition, when the control signal for performing the phase difference detection is supplied from the control unit 120, the first synchronization signal generation unit 130 generates an image according to the exposure time for phase difference detection calculated by the control unit 120. An STL synchronization signal is generated so that the sensor 200 is driven. The first synchronization signal generation unit 130 supplies the generated STL synchronization signal to the image sensor 200 via the signal line 131.

  The first signal processing unit 140 performs various types of signal processing on the electrical signal generated by the STL line pixels in the image sensor 200. In the case of a still image capturing operation, the first signal processing unit 140 generates still image data (still image data) based on an output signal (pixel value) from an image generation pixel of the STL line. The first signal processing unit 140 supplies the generated still image data to the recording unit 181 and stores it in the recording unit 181. The first signal processing unit 140 supplies pixel data (pixel value) of the phase difference detection pixel of the STL line to the focus determination unit 170 in the case of the operation of adjusting the focus by detecting the phase difference. Further, the first signal processing unit 140 supplies pixel data of the phase difference detection pixels to the control unit 120 when the control unit 120 calculates the exposure time for phase difference detection. The first signal processing unit 140, when the control unit 120 calculates the exposure time for capturing a still image, if there is pixel data of the image generation pixels of the STL line acquired immediately before imaging, This pixel data is supplied to the control unit 120.

  The second synchronization signal generation unit 150 generates a synchronization signal (LV synchronization signal) for driving the pixels on the LV line in the image sensor 200. When the control signal for displaying the live view image is supplied from the control unit 120, the second synchronization signal generation unit 150 responds to the exposure time for acquiring the live view image calculated by the control unit 120. Then, the LV synchronization signal is generated so that the image sensor 200 is driven. In addition, the second synchronization signal generation unit 150 supplies the generated LV synchronization signal to the image sensor 200 via the signal line 151.

  The second signal processing unit 160 performs various types of signal processing on the electrical signal generated by the pixels of the LV line in the image sensor 200. When displaying a live view image, the second signal processing unit 160 displays live view image data (live view image data) based on an output signal (pixel data) from an image generation pixel of the LV line in the image sensor 200. ) Is generated. The second signal processing unit 160 supplies the generated live view image data to the display unit 182 to display the live view on the display screen in the display unit 182. Further, the second signal processing unit 160 supplies pixel data of image generation pixels of the LV line to the control unit 120 when the control unit 120 calculates the exposure time for the live view image. In addition, when the control unit 120 calculates the exposure time for capturing a still image, when the second signal processing unit 160 has pixel data of image generation pixels of the LV line acquired immediately before imaging, This pixel data is supplied to the control unit 120.

  The recording unit 181 records the image data supplied from the first signal processing unit 140 as an image content (image file). For example, the recording unit 181 may be a removable recording medium (one or a plurality of recording media) such as a disk such as a DVD (Digital Versatile Disk) or a semiconductor memory such as a memory card. In addition, these recording media may be built in the imaging apparatus 100 or may be detachable from the imaging apparatus 100.

  The display unit 182 displays an image based on the image data supplied from the second signal processing unit 160. The display unit 182 is realized by a color liquid crystal panel, for example. For example, when live view image data is supplied from the second signal processing unit 160, the display unit 182 displays the live view image on the display screen.

  Based on the pixel data of the phase difference detection pixels supplied from the first signal processing unit 140, the focusing determination unit 170 determines whether or not the object to be focused (the focusing target) is in focus. Is determined by phase difference detection. The focus determination unit 170 calculates a focus shift amount (defocus amount) with respect to an object (focus target object) in a focusing area (focus area), and based on the calculated defocus amount, A driving amount of the focus lens 113 necessary for focusing is calculated. Then, the focus determination unit 170 supplies information indicating the driving amount of the focus lens 113 to the lens driving unit 175.

  The lens driving unit 175 drives the focus lens 113. The lens driving unit 175 moves the focus lens 113 based on the driving amount of the focus lens supplied from the focus determination unit 170 to focus. The lens driving unit 175 maintains the current position of the focus lens 113 when the focus is achieved (the driving amount of the focus lens 113 is “0”).

[Section configuration example of imaging device]
FIG. 2 is a cross-sectional view schematically illustrating a cross-sectional configuration example of the imaging device in the imaging device 100 according to the embodiment of the present invention. In the figure, it is assumed that the imaging apparatus 100 is a single-lens camera.

  In the drawing, a body 101 and an interchangeable lens 105 are shown as a cross-sectional view of the imaging apparatus 100. The interchangeable lens 105 is a detachable lens unit in the imaging apparatus 100, and corresponds to the lens unit 110 illustrated in FIG. The body 101 is a main body that performs an imaging process in the imaging apparatus 100, and corresponds to a configuration other than the lens unit 110 illustrated in FIG. In the body 101, a shutter button 126, a display unit 182 and an image sensor 200 are shown.

  In addition, in the drawing, an optical axis (optical axis L12) in the lens provided in the lens unit 110 and two lines (lines L11 and L13) indicating a range through which subject light passes are shown. Note that the range between the lines L11 and L13 indicates a range through which light incident on the image sensor 200 passes.

  As shown in the figure, in the imaging apparatus 100, all incident subject light enters the image sensor 200. That is, when the phase difference detection is performed in the imaging apparatus 100, the signal generated by the image sensor 200 is used. In addition, generation of a live view image and generation of a still image are also performed using signals generated by the image sensor 200.

[Example of basic configuration of image sensor]
FIG. 3 is a block diagram illustrating a basic configuration example of the image sensor 200 according to the embodiment of the present invention.

  The image sensor 200 includes a pixel array unit 400, a first control unit 210, a first vertical drive circuit 220, a first horizontal drive circuit 230, a first column signal processing unit 240, and a first output buffer 260. Prepare. Further, the image sensor 200 includes a second control unit 310, a second vertical drive circuit 320, a second horizontal drive circuit 330, a second column signal processing unit 340, and a second output buffer 360.

  The pixel array unit 400 has phase difference detection pixels and image generation pixels arranged in an array. The pixels of the pixel array unit 400 are classified into pixels belonging to the STL line and pixels belonging to the LV line according to the pixel position. The pixels belonging to the STL line include the first vertical selection line 270 and the first vertical signal line 280. Is connected. On the other hand, the second vertical selection line 370 and the second vertical signal line 380 are connected to the pixels belonging to the LV line. Note that the pixel arrangement in the pixel array unit 400 will be described with reference to FIG.

  The first controller 210 is connected to the STL line based on the STL synchronization signal supplied from the first synchronization signal generator 130 via the signal line 131 and the control signal of the image sensor 200 supplied from the controller 120. It controls the operation of each unit related to the generation of the signal of the pixel to which it belongs. That is, the first control unit 210 functions as a timing generator that generates various timing signals for the operation of the first vertical driving circuit 220, the first horizontal driving circuit 230, and the first column signal processing unit 240. To do.

  The first vertical drive circuit 220 selectively scans the STL lines in units of rows in the vertical direction (column direction) sequentially via the first vertical selection line 270. The first vertical drive circuit 220 is constituted by, for example, a shift register.

  The first horizontal drive circuit 230 selectively scans circuit portions for each pixel column in the first column signal processing unit 240 in order. The first horizontal drive circuit 230 is configured by, for example, a shift register, an address decoder, or the like. The first horizontal driving circuit 230 selectively scans the circuit portions of the first column signal processing unit 240 in order, whereby the first column signal processing unit 240 performs an electrical signal for each pixel (hereinafter referred to as pixel signal processing) for each pixel column. Are referred to as STL pixel data) in order to the first output buffer 260.

  The first column signal processing unit 240 performs various types of signal processing for each pixel column on the analog signal output from the pixels on the STL line in the pixel array unit 400. That is, the first column signal processing unit 240 performs various types of signal processing on the analog signal output from each pixel in the row selected by the first vertical drive circuit 220 via the first vertical signal line 280. For example, the first column signal processing unit 240 performs CDS (Correlated Double Sampling) processing for removing noise and AD (Analog Digital) conversion processing for digitizing an analog signal as signal processing. Etc. The first column signal processing unit 240 sequentially supplies the electric signal (STL pixel data) after the signal processing to the first output buffer 260 for each pixel.

  The first output buffer 260 amplifies the STL pixel data supplied from the first column signal processing unit 240 and outputs the amplified STL pixel data to the outside of the image sensor 200 via the signal line 149. The first column signal processing unit 240 and the first output buffer 260 are examples of the first output unit described in the claims.

  Based on the LV synchronization signal supplied from the second synchronization signal generation unit 150 via the signal line 151 and the control signal of the image sensor 200 supplied from the control unit 120, the second control unit 310 sets the LV line. It controls the operation of each unit related to the generation of the signal of the pixel to which it belongs. That is, the second control unit 310 functions as a timing generator that generates various timing signals for the operation of the second vertical drive circuit 320, the second horizontal drive circuit 330, and the second column signal processing unit 340. To do.

  As described above, the second control unit 310 is the same as the first control unit 210 except that a functional configuration related to generation of a signal of a pixel belonging to the LV line is a control target. The second vertical drive circuit 320 is the same as the first vertical drive circuit 220 except that the LV line is a target for selective scanning. The second horizontal drive circuit 330, the second column signal processing unit 340, and the second output buffer 360 are also different from each other in processing targets, except for the first horizontal drive circuit 230, the first column signal processing unit 240, and the second output buffer 360. This is the same as the one output buffer 260. For this reason, description of these functional configurations is omitted here. The second column signal processing unit 340 and the second output buffer 360 are an example of a second output unit described in the claims.

  As described above, the image sensor 200 is provided with the STL line drive circuit and the LV line drive circuit separately. The first control unit 210 that controls the driving of the STL line and the second control unit 310 that controls the driving of the LV line perform control based on different synchronization signals (an STL synchronization signal or an LV synchronization signal). . That is, the exposure of the LV line pixels and the STL line pixels can be started at different timings and can be ended at different timings.

  Next, the pixel arrangement in the pixel array unit 400 will be described with reference to FIG.

[Pixel arrangement example in image sensor]
FIG. 4 is a schematic diagram illustrating an example of the arrangement of pixels provided in the image sensor 200 according to the embodiment of the present invention.

  In FIG. 4, description will be made assuming an XY axis where the left-right direction is the Y-axis and the vertical direction is the X-axis. The signal reading direction in the image sensor 200 is assumed to be in the X-axis direction (read out in units of rows).

  In FIG. 4, for convenience of description, the pixel arrangement will be described using a partial pixel region (region 410) among the pixels arranged in the pixel array unit 400 of the image sensor 200. The pixel arrangement in the pixel array unit 400 is an arrangement in which the pixel arrangement as shown in the region 410 is repeated in the X-axis direction and the Y-axis direction.

  In this area 410, as the rows (LV lines) controlled by the second control unit 310, rows (LV lines L21 to L25) having only image generation pixels at intervals of five rows are shown. Further, in this area 410, as a plurality of rows (STL lines) controlled by the first controller 210, there are line groups (STL line groups L11 to L16) indicating a plurality of STL lines continuous in the column direction. It is shown. In the STL line groups L11 to L16, an STL line in which only image generation pixels are arranged and an STL line in which phase difference detection pixels and image generation pixels are arranged are shown.

  In FIG. 4, one pixel is indicated by one square. In FIG. 4, the image generation pixels are indicated by the squares indicated by the symbols (R, G, B) representing the color filters provided. That is, the R pixel 421 indicates a pixel (R pixel) that receives red light with a color filter that transmits red (R) light, and the B pixel 423 includes a color filter that transmits blue (B) light. A pixel (B pixel) that receives blue light is shown. The G pixel 422 indicates a pixel (G pixel) that receives green light by a color filter that transmits green (G) light.

  Further, the phase difference detection pixel is indicated by a gray square to which a white rectangle is added. Note that the white rectangle in the phase difference detection pixel indicates the side where incident light is received by the light receiving element (the side not covered by the light shielding layer for pupil division).

  Here, the phase difference detection pixels (the right opening phase difference detection pixel 431 and the left opening phase difference detection pixel 432) shown in FIG. 4 will be described.

  The right aperture phase difference detection pixel 431 is a phase difference detection pixel in which a light shielding layer is formed so as to shield the subject light that has passed through the right side of the exit pupil from the subject light incident on the microlens of the right aperture phase difference detection pixel 431. It is. That is, the right aperture phase difference detection pixel 431 blocks light on the right side (+ side in the X-axis direction) of the light divided into the left and right sides (+ -side in the X-axis direction) of the exit pupil, and on the left side. The pupil-divided light (−side in the X-axis direction) is received.

  The left aperture phase difference detection pixel 432 is a phase difference detection pixel in which a light shielding layer is formed so as to shield the subject light passing through the left side of the exit pupil among the subject light incident on the microlens of the left aperture phase difference detection pixel 432. It is. That is, the left aperture phase difference detection pixel 432 blocks light on the left side (−side in the X axis direction) of the light divided into the left and right sides (+ −side in the X axis direction) of the exit pupil, and The pupil-divided light on the + side in the X-axis direction is received. Further, the left aperture phase difference detection pixel 432 is used as a pair with the right aperture phase difference detection pixel 431, thereby forming a pair of images.

  Here, the arrangement of pixels in the image sensor 200 will be described.

  As shown in a region 410, the pixel arrangement of the image sensor 200 includes a row (line) in which only image generation pixels are arranged, and a row (line) in which image generation pixels and phase difference detection pixels are arranged. . Rows of image generation pixels and phase difference detection pixels are arranged at predetermined intervals in the direction (column direction) perpendicular to the readout direction (row direction) (every 10 rows in FIG. 4), and the other rows have images. Rows with only generated pixels are arranged. Further, the image generation pixels are arranged so that the color filters are arranged in a Bayer arrangement.

  In the row where the image generation pixel and the phase difference detection pixel are arranged, the G pixel 422 and the B pixel 423 are alternately arranged in the column direction. One of the phase difference detection pixel 431 and the left opening phase difference detection pixel 432 is arranged. Then, the right aperture phase difference detection pixel 431 and the left aperture phase difference detection pixel 432 have an interval between the two pixels (an image generation pixel arranged between the two pixels in order to perform pupil division with high accuracy. (In FIG. 4, it is arranged with one G pixel 422 in between).

  In the image sensor 200 having such a pixel arrangement, rows at predetermined intervals among rows in which only image generation pixels are arranged are rows (LV lines) controlled by the second control unit 310. That is, the second vertical selection line 370 and the second vertical signal line 380 are connected to the pixels of the LV line controlled by the second control unit 310. Note that an odd number is set as the interval between the LV lines because only the LV lines are arranged in the Bayer arrangement.

  Rows other than the LV line are rows (STL lines) controlled by the first controller 210, and the first vertical selection line 270 and the first vertical signal line 280 are connected to each other. In FIG. 4, the row where both the image generation pixel and the phase difference detection pixel are arranged is arranged at a position close to the LV line in order to obtain a focus determination result close to the live view display. In FIG. 4, the row adjacent to the lower side (−side in the Y-axis direction) of the LV line every two rows is arranged as a row in which the image generation pixel and the phase difference detection pixel are arranged.

  Next, the pixel arrangement of the image sensor 200 will be described by focusing on the relationship between the pixel arrangement and each signal line.

  FIG. 5 is a diagram schematically showing the relationship between the pixels provided in the image sensor 200 and the signal lines connected to the pixels in the embodiment of the present invention.

  In FIG. 5, description will be made using a further partial region (10 rows × 6 columns) of the pixel shown in FIG. 4.

  In FIG. 5, the pixels are shown as squares with a dotted frame, and as in FIG. 4, a code representing a color filter is added to the image generation pixels, and the phase difference detection pixels are open on the gray background. The white rectangle which shows is added. Note that the pixels on the LV line are shown with fine dots in the frame.

  In FIG. 5, a first vertical selection line 270, a first vertical signal line 280, a second vertical selection line 370, and a second vertical signal line 380 are shown. The connection between each signal line and each pixel is schematically shown by black dots on each signal line.

  As shown in FIG. 5, the second vertical selection line 370 and the second vertical signal line 380 are connected to the pixels of the LV line, and the first vertical selection line 270 and the first vertical signal line 280 are connected to the pixels of the STL line. Connected. Therefore, the pixels on the LV line and the pixels on the STL line can be driven independently.

[Example of relationship between live view display operation and still image capturing operation]
FIG. 6 is a timing chart schematically showing an example of a relationship between a live view display operation and a still image imaging operation when a still image is captured using the imaging apparatus 100 according to the embodiment of the present invention.

  This timing chart shows a live view display operation performed using the output of the pixels on the LV line and a still image imaging operation performed using the output of the pixels on the STL line, with the horizontal axis as the common time axis. Has been.

  As live view display operations, potential transition of the signal line 151 (pulse is an LV synchronization signal), pixel exposure timing (exposure period) on the LV line, and transfer of LV pixel data output via the signal line 169 Timing (transfer period) is shown. In addition, the display timing (display period) of the live view image displayed on the display unit 182 is shown as the live view display operation.

  As a still image capturing operation, potential transition of the signal line 131 (pulse is an STL synchronization signal), pixel exposure timing (exposure period) on the STL line, and transfer of STL pixel data output via the signal line 149 Timing (transfer period) is shown. In addition, the recording timing (recording period) of the still image recorded in the recording unit 181 is shown as the still image capturing operation.

  FIG. 6 also shows a double arrow (periods 531 and 533) indicating a period (live view period) in which the user determines the composition of the captured image based on the displayed live view image, and the imaging apparatus is a still image. A double arrow (period 532) indicating a period (image generation period) during which is generated. In FIG. 6, the focus adjustment in the live view period is not considered and attention is paid to still image capturing. The focus adjustment using the phase difference detection pixels will be described with reference to FIG.

  Here, the live view display operation will be described. For example, when the display speed of the live view image is set to 60 fps, the LV synchronization signal is supplied to the second control unit 310 every 1/60 seconds when the amount of the subject light is sufficient. The pixels on the LV line are driven based on this synchronization signal.

  Pixel data (LV pixel data) generated in the pixels on the LV line by the exposure is read to the second signal processing unit 160 via the signal line 169 and displayed on the display unit 182 in the display period 513. Note that the exposure period 511 in FIG. 6 corresponds to this exposure period, and the transfer period 512 corresponds to this readout period. Such an operation is repeated regardless of the still image capturing operation performed using the pixels of the STL line.

  That is, when the display speed of the live view image is 60 fps, the live view image is displayed while maintaining 60 fps even during the still image capturing operation. In addition, since no phase difference detection pixel is arranged in the LV line, interpolation processing of the pixel value at the position of the phase difference detection pixel is not necessary when generating a live view image. For this reason, a beautiful live view image can be quickly generated.

  Next, the still image capturing operation will be described. When the shutter button is pressed, the first control unit 210 sets a row to be read out of the STL line for still image capturing in accordance with a control signal of the image sensor 200 from the control unit 120. For example, when all the pixels of the STL line are read out to capture a still image, the first vertical driving circuit 220, the first horizontal driving circuit 230, and the first column are read so as to read out all the pixels of the STL line. The operation with the signal processing unit 240 is set. That is, all the STL lines are set to read target rows. Then, an STL synchronization signal is supplied from the first synchronization signal generation unit 130 to the first control unit 210, and exposure of pixels on the STL line is started. Then, after the exposure time for taking a still image calculated by the control unit 120, the STL synchronization signal is supplied again, and the exposure ends.

  Thereafter, pixel data (STL pixel data) generated in the image sensor 200 by exposure is read to the first signal processing unit 140 via the signal line 149 and recorded in the recording unit 181. The exposure period 521 in FIG. 6 corresponds to this exposure period, and the transfer period 522 corresponds to this readout period. The recording period 523 corresponds to a recording period in the recording unit 181. In the image processing in the first signal processing unit 140, the pixel value of the LV line and the pixel value of the phase difference detection pixel are interpolated by general defective pixel correction to generate an image. Note that the pixel data at the position of the LV line can be easily interpolated by the first signal processing unit 140 if the first column signal processing unit 240 outputs dummy data.

  As shown in FIG. 6, in the image sensor 200, the LV line and the STL line can be driven separately. Therefore, there is no interference with each other's operation timing, and it is possible to continue displaying the live view without interruption even during the still image capturing (period 532 in FIG. 6).

  Next, a case where focus adjustment is performed by phase difference detection will be described with reference to FIG.

[Example of relationship between live view display operation and phase difference detection operation]
FIG. 7 is a timing chart schematically showing an example of the relationship between the live view display operation and the phase difference detection operation when focus adjustment is performed in the imaging apparatus 100 according to the embodiment of the present invention.

  This timing chart shows a live view display operation performed using the output of the pixels on the LV line and a phase difference detection operation performed using the output of the pixels on the STL line, with the horizontal axis as the common time axis. Has been.

  Since the live view display operation is the same as that shown in FIG. 6, the description thereof is omitted here.

  As the phase difference detection operation, potential transition of the signal line 131 (pulse is an STL synchronization signal), pixel exposure timing (exposure period) on the STL line, and transfer of STL pixel data output via the signal line 149 Timing (transfer period) is shown. In addition, as a phase difference detection operation, a timing (detection period) at which the defocus amount is calculated by the phase difference detection process, and a timing at which the focus lens is driven (driving) by the lens driving amount obtained from the calculated defocus amount Period). For convenience of explanation, the focus lens drive timing is shown as a fixed period in FIG. 7, but the time length varies depending on the actual drive amount size.

  Here, the phase difference detection operation will be described. When performing the focus adjustment by detecting the phase difference, the control unit 120 causes the setting of the readout target row of the STL line to be set for detecting the phase difference. For example, the first vertical drive circuit 220 so that a line on which a phase difference detection pixel is arranged among STL lines in which an object to be focused (focused object) is imaged becomes a line to be read. The operations of the first horizontal driving circuit 230 and the first column signal processing unit 240 are set. Thus, when performing phase difference detection, it is set so that only the line including the phase difference detection pixel in the STL line is driven.

  Then, the first synchronization signal generation unit 130 sets the STL synchronization signal supply interval based on the exposure time appropriate for the phase difference detection calculated by the control unit 120, and sets the STL synchronization signal at the timing when the phase difference detection is performed. 1 is supplied to the control unit 210. Thereby, the exposure of the pixels of the STL line is repeated with the exposure time for phase difference detection. Note that FIG. 7 shows a section (section 561) in which a short exposure time is set because the amount of light of the subject is large, and phase difference detection is repeatedly performed by imaging with this exposure time. Further, FIG. 7 shows a section (section 562) where a long exposure time is set because the amount of light of the subject is small, and phase difference detection is repeatedly performed by imaging with this exposure time.

  Pixel data (STL pixel data) generated in pixels on the STL line to be read by exposure is read to the first signal processing unit 140 via the signal line 149. The exposure period 551 in FIG. 7 corresponds to this exposure period, and the transfer period 552 corresponds to this readout period. Note that since the number of STL lines to be read is small, the transfer period 552 is shorter in time than the transfer period 522 in FIG.

  Then, only the output (pixel value) of the phase difference detection pixel is supplied to the focus determination unit 170, and the focus lens required for focusing is driven based on the defocus amount calculated from the pixel value of the phase difference detection pixel. The amount is calculated by the focus determination unit 170. Then, the focus lens 113 is driven based on this driving amount to focus. A detection period 553 in FIG. 7 corresponds to a period in which the driving amount of the focus lens is calculated based on the output of the phase difference detection pixel, and a driving period 554 corresponds to a driving period of the focus lens 113.

  As described above, since the LV line and the STL line can be driven separately, the live view image pixel is set while separately setting the exposure time length of the live view image and the exposure time length of the phase difference detection pixel. The value and the pixel value for phase difference detection can be acquired simultaneously.

[Operation example of imaging device]
Next, the operation of the imaging apparatus 100 according to the embodiment of the present technology will be described with reference to the drawings. Note that FIG. 8 illustrates an operation example of displaying a live view image by driving pixels of the LV line, and FIG. 9 illustrates an operation example of phase difference detection and still image capturing by driving the pixels of the STL line.

  FIG. 8 is a flowchart illustrating a processing procedure example when live view image display processing is performed by driving the pixels of the LV line by the imaging apparatus 100 according to the embodiment of the present technology.

  First, the control unit 120 determines whether or not to start displaying a live view image (step S901). When it is determined not to start displaying the live view image, the process waits until display of the live view image is started. For example, when the power of the imaging apparatus 100 is turned on, but when an already captured image is reproduced without performing imaging, it is determined that the display of the live view image is not started.

  On the other hand, when it is determined to start displaying the live view image (step S901), the exposure time of the pixels of the LV line is set by the control unit 120 (step S902). Subsequently, an LV synchronization signal is generated by the second synchronization signal generation unit 150 based on the set exposure time of the pixels on the LV line, and exposure of the pixels on the LV line in the image sensor 200 is performed based on the LV synchronization signal. Processing is performed (step S903).

  Thereafter, a live view image is generated by the second signal processing unit 160 based on the pixel data (LV pixel data) generated by the pixels of the LV line (step S904), and the generated live view image is displayed on the display unit 182. It is displayed (step S905). Subsequently, the control unit 120 determines whether or not to continue the live view display (step S906). If it is determined not to continue the live view display (step S906), the live view image display processing procedure by driving the pixels of the LV line is ended. For example, when the imaging operation is terminated, it is determined that the live view display is not continued.

  On the other hand, when it is determined that the display of the live view image is to be continued (step S906), the control unit 120 determines whether or not the LV line exposure time needs to be changed (step S907). If it is determined that the exposure time of the LV line needs to be changed (step S907), the process returns to step S902, and the live view display is continued after the exposure time is reset.

  If it is determined that there is no need to change the exposure time of the LV line (step S907), the process returns to step S903 and the live view display is continued.

  FIG. 9 is a flowchart illustrating a processing procedure example when phase difference detection or still image capturing is performed by driving the pixels of the STL line by the image capturing apparatus 100 according to the embodiment of the present technology.

  First, the control unit 120 determines whether or not to start imaging for phase difference detection (step S911). If it is determined not to start imaging for phase difference detection (step S911), the process proceeds to step S918.

  On the other hand, when it is determined in step S911 that imaging for phase difference detection is started (step S911), the exposure time of the pixels on the STL line is set by the control unit 120 (step S912). After that, the line in which the phase difference detection pixels are arranged in the STL line is set as a readout target line for imaging for phase difference detection (step S913). In this step S913, the number of read lines can be reduced by setting the line where the phase difference detection pixel is arranged among the STL lines where the in-focus object is imaged, as the read line.

  Subsequently, an STL synchronization signal is generated by the first synchronization signal generation unit 130 based on the set exposure time of the pixels on the STL line, and pixels on the STL line in the image sensor 200 are exposed based on the STL synchronization signal. (Step S914). Next, pixel data generated by the phase difference detection pixels by this exposure is supplied to the focus determination unit 170, and a focus determination process for calculating a defocus amount is performed by the focus determination unit 170 (step S915). Then, a focus lens driving process is performed in which the focus lens 113 is driven based on the calculated defocus amount (step S916), and the process proceeds to step S924. Note that when Steps S912 to S916 are performed, since the pixels of the LV line are driven as in the operation example shown in FIG. 8, the generation and display of the live view image are performed simultaneously. Note that step S914 is an example of a first control procedure described in the claims.

  If it is determined in step S911 that imaging for phase difference detection is not started, the control unit 120 determines whether imaging for still image shooting is to be started (step S918). If it is determined that imaging for still image imaging is not started (step S918), the process returns to step S911 and waits until either imaging for phase difference detection or imaging for still image imaging is started. To do.

  On the other hand, when it is determined to start imaging for still image capturing (step S918), the exposure time of the pixels of the STL line is set by the control unit 120 (step S919). Thereafter, all the STL lines are set as readout target lines in imaging for still image imaging (step S920). Subsequently, an STL synchronization signal is generated by the first synchronization signal generation unit 130 based on the set exposure time of the pixels on the STL line, and pixels on the STL line in the image sensor 200 are exposed based on the STL synchronization signal. (Step S921). Step S921 is an example of the second control procedure described in the claims.

  Thereafter, based on the pixel data (STL pixel data) generated by the pixels of the STL line, a still image for recording is generated by the first signal processing unit 140 (step S922). Then, the generated still image is recorded in the recording unit 181 (step S923). Note that when Steps S919 to S923 are performed, since the pixels of the LV line are driven as in the operation example shown in FIG. 8, the live view image is generated and displayed at the same time.

  Subsequently, the control unit 120 determines whether or not to end the imaging operation of the pixels of the STL line (step S924). When it is determined that the imaging operation for the pixels in the STL line is to be ended (step S924), the imaging processing procedure for the pixels in the STL line is ended. For example, when the operation mode of the imaging apparatus 100 is switched from the imaging mode to the image reproduction mode, it is determined that the imaging operation is finished.

  On the other hand, when it is determined not to end the imaging operation of the pixels of the STL line (step S924), the process returns to step S911, and either imaging for phase difference detection or imaging for still image imaging is performed.

<2. Modification>
In the embodiment of the present technology, the example in which the exposure for live view and the exposure for still image can be independently set in one image sensor has been described. Further, in this image sensor, no phase difference detection pixel is arranged in the line of the pixel for exposure for live view (LV line), and it is positioned in the line of the pixel for exposure for still image (STL line). Phase difference detection pixels are arranged. For this reason, while generating a live view image with an appropriate exposure time for live view, a phase difference detection pixel value can be generated with an appropriate exposure time for a phase difference detection pixel.

  Note that since a live view image can be captured while still images are being captured, even if continuous shooting is performed, the live view display does not freeze (does not black out) during continuous shooting. This has the advantage that the live view display is not fixed for the user who wants to check the live view display during continuous shooting. However, it is inconvenient for a user who wants to check a captured image during continuous shooting to be unable to check the captured image without fixing the live view display.

  Therefore, during continuous shooting, images taken in continuous shooting together with live view images are displayed in chronological order, and an example of a display that allows the user to easily check both live view images and captured images is shown below. A modification of the embodiment will be described with reference to FIG.

[Display example during continuous shooting]
FIG. 10 is a diagram schematically illustrating an example of a display in which both the live view image and the captured image can be easily confirmed during continuous shooting, as a modification of the embodiment of the present technology.

  FIG. 10 shows four images (images 611 to 614) indicating captured images (recorded images) captured by continuous shooting, along with an axis indicating the time axis, and three display screens (during continuous shooting). Screen 620, screen 630, screen 640).

  Note that the screen 620 is a display screen displayed from the image 611 to the image 612, and the screen 630 is a display screen displayed from the image 612 to the image 613. The screen 640 is a display screen that is displayed from the image 613 to the image 614.

  In this modification, live view display during continuous shooting and images captured so far are displayed in chronological order. Note that images captured so far are displayed small so as not to disturb the live view image. In addition, images captured so far are displayed together with marks indicating the time axis so that the user can easily understand the imaging relationship (imaging order). In FIG. 10, as an example of a mark indicating the time axis, an arrow is illustrated in which the current time is the tip of the arrow and the start of continuous shooting is the trailing end of the arrow.

  On the screen 620, a display area (recorded image display area 621) in which a recorded image (image 611) captured in continuous shooting before the live view display shown on the screen 620 is displayed, and the current time as a front end portion is displayed. An arrow (an arrow display area 625) is shown. Since the image 611 is the first continuous shot, the recorded image display area 621 is shown in association with the position of the rear end portion of the arrow in the arrow display area 625.

  On the screen 630, a display area (recorded image display areas 631 and 632) in which two recorded images (images 611 and 612) captured in continuous shooting before the live view display indicated by the screen 630 is displayed; An arrow (arrow display area 635) with the current time as the tip is shown together with the live view display. The recorded image display area 631 displaying the first image (image 611) is shown in association with the position of the rear end portion of the arrow in the arrow display area 625. The recorded image display area 632 displaying the second image (image 612) is shown in association with the position between the rear end portion and the front end portion of the arrow in the arrow display region 625. .

  Similar to the screens 620 and 630, the screen 640 includes a display area (recorded image display areas 641 to 642) showing recorded images captured so far by continuous shooting, and an arrow (arrow) having the current time as a tip portion. A display area 645) is shown with a live view display.

  In this way, the recorded images captured by continuous shooting are displayed in chronological order while the live view image is displayed. When there are a large number of recorded images taken by continuous shooting, it is possible to display the recorded images in order starting from the oldest recorded images or by reducing the display size per image. . Further, when there are a large number of recorded images picked up by continuous shooting, it is conceivable to display the recorded images in an overlapping manner to save display space. Therefore, in FIG. 11, an example in which the recorded images are displayed in an overlapping manner will be described.

  FIG. 11 is a diagram schematically illustrating an example in which a plurality of recorded images are displayed in a superimposed manner in the display of the recorded images in the live view image according to the modification of the embodiment of the present technology.

  FIG. 11 a shows an example in which, in a live view image, all recorded images captured by continuous shooting cannot be displayed in an overlapping manner. Here, description will be made on the assumption that only three recorded images can be displayed as shown in the screen 640 of FIG. As shown in the display 661, when the number of recorded images in the live view image is the upper limit of the number of images, if the image is further imaged, the recorded images are displayed in an overlapping manner as shown in the display 662. Thereby, many recorded images can be displayed. In FIG. 11a, the example in which the images are displayed in an overlapped manner after the upper limit of the number of sheets has been described has been described.

  FIG. 11 b shows an example in which the image size is reduced and displayed according to the imaging timing. As shown in the displays 671 to 673, the recorded image with the oldest imaging timing is displayed the smallest, and the recorded image with the newest imaging timing is displayed with the largest display. In the case of FIG. 11b as well as in FIG. 11a, the display of the recorded images can be shown in an overlapping manner after the upper limit of the number of recorded images has been reached. It is also possible to display so that there is no.

  In the case of FIG. 11b, since the recorded image with the oldest imaging timing is displayed smallest, it is difficult to confirm the first (first) recorded image. For this reason, the first recorded image is not reduced in size or superimposed on the display so that the first recorded image can be compared with the latest recorded image even when the size is reduced or the display is superimposed. It is also possible to display the recorded image so that it can be compared.

  In the embodiment of the present technology, since the live view image is not stationary, it is difficult for the user to know the exposure timing in continuous shooting. Therefore, it is conceivable to display a mark (for example, a frame) indicating that the exposure period is in progress in live view display.

  As described above, according to the embodiment of the present technology, it is possible to simultaneously perform still image capturing and live view image capturing with appropriate exposure times, and to perform live view image capturing and processing. Imaging for phase difference detection can be performed simultaneously with appropriate exposure times. This enables live view display without interruption during still image shooting, and makes it easy to capture a subject. In particular, live view is possible even during continuous shooting, and even in an imaging apparatus having only one image sensor, it is possible to capture a subject during continuous shooting. Further, according to the embodiment of the present technology, it is possible to obtain phase difference detection pixel data at an exposure time and timing suitable for phase difference detection (when the user wants to perform focus adjustment or when the focus lens is driven). it can. For this reason, the detection accuracy and the detection speed are improved, and the focusing accuracy and the focusing speed can be improved.

  Further, in the embodiment of the present technology, since no phase difference detection pixel is arranged in the LV line, interpolation of data at the position of the phase difference detection pixel is not necessary when generating a live view image. For this reason, it is possible to generate a high-quality live view image as compared with the case where the image generation pixel and the phase difference detection pixel are read simultaneously and the pixel data at the position of the phase difference detection pixel is complemented. That is, it is possible to achieve both generation of a high-quality live view image and high-accuracy phase difference detection based on the pixel values of the phase difference detection pixels exposed with an exposure time suitable for phase difference detection.

  That is, according to the embodiment of the present technology, it is possible to achieve both high-quality live view images and highly accurate phase difference detection.

  In the embodiment of the present technology, for convenience of explanation, an example in which only a pair of a right aperture phase difference detection pixel and a left aperture phase difference detection pixel is arranged as a phase difference detection pixel is shown. It is not limited to. It is also conceivable to arrange a pair of phase difference detection pixels (upper aperture phase difference detection pixels, lower aperture phase difference detection pixels) that divide the pupil above and below the exit pupil (+ -side in the Y-axis direction). When the phase difference detection pixels for pupil division are arranged above and below, they are arranged in a row in the column direction so that a shift in the column direction of the image can be detected. In addition, by arranging both the pair of the right aperture phase difference detection pixel and the left aperture phase difference detection pixel and the pair of the upper aperture phase difference detection pixel and the lower aperture phase difference detection pixel, the phase difference is When it is difficult to detect, the other can be compensated, so that the detection accuracy by the phase difference can be improved. Even in such a case, two drive circuits are provided, and the phase difference detection pixel is not provided in the live view side line (LV line), so that it can be implemented in the same manner as the embodiment of the present technology.

  In the embodiment of the present technology, the color filter provided in the image generation pixel is assumed to be a color filter of three primary colors (RGB). However, the present invention is not limited to this. For example, the present invention can be similarly applied to the case where the image generation pixel is provided with a complementary color filter. In addition, a pixel that detects all light having a wavelength in the visible light region in one pixel region (for example, an image sensor in which a blue pixel, a green pixel, and a red pixel are overlapped in the optical axis direction) ) Is an image generation pixel, the embodiment of the present technology can be similarly applied.

  Further, in the embodiment of the present technology, the phase difference detection pixel has been described on the assumption that one of the light divided into two pupils is received, but the present invention is not limited to this. For example, even in the case of a phase difference detection pixel that includes two light receiving elements without including a pupil dividing light-shielding layer and can receive light divided by each of the light receiving elements, the embodiment of the present technology is used. Can be applied. In addition, in the case of a phase difference detection pixel that includes a light-receiving element having a half size without including a pupil-dividing light-shielding layer and can receive one of the light beams divided by the pupil with the light-receiving element having a half size Can also be implemented in the same manner.

  The above-described embodiment shows an example for embodying the present technology, and the matters in the embodiment and the invention-specific matters in the claims have a corresponding relationship. Similarly, the invention specific matter in the claims and the matter in the embodiment of the present technology having the same name as this have a corresponding relationship. However, the present technology is not limited to the embodiment, and can be embodied by making various modifications to the embodiment without departing from the gist thereof.

  Further, the processing procedure described in the above embodiment may be regarded as a method having a series of these procedures, and a program for causing a computer to execute these series of procedures or a recording medium storing the program. You may catch it. As this recording medium, for example, a hard disk, a CD (Compact Disc), an MD (MiniDisc), a DVD (Digital Versatile Disk), a memory card, a Blu-ray Disc (registered trademark), or the like can be used.

In addition, this technique can also take the following structures.
(1) A first image generation pixel that is an image generation pixel driven based on a first synchronization signal for detecting a phase difference or generating a recorded image, and a phase difference detection driven based on the first synchronization signal An image generation pixel that is driven on the basis of a second synchronization signal that is different from the first synchronization signal and is a synchronization signal for generating a pixel and a live view image. A pixel array unit composed of second image generation pixels;
A first output unit for outputting pixel data of the first image generation pixel and the phase difference detection pixel to the outside;
An imaging device comprising: a second output unit that outputs pixel data of the second image generation pixel to the outside.
(2) The pixel array unit includes a first line configured only by the second image generation pixel, a second line configured by the first image generation pixel and the phase difference detection pixel, and the first image. The imaging device according to (1), wherein a third line including only generated pixels is arranged, and a total number of the second line and the third line is larger than a number of the first lines.
(3) The imaging device according to (2), wherein in the pixel array unit, the first lines are arranged at odd-numbered lines, and one of the second line and the third line is arranged on another line. .
(4) The imaging device according to (2) or (3), wherein the second line is disposed adjacent to the first line.
(5) a first image generation pixel which is an image generation pixel driven based on a first synchronization signal for phase difference detection or generation of a recorded image, and phase difference detection driven based on the first synchronization signal An image generation pixel that is driven on the basis of a second synchronization signal that is different from the first synchronization signal and is a synchronization signal for generating a pixel and a live view image. A pixel array unit configured by second image generation pixels, a first output unit for outputting pixel data of the first image generation pixels and the phase difference detection pixels to the outside, and pixel data of the second image generation pixels An image sensor comprising: a second output unit that outputs to the outside;
When the line where the second image generation pixel is arranged is driven to generate the pixel data output from the second output unit and the phase difference detection is performed, the phase difference detection pixel is arranged. When the line data is driven to generate the pixel data output from the first output unit and the recording image is generated, the line on which the first image generation pixel is arranged is driven to An imaging apparatus comprising: a control unit that performs control to generate the pixel data output from the first output unit.
(6) When the phase difference detection is performed, the first synchronization signal is generated based on an exposure time corresponding to the phase difference detection, and when the recording image is generated, the recording image is generated. A first synchronization signal generator for generating the first synchronization signal based on an exposure time according to
The imaging apparatus according to (5), further including a second synchronization signal generation unit configured to generate the second synchronization signal based on an exposure time corresponding to the generation of the live view image.
(7) When the control unit displays the live view image on the display unit during continuous shooting, the control unit displays a reduced image of the recorded image generated during the continuous shooting together with the live view image. The imaging device according to (5) or (6).
(8) A first image generation pixel which is an image generation pixel driven based on a first synchronization signal for phase difference detection or generation of a recorded image, and a phase difference detection driven based on the first synchronization signal An image generation pixel that is driven on the basis of a second synchronization signal that is different from the first synchronization signal and is a synchronization signal for generating a pixel and a live view image. A pixel array unit configured by second image generation pixels, a first output unit for outputting pixel data of the first image generation pixels and the phase difference detection pixels to the outside, and pixel data of the second image generation pixels In the case where the phase difference detection is performed together with the generation of the live view image in which the line on which the second image generation pixel is arranged is driven in an image pickup device including a second output unit that outputs to the outside A first control procedure for performing control to drive the line in which the phase difference detection pixels are arranged to generate the pixel data used for the phase difference detection;
When generating the recorded image together with the generation of the live view image in which the line in which the second image generation pixel is arranged in the imaging element is driven, the first image generation pixel is arranged. An imaging method comprising: a second control procedure for performing control for driving the line to generate the pixel data used for generating the recorded image.
(9) A first image generation pixel that is an image generation pixel driven based on a first synchronization signal for phase difference detection or generation of a recorded image, and a phase difference detection driven based on the first synchronization signal An image generation pixel that is driven on the basis of a second synchronization signal that is different from the first synchronization signal and is a synchronization signal for generating a pixel and a live view image. A pixel array unit configured by second image generation pixels, a first output unit for outputting pixel data of the first image generation pixels and the phase difference detection pixels to the outside, and pixel data of the second image generation pixels In the case where the phase difference detection is performed together with the generation of the live view image in which the line on which the second image generation pixel is arranged is driven in an image pickup device including a second output unit that outputs to the outside A first control procedure for performing control to drive the line in which the phase difference detection pixels are arranged to generate the pixel data used for the phase difference detection;
When generating the recorded image together with the generation of the live view image in which the line in which the second image generation pixel is arranged in the imaging element is driven, the first image generation pixel is arranged. The program which makes a computer perform the 2nd control procedure which performs control which drives a line and produces | generates the said pixel data used for the production | generation of the said recording image.

DESCRIPTION OF SYMBOLS 100 Imaging device 110 Lens part 111 Zoom lens 112 Aperture 113 Focus lens 120 Control part 125 Operation reception part 130 1st synchronization signal generation part 140 1st signal processing part 150 2nd synchronization signal generation part 160 2nd signal processing part 170 Focusing Determination unit 175 Lens drive unit 181 Recording unit 182 Display unit 200 Image sensor 210 First control unit 220 First vertical drive circuit 230 First horizontal drive circuit 240 First column signal processing unit 260 First output buffer 310 Second control unit 320 Second vertical drive circuit 330 Second horizontal drive circuit 340 Second column signal processing unit 360 Second output buffer

Claims (9)

A first image generation pixel that is an image generation pixel driven based on a first synchronization signal for phase difference detection or generation of a recorded image; a phase difference detection pixel driven based on the first synchronization signal; A second image that is a synchronization signal for generating a live view image and is driven based on a second synchronization signal different from the first synchronization signal, and is an image generation pixel having a smaller number than the first image generation pixel A pixel array unit composed of generated pixels;
A first output unit for outputting pixel data of the first image generation pixel and the phase difference detection pixel to the outside;
An imaging device comprising: a second output unit that outputs pixel data of the second image generation pixel to the outside.   The pixel array unit includes a first line composed only of the second image generation pixels, a second line composed of the first image generation pixels and the phase difference detection pixels, and only the first image generation pixels. 3. The imaging device according to claim 1, wherein a third line composed of the second line and the third line is greater than a number of the first lines.   The imaging device according to claim 2, wherein in the pixel array unit, the first line is arranged every odd number of lines, and one of the second line and the third line is arranged on another line.   The imaging device according to claim 2, wherein the second line is disposed adjacent to the first line. A first image generation pixel that is an image generation pixel driven based on a first synchronization signal for phase difference detection or generation of a recorded image; a phase difference detection pixel driven based on the first synchronization signal; A second image that is a synchronization signal for generating a live view image and is driven based on a second synchronization signal different from the first synchronization signal, and is an image generation pixel having a smaller number than the first image generation pixel A pixel array unit composed of generated pixels, a first output unit that outputs pixel data of the first image generation pixel and the phase difference detection pixel to the outside, and pixel data of the second image generation pixel to the outside An image sensor comprising a second output unit for outputting;
When the line where the second image generation pixel is arranged is driven to generate the pixel data output from the second output unit and the phase difference detection is performed, the phase difference detection pixel is arranged. When the line data is driven to generate the pixel data output from the first output unit and the recording image is generated, the line on which the first image generation pixel is arranged is driven to An imaging apparatus comprising: a control unit that performs control to generate the pixel data output from the first output unit. When performing the phase difference detection, the first synchronization signal is generated based on the exposure time according to the phase difference detection, and when generating the recorded image, the first image is generated according to the generation of the recorded image. A first synchronization signal generator for generating the first synchronization signal based on an exposure time;
The imaging apparatus according to claim 5, further comprising: a second synchronization signal generation unit configured to generate the second synchronization signal based on an exposure time corresponding to generation of the live view image.   The control unit, when displaying the live view image on a display unit during continuous shooting, displays a reduced image of the recorded image generated during the continuous shooting together with the live view image. The imaging device described. A first image generation pixel that is an image generation pixel driven based on a first synchronization signal for phase difference detection or generation of a recorded image; a phase difference detection pixel driven based on the first synchronization signal; A second image that is a synchronization signal for generating a live view image and is driven based on a second synchronization signal different from the first synchronization signal, and is an image generation pixel having a smaller number than the first image generation pixel A pixel array unit composed of generated pixels, a first output unit that outputs pixel data of the first image generation pixel and the phase difference detection pixel to the outside, and pixel data of the second image generation pixel to the outside In the case where the phase difference detection is performed together with the generation of the live view image that drives the line in which the second image generation pixel is arranged in an imaging device including a second output unit that outputs A first control procedure for performing control to generate the pixel data used for the phase difference detection by driving the line phase difference detection pixels are arranged,
When generating the recorded image together with the generation of the live view image in which the line in which the second image generation pixel is arranged in the imaging element is driven, the first image generation pixel is arranged. An imaging method comprising: a second control procedure for performing control for driving the line to generate the pixel data used for generating the recorded image. A first image generation pixel that is an image generation pixel driven based on a first synchronization signal for phase difference detection or generation of a recorded image; a phase difference detection pixel driven based on the first synchronization signal; A second image that is a synchronization signal for generating a live view image and is driven based on a second synchronization signal different from the first synchronization signal, and is an image generation pixel having a smaller number than the first image generation pixel A pixel array unit composed of generated pixels, a first output unit that outputs pixel data of the first image generation pixel and the phase difference detection pixel to the outside, and pixel data of the second image generation pixel to the outside In the case where the phase difference detection is performed together with the generation of the live view image that drives the line in which the second image generation pixel is arranged in an imaging device including a second output unit that outputs A first control procedure for performing control to generate the pixel data used for the phase difference detection by driving the line phase difference detection pixels are arranged,
When generating the recorded image together with the generation of the live view image in which the line in which the second image generation pixel is arranged in the imaging element is driven, the first image generation pixel is arranged. The program which makes a computer perform the 2nd control procedure which performs control which drives a line and produces | generates the said pixel data used for the production | generation of the said recording image.

Images