RU2574316C2 - Imaging element and image forming apparatus - Google Patents

Abstract

FIELD: physics, computer engineering.

SUBSTANCE: invention relates to imaging elements which determine phase difference and record an image. An imaging element comprises a plurality of phase difference determining pixels, configured to generate signals for making a decision on adjusting focus by determining phase difference, and a plurality of image generating pixels. A first group of pixels formed by arranging part of the phase difference determining pixels in a specified direction and a second group of pixels formed by arranging part of the image generating pixels from the plurality of image generating pixels in said specified direction are arranged alternately in a direction perpendicular to said specified direction. The first group of pixels comprises a first line formed by arranging, in a specified direction, phase difference determining pixels to be divided by the pupil in a specified direction, and a second line formed by arranging, in said specified direction, phase difference determining pixels to be divided by the pupil in a perpendicular direction, wherein the first and second lines are arranged alternately across the second group of pixels.

EFFECT: reduced processing load relating to image generation.

13 cl, 14 dwg

Description

FIELD OF THE INVENTION

The present invention relates to an image pickup element, and more particularly relates to an image pickup element that determines a phase difference and captures images, and relates to an image forming apparatus.

State of the art

Recently, imaging devices such as digital cameras that receive images of objects, such as people, generate acquired images, and record said generated received images, are common. Moreover, imaging devices with autofocus (AF) functions are widely used, in which the focal length (focus point) on the resulting image is automatically adjusted, which is done to facilitate image acquisition operations performed by the user.

Image forming devices are widespread in which a pair of images is formed by separating the light from the pupil that has passed through the image acquisition lens and in which the interval between the generated images is measured (phase difference is determined) in order to determine the position of the image acquisition lens (see, for example, patent document 1) . This image forming apparatus generates a pair of images due to the presence of pixels in the image sensor determining the focus adjustment, which separate the pupil by blocking half the light from the object received by the light receiving element, and calculates the amount of focus divergence by measuring the interval between the generated images. Further, this image forming apparatus adjusts the focus by calculating the amount of movement of the image pickup lens based on the calculated amount of focus difference and adjusting the position of the image pickup lens based on the calculated amount of movement (focus adjustment).

List of documents

Patent documents

Patent Document 1: Japanese Patent Application Laid-Open No. 2009-145401 (FIG. 15)

Disclosure of invention

The tasks solved by the invention

According to the aforementioned conventional technology, both phase difference detection pixels (focus adjustment determination pixels (phase difference determination pixels) and image generation pixels (image generation pixels) are provided on one image sensor, and therefore it is not necessary to provide two separate a sensor acting as a sensor for determining focus adjustment and an image acquisition sensor.

However, in accordance with the aforementioned conventional technology, the phase difference detection pixels cannot generate a signal, and therefore, it is necessary to predict (supplement) the data at the position of the phase difference determination pixel from the data of a closely located image generation pixel, considering the position of the phase difference determination pixel as faulty pixel position. In this case, the image generation pixel located next to the phase difference determination pixel has different properties compared to the image generation pixel located next to only the image generation pixel, and it is necessary to make corrections during image formation. This makes it necessary to process when generating images corresponding to the phase difference determination pixels and images corresponding to image generation pixels located close to the phase difference determination pixels, thereby increasing the load of said image processing.

The present invention has been proposed in view of such a situation, and an object of the present invention is to reduce a processing load related to image generation in the case where an image acquisition element is used to determine the phase difference and generate the image.

The solution of the problem

The present invention is made to solve the aforementioned problem, and a first aspect of the present invention comprises the following: a plurality of phase difference determination pixels for generating signals for making a focus adjustment decision by determining a phase difference; and a plurality of image generation pixels for generating signals for generating the image, and a first group of pixels formed by arranging a portion of the pixels for determining a phase difference from the plurality of pixels for determining the phase difference in a specific direction, and a second group of pixels formed by arranging a portion of the pixels of generating the image from the plural pixels of image generation in a specific direction, arranged alternately with each other in a direction perpendicular to particular direction. This ensures that the first group of pixels formed by arranging the pixels for determining the phase difference in a specific direction, and the second group of pixels formed by arranging a portion of the pixels of the image generation are arranged alternately with each other.

Further, in accordance with the first aspect, each of the plurality of image generating pixels may have a fixed pixel ratio of determining the phase difference and image generating pixels for each adjacent pixel in the region of the image receiving element that receives light from the object. Due to this, it is achieved that the ratio of the pixels for determining the phase difference and the image generation pixels is fixed for each pixel located next to the image generation pixels.

Further, in accordance with the first aspect, the first group of pixels may comprise a plurality of phase difference determination pixels that form one or more lines, and the second group of pixels may comprise a plurality of image generating pixels forming one or more lines. Thus, it is ensured that the first group of pixels contains a plurality of pixels for determining a phase difference forming one or more lines, and the second group of pixels contains a plurality of image generating pixels forming one or two lines.

Further, in accordance with the first aspect, a specific direction may be a read direction when data generated by the phase difference determination pixels and image generation pixels is read from the phase difference determination pixels and the image generation pixels. In this way, it is ensured that the first group of pixels formed by arranging the pixels for determining the phase difference in the reading direction and the second group of pixels formed by arranging the portion of the image generating pixels in the reading direction are arranged alternately with each other.

Further, in accordance with the first aspect, the first group of pixels may comprise a plurality of phase difference determination pixels that form a single line, and the second group of pixels may comprise a plurality of image generation pixels forming one line and two inextricable image generation pixels from a plurality of image generation pixels containing color filters with the same properties, and which are located in a specific direction, can form a pair of image generation pixels and each pixel The spruce can be located using a pair of image generating pixels as pixel blocks. This ensures that two inextricable image generation pixels that contain color filters with the same properties and which are located in a specific direction form a pair of image generation pixels, and each pixel is located using a pair of image generation pixels as pixel blocks. Further, in this case, a plurality of image generating pixels may be arranged in accordance with the Bayer pattern in pixel blocks in the image pickup element. In this way, it is ensured that the blocks of image generating pixels are arranged in accordance with a Bayer pattern.

Further, in accordance with the first aspect, two pixels of the determination of the phase difference from the plurality of pixels of the determination of the phase difference, which carry out the separation by the pupil in the same direction and receive the light divided in the same path in the same direction, can form a pair of pixels of the determination of the phase difference as two inextricable determination pixels phase differences located in a specific direction, and each pixel can be formed by a pair of pixels to determine the phase difference as blocks of pixels. This ensures that two inextricable phase difference determination pixels that are located in a specific direction form a pair of phase difference determination pixels and each pixel is located using a pair of phase difference determination pixels as pixel blocks.

Further, in accordance with the first aspect, two inextricable light-receiving elements from light-receiving elements of a plurality of image generating pixels that contain color filters with the same properties and which are located in a specific direction can form a pair of light-receiving elements and each pixel can be located using two pixels related to a pair of light receiving elements as pixel blocks. Thus, it is ensured that the image generating pixel contains two light receiving elements as a pair of light receiving elements.

Further, in accordance with the first aspect, two light-receiving elements from light-receiving elements of a plurality of phase difference determination pixels that perform pupil separation in the same direction and which receive light divided in the same path of the same direction can form a pair of light-receiving elements and each element may be located using two pixels belonging to a pair of light receiving elements as a block of pixels. In this way, it is ensured that, as a pair of light receiving elements, the phase difference detection pixel contains two light receiving elements.

Further, in accordance with the first aspect, the first group of pixels may comprise a first line formed by arranging the phase difference detection pixels in a specific direction to separate the pupil in a specific direction, and a second pixel group formed by arranging the phase difference determination pixels in a specific direction that carry out the separation of the pupil in the perpendicular direction, and the first line and the second line can be located alternating with the second group of pixels. Thus, it is ensured that the first line of pixels for determining the phase difference, which carry out the separation of the pupil in a specific direction, and the second line of pixels for determining the phase difference, which perform the separation of the pupil in the perpendicular direction, are arranged alternating with the second group of pixels. Further, in this case, the phase difference determination pixel may comprise a plurality of phase difference determination pixels corresponding to a plurality of exit pupils that are located at different positions in the direction of the optical axis, and the first line may be formed by arranging the phase difference determination pixels from the plurality of phase difference determination pixels, for which exit pupils are located in the same positions. In this way, it is ensured that the first line is formed by arranging the pixels for determining the phase difference from the plurality of pixels for determining the phase difference, for which the exit pupils are located at the same positions. Further, in this case, the plurality of phase difference determination pixels may comprise a plurality of phase difference determination pixels corresponding to a plurality of exit pupils that are located at different positions in the direction of the optical axis, and a second line can be formed by arranging the phase difference determination pixels in which the exit pupils are located in the same positions, in a position that coincides with the position in a particular direction. In this way, it is ensured that the second line is formed so that the pixels for determining the phase difference in which the exit pupils are in the same positions are located in a position that coincides with said position in a specific direction.

Further, in accordance with a second aspect of the present invention, the image pickup element comprises a plurality of phase difference determination pixels that generate signals for making a focus adjustment decision by determining a phase difference; and a plurality of image generation pixels that generate signals for generating the image, and each of the plurality of image generation pixels has a fixed ratio of phase difference pixels and image generation pixels for each adjacent pixel in the region of the image pickup element that receives light from the object. Due to this, it is achieved that the pixel ratio of the determination of the phase difference and the image generation pixels obtained for each pixel located next to the image generation pixels.

Further, in accordance with a third aspect of the present invention, the image forming apparatus comprises an image acquisition element comprising a plurality of phase difference determination pixels for generating signals for making a focus adjustment decision by determining a phase difference, and a plurality of image generating pixels for generating signals for generating an image, this is the first group of pixels formed by arranging pixels to determine a phase difference from a plurality of pixels EFINITIONS phase difference in a specific direction, and the second group of pixels, formed by arranging pixels for generating images of the plurality of pixels generate an image in a specific direction are arranged alternately in a direction perpendicular to said specific direction; a focus adjustment decision block for making a focus adjustment decision by determining a phase difference based on signals generated by the phase difference determination pixels; and an image generating unit for generating an image based on the signals generated by the image generating pixels. Thus, it is ensured that the focus is adjusted by determining the phase difference and the image generation is performed by using the image pickup element in which the first group of pixels formed by arranging the pixels for determining the phase difference in a specific direction and the second group of pixels formed by forming the generating pixels images in a specific direction are arranged alternately with each other.

The effects achieved by the invention

The present invention can provide a positive effect of reducing a load in processing related to image generation in the case where an image pickup element is used to determine the image, which is used to determine the phase difference and generate the image.

Brief Description of the Drawings

FIG. 1 is a view showing a block diagram illustrating an example of the functioning and structure of an image forming apparatus 100 that corresponds to a first embodiment of the present invention;

FIG. 2 is a view schematically showing a sectional view illustrating an example arrangement of a film mirror 160 of an image forming apparatus 100 that corresponds to a first embodiment of the present invention;

FIG. 3 is a view schematically showing an example of the arrangement of light receiving elements of the second image sensor 200 in accordance with the first embodiment of the present invention;

4 is a plan view schematically showing an example of the arrangement of pixels in a region 340 of a second image sensor 200 in accordance with a first embodiment of the present invention and an example of a pixel arrangement of a conventional image sensor;

5 is a view schematically showing an internal pixel structure of a second image sensor 200 in accordance with a first embodiment of the present invention and an internal pixel structure of a conventional image sensor;

6 is a view schematically showing pupil separation for a phase difference determination pixel D1 and a phase difference determination pixel D2 in accordance with a first embodiment of the present invention;

7 is a view schematically showing pupil separation for a phase difference determination pixel D3 and a phase difference determination pixel D4 in accordance with a first embodiment of the present invention;

FIG. 8 is a view schematically showing pixels located adjacent to image generation pixels of a second image sensor 200 in accordance with the first embodiment of the present invention, and pixels adjacent to image generation pixels of a conventional image sensor;

FIG. 9 is a view schematically showing a received image generated based on a signal of a second image sensor 200 in accordance with a first embodiment of the present invention and a received image generated based on a signal of a conventional image sensor;

10 is a view showing a diagram illustrating an example of a data reading speed for a second image sensor 200 in accordance with a first embodiment of the present invention and an example of a data reading speed for a conventional image sensor;

11 is a view showing an example of the arrangement of the light receiving elements of the second image sensor, in which the positions of the pair of pixels of the phase difference detection are opposite to the positions of the same pixels of the first embodiment of the invention, this example corresponding to a modified example of the first embodiment of the present invention;

12 is a view showing an arrangement of light receiving elements of a second image sensor in which only phase difference determination pixels that perform pupil separation in a read direction are located in a pixel row of phase difference determination pixels in accordance with a modified example of the first embodiment of the present invention;

13 is a view showing the arrangement of light receiving elements of the second image sensor, which is different from FIG. 12 and in which only the phase difference determination pixels that perform pupil separation in the read direction are located in the pixel row of the phase difference determination in accordance with a modified example a first embodiment of the present invention;

Fig. 14 is a view showing an example of the arrangement of light receiving elements of the second image sensor, in which the lines of the phase difference determination pixels and the lines of image generation pixels are arranged alternately with each other every two lines in accordance with a modified example of the first embodiment of the present invention.

The implementation of the invention

Next, an embodiment of the present invention will be described. This embodiment of the invention will be described in the following order.

1. First embodiment of the invention (image acquisition control: an example in which phase lines of phase difference determination pixels and image generation pixel lines are arranged alternately with each other)

2. Modified Example

1. The first embodiment of the invention

An example of the functioning and structure of an image forming apparatus. 1 is a block diagram illustrating an example of the functioning and structure of an image forming apparatus 100 that corresponds to a first embodiment of the present invention. The image forming apparatus 100 is an image forming apparatus that captures an image of an object, generates image data (received image), and records the generated image data as image content (contents of a still image or a moving image). In addition, an example will be mainly described below in which still image content (still image file) is recorded as image content (image file).

The image forming apparatus 100 comprises a lens unit 110, an operation receiving unit 120, a control unit 130, a first image sensor 140 and a first signal processing unit 150. Additionally, the image forming apparatus 100 comprises a film mirror 160, a second image sensor 200, a second signal processing unit 170, a memory unit 181, a display unit 182, a focus adjustment decision block 183, and a drive unit 184.

The lens unit 110 compresses the light (object light) from the object. This lens unit 110 comprises a zoom lens 111, aperture 112, and a focus lens 113.

The zoom lens 111 controls the magnification of the object contained in the acquired image by changing the focal length, while it is driven by the drive unit 184 and it moves in the direction of the optical axis.

The aperture 112 is a blocking material adapted to adjust the amount of light from an object incident on the first image sensor 140 and the second image sensor 200, which is done by changing the openings provided by the drive unit 184.

The focus lens 113 adjusts focus by moving in the direction of the optical axis, wherein said focus lens 113 drives the drive unit 184.

The operation receiving unit 120 receives the operation from the user. When, for example, the shutter button 121 is pressed (shown in FIG. 2), this operation receiving unit 120 provides a signal associated with this pressing to the control unit 130 as an operation signal.

The control unit 130 controls the operation of each block of the image forming apparatus 100. For example, when receiving an operation signal to start recording a still image in response to pressing the shutter button 121, this control unit 130 provides a signal regarding recording a still image (an operation signal to obtain a still image) to the first signal processing unit 150. Further, to display the real-time view in the display unit 182, the control unit 130 provides a signal (real-time view display signal) to the second signal processing unit 170 to generate a real-time image based on a signal outputted by the second image sensor 200. Meanwhile, the real-time view relates to real-time display of an image of an object falling into the image forming apparatus 100. Further, when making the decision to adjust the focus in accordance with the phase difference determination system, the control unit 130 provides a signal (signal of the phase difference determination operation) to the second signal processing unit 170 indicating operation (phase difference determination operation) aimed at making the decision on the adjustment focusing. In this case, the phase difference determination system is a focus determination system that forms a pair of images by separating the pupil of the light passing through the image forming lens, measuring the interval between the generated images (the difference between the images (determine the phase difference)) and determining the degree of focus adjustment.

A film mirror 160 divides the light from the object, condensed by the lens unit 110, into two parts. This film mirror 160 is, for example, a translucent mirror and divides the light from the object into two parts by reflecting 30% of the light from the object. The film mirror 160 supplies one part of the divided light to the first image sensor 140 and supplies the other part to the second image sensor 200.

The first image sensor 140 is an image pickup element that receives one part of the light from an object separated by a film mirror 160, and photoelectricly converts the received light from the object to an electrical signal. This first image sensor 140 is implemented using, for example, a CMOS sensor (complementary metal oxide semiconductor). In the first image sensor 140, only pixels (image generating pixels) that generate signals for generating the obtained image based on the received light from the object are arranged in accordance with the Bayer pattern. The first image sensor 140 provides an electrical signal obtained by photoelectric conversion to the first signal processing unit 150.

The first signal processing unit 150 applies various types of signal processing to an electrical signal supplied from the first image sensor 140. When, for example, a photographic image receiving operation signal is received from the control unit 130, said first signal processing unit 150 generates photographic image data. Next, the first signal processing unit 150 supplies this generated image data to the memory unit 181 and the memory unit 181 stores this image data.

This memory unit 181 records image data supplied from the first signal processing unit 150 as image content (image file). For example, a removable storage medium (one or more storage media), such as disks, for example DVD (universal digital disk) disks, or semiconductor memories, including memory cards, can be used for this memory unit 181. Further, this storage medium may be integrated in the image forming apparatus 100 or may be configured to be disconnected from the image forming apparatus 100.

The second image sensor 200 is an image pickup element that receives one part of the light from an object separated by a film mirror 160, and photoelectricly converts the received light from the object to an electrical signal. This second image sensor 200 is implemented using, for example, a CMOS sensor similar to the first image sensor 140. In the second image sensor 200, image generation pixels and pixels (phase difference determination pixels) are located that generate signals for performing phase difference determination. In addition, hereinafter, with reference to FIGS. 3-10, a second image sensor 200 will be described. The second image sensor 200 supplies the second signal processing unit 170 with an electrical signal obtained by photoelectric conversion. In addition, the second image sensor 200 is an example of an image pickup element as described in the claims.

The second signal processing unit 170 applies various types of signal processing to the electrical signal supplied from the second image sensor 200. When, for example, a phase difference determination signal is received from the control unit 130, this signal processing unit 170 generates data (phase difference determination data) adapted to determine the phase difference based on the output signals from the phase difference determination pixels of the second image sensor 200. Next, the second signal processing unit 170 supplies the generated phase difference determination data to the focus adjustment decision unit 183. Moreover, when receiving the real-time display signal from the control unit 130, the second signal processing unit 170 generates real-time image data based on the output signals from the image generating pixels of the second image sensor 200. Next, the second signal processing unit 170 supplies this generated real-time image data and makes the screen of the display unit 182 display in real time. In addition, the second image processing sensor 170 is an example of an image generating element referred to in the claims.

The display unit 182 displays an image based on image data supplied from the second signal processing unit 170. This display unit 182 is implemented, for example, in the form of a color liquid crystal panel. When, for example, receiving real-time image data from the second signal processing unit 170, this display unit 182 displays a real-time image on the screen.

The focus adjustment decision block 183 decides whether the focus is adjusted relative to the subject (the focus adjustment target), which is the focus target, which is done based on the phase difference determination data supplied from the second signal processing unit 170. When the focus is adjusted on the subject (focus adjustment target) in the focus area (focus area), this focus adjustment decision block 183 supplies the drive unit 184 with information indicating that the focus is adjusted as the result information focus adjustment decisions. Further, when the focus is not adjusted for the purpose of focus adjustment, this focus adjustment decision block 183 calculates the amount of focus divergence (defocus amount) and provides information to the drive unit 184 indicating the calculated defocus amount as information about the result of the focus adjustment decision.

This drive unit 184 drives a zoom lens 111, an aperture 112, and a focus lens 113. For example, the drive unit 184 calculates the amount of movement of the focus lens 113 based on the result of the focus adjustment decision from the focus adjustment decision unit 183, and moves the focus lens 113 in accordance with the calculated amount of movement. When the focus is adjusted, this drive unit 184 maintains the current position of the focus lens 113. Further, in the presence of defocusing, the drive unit 184 calculates a displacement amount (displacement distance) based on the result of the focus adjustment decision, which indicates a defocus amount and position information of the focus lens 113, and moves the focus lens 113 in accordance with the displacement amount.

An example of the location of the film mirror

2 is a schematic cross-sectional view illustrating an example of the position of the film mirror 160 of the image forming apparatus 100 that corresponds to the first embodiment of the present invention. In addition, the image forming apparatus 100 will be described using FIG. 2 as a single lens reflex camera.

2, a sectional view of the image forming apparatus 100 shows a shutter button 121, a screen (liquid crystal display device 182a) of the display unit 182, a film mirror 160, a first image sensor 140 and a second image sensor 200. Moreover, figure 2 shows the optical axis (optical axis L12) for the lens of the lens unit 110 and two lines (lines L11 and L13) showing the range in which light from the object passes. In addition, the range between the lines L11 and L13 indicates the range in which light is supplied to the first image sensor 140 and the second image sensor 200.

A film mirror 160 is arranged to divide the light from the object supplied to the image forming apparatus 100 into two parts. For example, the film mirror 160 is located at an angle of 45 degrees relative to the optical axis L12. Due to this, the film mirror 160 reflects upward a portion (e.g., 30%) of the light from the object.

The first image sensor 140 is located vertically relative to the optical axis L12 in front of the film mirror 160 (the direction of movement of light from the object) and is adapted to receive light from an object passing the film mirror 160.

The second image sensor 200 is located horizontally relative to the optical axis L12 above the film mirror 160 (when the film mirror 160 is at an angle of 45 degrees relative to the optical axis L12) and is adapted to receive light from an object reflected by the film mirror 160.

Thus, in the image forming apparatus 100, the film mirror 160 is positioned to divide the incident light from the object into two parts. Next, the first image sensor 140 and the second image sensor 200 are arranged so as to receive two parts of the separated light from the object.

An example of the location of the light receiving elements of the second image sensor

Figure 3 schematically shows an example of the arrangement of the light receiving elements of the second image sensor 200 in accordance with the first embodiment of the present invention. According to a first embodiment of the present invention, one image generating pixel contains two light receiving elements and one phase difference determining pixel also contains two light receiving elements. Next, with reference to figure 3, we describe the location of the light receiving elements.

In addition, in the description of FIG. 3, the xy axis will be used, with the left and right directions corresponding to the y axis direction, and the up and down directions corresponding to the x axis direction. Next, in FIG. 3, the upper left end is the starting point of the xy axes, the top to bottom direction is the positive side of the x axis, and the left to right direction is the positive side of the y axis. In addition, the signal read direction in this second image sensor 200 is the x axis direction (read in blocks of rows). In addition, the signal reading direction in this second image sensor 200 is an example of the specific direction described in the claims.

For ease of description, FIG. 3 will be described using a region (region 210) consisting of a portion of light receiving elements (light receiving elements of sixteen rows and sixteen columns) of each pixel forming a second image sensor 200. In addition, in accordance with the arrangement of the light receiving elements in the second image sensor 200, the pixel arrangement (pixel arrangement corresponding to region 210) corresponding to this block is repeated in the x direction and y direction using the pixel arrangement indicated in region 210 as one block .

3, one light receiving element is shown in one circle. Further, light-receiving elements of the image generation pixel are indicated by circles marked with symbols (R (red), G (green), and B (blue)), and these symbols represent color filters provided in the light receiving elements. Moreover, light-receiving pixel elements for determining the phase difference are indicated by circles containing areas with filled sides (gray halves of circles) that coincide with the side on which the light blocking unit blocks incident light. In addition, with regard to the light receiving pixel elements of the phase difference determination, the light receiving elements corresponding to the exit pupils of the four positions (positions d1 to d4) are together denoted by reference numbers (D1 to D4). Further, the letters (a - d) of the reference positions of the light-receiving elements of the phase difference determination pixel indicate the side on which the light blocking unit blocks incident light (a is the negative side of the x axis, b is the positive side of the x axis, c is the positive side of the axis y, and d is the negative side of the y axis). For example, D1a is a light-receiving element that blocks the right half of the light, divided by the pupil into the left and right parts (positive and negative sides of the x axis), which makes the exit pupil at position d1, and which takes the left half of the pupil-separated light. In addition, a pixel for determining the phase difference will be described with reference to FIGS.

Next, the arrangement of pixels in the second image sensor 200 will be described.

In the second image sensor 200, rows (lines) in which light-receiving elements of the image generation pixels are located, and rows (lines) in which light-receiving elements of the phase difference pixels are located, are arranged alternately with each other. That is, as shown in FIG. 3, the image generation pixel, the phase difference determination pixel, the image generation pixel, the phase difference determination pixel and ... are arranged alternately with each other in the y-axis direction. In addition, the lines in which the light-receiving elements of the image generating pixels are located are an example of the second group of images, as described in the claims. Next, the lines in which the light-receiving pixel elements of the phase difference processing are located are an example of the first group of pixels referred to in the claims.

Moreover, the light receiving elements of the image generating pixels are arranged such that two light receiving elements in which color filters of the same color are located are inextricably aligned in the x-axis direction (in FIG. 3, RR, GG and BB are inextricable in the x-axis direction). Furthermore, although these two inextricably light receiving elements form one image generating pixel in the first embodiment of the present invention, this will be described with reference to FIG. 6.

The light receiving elements of the phase difference determination pixels are arranged so that two light receiving elements in which light is blocked on the same side are inextricably aligned in the x-axis direction (in FIG. 3, for example, D1aDa1 and D1bD1b are inseparable in the x-axis direction). In addition, although these two inextricable light receiving elements form one phase difference determination pixel in the first embodiment of the present invention, this will be described with reference to FIG. 6.

Further, the light receiving elements of the phase difference determination pixels are arranged so that rows are alternating with each other, in which only the light receiving elements are arranged so that the positions of the light blocking side and the light transmitting side for light from the object are located in the x axis direction ( reading direction), and lines in which only light-receiving elements are present, arranged in such a way that the positions of the light-blocking side and the light-transmitting side for light from the object are located in The direction of axis y. That is, with regard to the light receiving pixel elements of determining the phase difference, the pixels for determining the phase difference, which are separated by the pupil in the same direction (the reading direction or the direction perpendicular to the reading direction), are located in lower case blocks. In FIG. 3, horizontal D1 line 321, horizontal D2 line 323, horizontal D3 line 325 and horizontal D4 line 327 are indicated as lines in which light-receiving elements are located only in the x-axis direction. 3, a vertical line 322, a vertical line 324, a vertical line 326, and a vertical line 328 are indicated as lines in which light-receiving elements are located only in the y-axis direction.

In rows in which light-receiving elements are located only in the x-axis direction, light-receiving elements are located containing exit pupils placed in the same position. That is, only D1a and D1b are located in horizontal D1 row 321, only D2a and D2b are located in horizontal D2 row 323, only D3a and D3b are located in horizontal D3 row 325 and only D4a and D4b are located in horizontal D4 row 327. Moreover, in the rows in which only light-receiving elements are located in the x-axis direction, the phase difference detection pixels alternate with each other the light-receiving elements a (which are located in the x-axis direction and on the negative side of which the light is blocked) and the pixels of the difference Φ of a light receiving elements b (which are arranged in the direction of x axis and on the positive side of which the light is blocked). For example, in horizontal D1 line 321 in FIG. 3, two light receiving elements D1bD1b are located next to two light receiving elements D1aD1a (two light receiving elements form one phase difference determination pixel, and therefore, the phase difference determination pixel D1a is located next to the determination pixel D1b phase difference). That is, the light receiving elements (light receiving elements a and b of types) that are separated by the pupil in the read direction (x-axis direction in FIG. 3) of the second image sensor 200 are arranged so as to be able to determine the phase difference only based on the difference detection pixel signal phases located on one line. Thus, when the reading direction (x-axis direction) is separated by the pupil, it is possible to determine the phase difference only from the data of the phase difference determination pixels located on the same line from the rows of the plurality of phase difference determination pixels.

In the rows in which only light-receiving elements are located in the y-axis direction, four pairs (pairs D1 and D2) relative to the four positions of the exit pupil are arranged in series with respect to pairs of two light-receiving elements (D1cD1c and D1dD1d) that receive light on the opposite side relative to the position similar exit pupil. Further, in rows in which only light-receiving elements are located in the y-axis direction, light-receiving elements are identical in the y-axis direction relative to rows in which only light-receiving elements are located in the y-axis direction. That is, the vertical D1 column 311 in FIG. 3 indicates a column in which the light receiving elements located in this column in the vertical determination row are D1c and D1d. Similarly, D2 column 312 is a column in which light receiving elements are D2c and D2d, D3 column 313 is a column in which light receiving elements are D3c and D3d, and D4 column 314 is a column in which light receiving elements are D4c and D4d . That is, the pixels for determining the phase difference, which are separated by the pupil in the direction (y-axis direction in FIG. 3), which differs 90 degrees from the reading direction for the second image sensor 200, are arranged to determine the phase difference based on the phase difference determination pixel signals ( four columns of light receiving elements) arranged in two inextricable columns. Next, the lines of pixels for determining the phase difference, which are separated by the pupil in the direction of the y axis, and the lines of pixels for determining the phase difference, which are divided by the pupil in the direction of the x axis, are arranged alternately with each other in the lines of pixels of the image generation, so that the interval between the lines of pixels for determining the phase difference that need to be divided by the pupil in the y direction is narrow.

Thus, in the second image sensor 200, alternating with each other, there are rows in which the image generation pixels are located, and rows in which the phase difference detection pixels are located.

Next, we will concentrate on the pixels contained in the region 340 (4 × 4 light-receiving elements) and describe them with reference to Fig. 4 as pixels corresponding to the first embodiment of the present invention.

An example of the arrangement of pixels of the second image sensor

4 is a schematic top view illustrating an example of the arrangement of pixels in the region 340 of the second image sensor 200 in accordance with the first embodiment of the present invention and an example of the arrangement of pixels of a conventional image sensor. In addition, in the description of FIG. 4, the xy axes will be used, with the right and left directions corresponding to the y axis direction, and the up and down directions corresponding to the x axis direction. Further, the direction of reading the signal is the direction of the x axis (reading in lowercase blocks).

4 (a) shows the arrangement of three groups of pixels (groups 391-393 pixels), which schematically illustrates image generation pixels in a conventional image sensor, which contains image generation pixels and phase difference detection pixels, and shows the arrangement of phase difference determination pixels in a conventional image sensor.

The pixel group 391 is two rows and two columns of pixels showing the arrangement of image generation pixels in a conventional image sensor, which contains both image generation pixels and phase difference determination pixels. In the group of 391 pixels, a pixel (R pixel 291) that receives red light with a color filter that transmits red light is located at the top left, and pixels (G pixel 292) that receive green light with a color filter that transmits green light are located top right and bottom left. Next, in the group of 391 pixels, a pixel (V pixel 293), which receives blue light using a color filter that transmits blue light, is located at the bottom right. Thus, in the image generation pixels of a conventional image sensor, three colors (cyan, green, and red) are arranged according to the Bayer pattern. Moreover, in the image generation pixels of a conventional image sensor, pixels arranged in accordance with a pattern indicated by a group of 391 pixels form the majority of the image sensors.

A group of 392 pixels are pixels of one row and four columns that show the location of the pixels of the determination of the phase difference located in the x-axis direction in a conventional image sensor. In the group of 392 pixels in the x-axis direction, a phase difference determination pixel (phase difference determination pixel (D1a) 294) on the left side of which the light is blocked and a phase difference determination pixel (phase difference determination pixel (D1b) 295) alternate with each other, on the right side of which the light is blocked.

A group of 393 pixels are pixels of four rows and one column that show the location of the pixels of the determination of the phase difference located in the direction of the y axis in a conventional image sensor. In the group of 393 pixels in the y direction, the phase difference determination pixel (phase difference determination pixel (D1c) 296) alternating with light is blocked on the upper side and the phase difference determination pixel (phase difference determination pixel (D1d) 297), on the lower side of which the light is blocked.

Let us describe the positions of the pixels for determining the phase difference in a conventional image sensor. In a conventional image sensor, it is necessary to supplement the image information for the positions of the pixels for determining the phase difference, which cannot generate signals that can be used for the generated images, and therefore the number of pixels for determining the phase difference is as small as possible. That is, in a conventional image sensor, most of the pixels are pixels indicated in a group of 391 pixels, and only pixels in areas with phase differences are pixels for determining the phase difference provided in the patterns, as shown by a group of 392 pixels and a group of 393 pixels.

4 (b), as the pixel arrangement in the second image sensor 200, which corresponds to the first embodiment of the present invention, pixels corresponding to the area 340 of FIG. 3 are shown. 4 (b) shows a pixel (R pixel 220) that contains two light receiving elements that receive red (R) light, and a pixel (G pixel 230) that contains two light receiving elements that receive green (G ) light. Next, in FIG. 4 (b), a pixel (B pixel 240) is shown as the image generation pixel, which contains two light receiving elements that receive blue (B) light. Moreover, FIG. 4 (b) shows a pixel (phase difference determination pixel (D1a) 251) that contains two light receiving elements (D1a) on which the light is blocked on the left side and a pixel (difference determination pixel (D1b) 252) phase), which contains two light receiving element (D1b), on the right side of which the light is blocked. In addition, FIG. 4 (b) shows a pixel (phase difference determination pixel (D1c) 253) that contains two light receiving elements (D1c) on which the light is blocked on the upper side and a pixel (difference determination pixel (D1d) 254) phase), which contains two light receiving element (D1d), on the lower side of which the light is blocked.

Thus, both the image generation pixels and the phase difference detection pixels of the second image sensor 200 comprise two light receiving elements. In addition, from the point of view of only the image generating pixels, excluding the rows in which the light-receiving elements of the phase difference determination pixels are located, the R pixel 220 is located in the upper left, the G pixels 230 are located in the upper right and lower left, and the B pixel 240 is located in the lower right with a Bayer pattern, similar to FIG. 4 (a). In the second image sensor 200, the arrangement of all pixels is designated as region 210, and therefore, this arrangement of only image generation pixels, not including lines in which light-receiving elements of the phase difference detection pixels are present, is uniform alignment according to the Bayer pattern. Example image sensor structure

5 schematically shows an internal pixel structure of a second image sensor 200 in accordance with a first embodiment of the present invention and an internal pixel structure of a conventional image sensor.

5 (a) shows a schematic view of image generation pixels and phase difference determination pixels located in a conventional image sensor, in which both image generation pixels and phase difference determination pixels are provided. 5 (a) will be described for a region in which a row is located in which image generation pixels are present and a row in which phase difference determination pixels are present. 5 (a) shows R pixels 291, G pixels 292, phase difference determination pixels (D1a) 294, phase difference determination pixels (D1b) 295 and signal lines 461 to 468.

The R pixel 291 is a pixel containing a color filter that transmits red light, and contains a light receiving element 410, FD (floating diffusion region) 442 and an amplifier 443.

The light receiving element 410 converts (photoelectrically converts) the received light into an electrical signal to generate an electrical signal whose intensity corresponds to the amount of received light. This light receiving element 410 is formed, for example, from a photodiode (PD).

FD 442 determines the electric charge of the light receiving element. This FD 442 converts a specific electric charge into voltage and supplies voltage to an amplifier 443.

The amplifier 443 amplifies the voltage supplied from the FD 442. This amplifier 443 supplies the amplified voltage to the signal line 461.

In addition, the G pixel 292 is similar to the R pixel 291 except that instead of a color filter that transmits red light, a color filter is provided that transmits green light, and therefore, we will not describe the G pixel 292.

Further, the phase difference determination pixel (D1a) 294 and the phase difference determination pixel (D1b) 295 are similar to R pixel 291 except that there is no color filter and light blocks light for half of each light receiving element, which is done using a light blocking unit (e.g. , part of the wires).

The signal lines 461-468 read the signals generated by each pixel connected to these signal lines. In the second image sensor 200, pixel-generated data is read sequentially in the horizontal direction (column direction), which is the read direction, using these signal lines 461-468. In the case of, for example, pixel data in a row (a row in which R pixels 291 and G pixels 292 are alternately arranged) of the image generation pixels, a row of image generation pixels is set as a row for reading data from the pixels (set in the y-axis direction). Next, columns for reading data from pixels are set sequentially (set in the x-axis direction), and data from pixels is sequentially read. Provided that the data is read sequentially from the left, the data of the image generation pixel (R pixel 291) connected to the signal line 461, as shown in FIG. 5 (a), is first read. Next, the data of the image generation pixel (G pixels 292) connected to the signal line 462 is read, and then the data is read from the image generation pixels connected to the signal line 463, that is, the data is read sequentially.

Thus, a conventional image sensor is formed of pixels (image generation pixels and phase difference detection pixels), each of which comprises a light receiving element 410, FD 442, and an amplifier 443.

5 (b) schematically shows image generation pixels and phase difference detection pixels located in the second image sensor 200 in accordance with the first embodiment of the present invention. FIG. 5 (b) will be described in the case of eight and two light receiving elements (four and two pixels) in the upper row and the second from the top row of the region 210 shown in FIG. 3. 5 (b) shows R pixels 220, G pixels 230, phase difference determination pixels (D1a) 253, phase difference determination pixels (D1b) 254 and signal lines 462, 464, 466 and 468.

The R pixel 220 is a pixel containing two light receiving elements that contain color filters that transmit red light, and contains two light receiving elements 410, an amplifier 443, and an FD 452.

In addition, the light receiving elements 410 and amplifier 443 are similar to those shown in FIG. 5 (a) and therefore will not be described below.

FD 452 determines the electric charge of the light receiving elements, converts the electric charges determined by the two connected light receiving elements 410 into voltages and supplies voltage to the amplifier 443. So far, FD 442 shown in FIG. 5 (a) determines the electric charge determined by one receiving light element 410, this FD 452 determines the electric charges defined by the two light receiving elements 410.

In addition, the G pixel 230 is similar to the R pixel 220 except that instead of a color filter that transmits red light, a color filter is provided that transmits green light, and therefore, we will not describe the G pixel 292.

Further, the phase difference determination pixel (D1a) 253 and the phase difference determination pixel (D1b) 254 are similar to the R pixel 220 except that there is no color filter and the light blocking unit (for example, part of the wires) blocks the light for half of each light receiving element and, therefore, we will not describe it.

The signal lines 462, 464, 466 and 468 read the signals generated by each pixel connected to these signal lines. The number of signal lines shown in FIG. 5 (b) is equal to half the number of signal lines shown in FIG. 5 (a). In addition, the signal lines 462, 464, 466, and 468 are similar to the signal lines shown in FIG. 5 (a), except that the number of signal lines is smaller and each pixel connected is different, and therefore lower than the signal lines 462, 464 , 466 and 468 will not be described.

Thus, the second image sensor 200 according to the first embodiment of the present invention is formed of pixels (image generation pixels and phase difference detection pixels), each of which comprises light receiving elements 410, FD 442, and an amplifier 443.

An example of pupil separation performed by four types of pixels for determining the phase difference

6 and 7 are schematic views showing pupil separation for four types of pixel difference detection phase difference (D1-D4) in accordance with the first embodiment of the present invention. In addition, although the second image sensor 200 is located above the film mirror 160, as shown in FIG. 2, for ease of description, the second image sensor 200 will be described with reference to FIGS. 6 and 7 as an image sensor parallel to the exit pupil.

FIG. 6 schematically shows the pupil separation for the phase difference determination pixel D1 and the phase difference determination pixel D2 in accordance with the first embodiment of the present invention.

FIG. 6 (a) schematically shows the relationship between the pupil separation carried out by the phase difference determination pixel (phase difference determination pixel D1) corresponding to the exit pupil at the d1 position and the exit pupils at the d1-d4 positions. 6 (a) shows four exit pupils (exit pupils E1-E4) located at different distances from the second image sensor 200, and the second image sensor 200. Further, in the exit pupils E1-E4, the central points (centers C1-C4) are indicated, showing the centers of the corresponding exit pupils.

Moreover, four positions (F1-F4) are indicated in the second image sensor 200, which are pixel positions of determining the phase difference in the second image sensor 200. Position F1 and position F4 are located at the same distance (image height) from the center of the second image sensor 200 and indicate positions from the center that are opposite to each other. Further, the position F2 and the position F3 also have the same image height and indicate positions from the center that are opposite to each other. In addition to this, the up and down directions of the second image sensor 200 shown in FIG. 6 (a) are the up and down directions (y axis direction) of the area 210 of the second image sensor 200 shown in FIG. 3.

Next, FIG. 6 (a) shows pupil dividing lines L21-L24 as axes illustrating the boundaries between regions separated by a phase difference determination pixel D1 at positions F1-F4. In addition, FIG. 6 (a) will be described in the case where the phase difference determination pixels D1 at positions F1-F4 are phase difference determination pixels (D1c) 253, receiving light on the upper side (upward direction in FIG. 6 (a)) which is closed by a light blocking unit.

Next, we describe the pupil separation by the pixel (D1c) 253 of the determination of the phase difference at position F1.

In the pixel (D1c) 253 determining the phase difference, a light blocking unit is formed, adapted to divide the exit pupil E1 into two parts. Thus, the phase difference determination pixel (D1c) 253 at the position F1 receives light from an object on the upper side of this pupil dividing line L21 based on the boundary of the pupil dividing line L21. In addition, as a method of arranging the light blocking unit corresponding to the position of this exit pupil E1, for example, a method (see, for example, published Japanese Patent Application No. 2009-204987) for changing the arrangement of the light blocking unit between pixels can be used.

The pixel (D1c) 253 for determining the phase difference at the F1 position performs pupil separation for the exit pupil E1 to divide the exit pupil E1 by forming a light blocking unit to match the position of the exit pupil E1. However, the pupil dividing line L21 is at an angle to the optical axis (dotted line L29 in FIG. 6) and therefore it is not possible to divide the pupil for the exit pupils in other positions in order to divide the exit pupil into two parts. For example, for exit pupil E2, the pixel (D1c) 253 for determining the phase difference at position F1 receives light from an object passing through an area that is three quarters away from the top of exit pupil E2. Further, for the exit pupil E3, light from the object is received, a passing region that is 90% separated from the top of the exit pupil E3. Moreover, for the exit pupil E4 receive all the light from the object, passing the exit pupil E4.

Thus, the pixel (D1c) 253 determining the phase difference at position F1 can divide the exit pupil E1 at position d1 into two parts and can accurately determine the phase difference for the exit pupil E1. However, the light from the object is not divided into two parts for the exit pupils E2-E4 and the accuracy of determining the phase difference is deteriorating.

In addition, although similarly to the position F1 in the pixels (D1c) 253 for determining the phase difference at position F2 and position F4, the light blocking blocks are formed to correspond to the position of the exit pupil E1 and the phase difference can be precisely determined for the exit pupil E1, the accuracy is degraded for the exit pupils E2 -E4.

Thus, although the phase difference determination pixel (D1c) 253 accurately determines the phase difference for the exit pupil E1, the accuracy for the exit pupils E2-E4 deteriorates.

FIG. 6 (b) schematically shows the relationship between the pupil separation carried out by the phase difference determination pixel (phase difference determination pixel D2) corresponding to the exit pupil at the d2 position and the exit pupils at the d1-d4 positions. Similarly to FIG. 6 (a), FIG. 6 (b) shows exit pupils (exit pupils E1-E4) and a second image sensor 200.

Instead of the exit pupil lines L21-L24 shown in FIG. 6 (a), FIG. 6 (b) shows the exit pupil lines L31 - L34 in the form of axes indicating the boundaries between the areas in which the phase difference determination pixels D2 are divided at positions F1-F4.

A light blocking block is formed in the pixel D2 for determining the phase difference, adapted to divide the exit pupil E2 into two parts. That is, although, as shown in FIG. 6 (b), the phase difference determination pixel D2 can accurately determine the phase difference for the exit pupil E2, the accuracy for the exit pupils E1, E3 and E4 is deteriorated.

7 schematically shows the pupil separation for the phase difference determination pixel D3 and the phase difference determination pixel D4 in accordance with a first embodiment of the present invention.

FIG. 7 (a) schematically shows the relationship between the pupil separation carried out by the phase difference determination pixel (phase difference determination pixel D3) corresponding to the exit pupil at the d3 position and the exit pupils at the d1-d4 positions. Similarly to FIG. 6 (a), FIG. 7 (a) shows exit pupils (exit pupils E1-E4) and a second image sensor 200.

Instead of the exit pupil lines L21-L24 shown in FIG. 6 (a), FIG. 7 (a) shows the exit pupil lines L41-L44 in the form of axes indicating the boundaries between the areas in which the phase difference determination pixels D3 are divided at positions F1-F4.

A light blocking unit is formed in the pixel D3 for determining the phase difference, adapted to divide the exit pupil E3 into two parts. That is, although, as shown in FIG. 7 (a), the phase difference determination pixel D3 can accurately determine the phase difference for the exit pupil E3, the accuracy for the exit pupils E1, E2 and E4 is deteriorated.

Fig. 7 (a) schematically shows the relationship between the pupil separation carried out by the phase difference determination pixel (phase difference determination pixel D4) corresponding to the exit pupil at the d4 position and the exit pupils at the d1-d4 positions. Similarly to FIG. 6 (a), FIG. 7 (b) shows exit pupils (exit pupils E1-E4) and a second image sensor 200.

Instead of the exit pupil lines L21-L24 shown in FIG. 6 (a), FIG. 7 (b) shows the exit pupil lines L51-L54 in the form of axes indicating the boundaries between the areas in which the phase difference determining pixels D4 are divided at positions F1-F4.

A light blocking block is formed in the pixel D4 for determining the phase difference, adapted to divide the exit pupil E4 into two parts. That is, although, as shown in FIG. 7 (b), the phase difference determination pixel D4 can accurately determine the phase difference for the exit pupil E4, the accuracy for the exit pupils E1-E3 is deteriorated.

Thus, in the phase difference determination pixels D1-D4, light blocking units are formed to correspond to exit pupils at various positions. Thus, by arranging the phase difference pixels corresponding to the exit pupils in the second image sensor 200 at different positions when the image forming apparatus 100 is a single lens reflex camera in which the lens unit can be replaced, it is also possible to maintain a lens change in which the exit pupils located in other positions.

In addition, although phase difference detection pixels D1-D4 are provided corresponding to the positions of the four exit pupils, the phase difference determination pixels are not limited to this option. As long as the lines of pixels for determining the phase difference and the lines of pixels for generating the image are located (alternating with each other) (the ratio of the pixels for determining the difference of phases located next to the pixels for generating the image is fixed), the number may differ from four. When, for example, a second image sensor 200 is located in a camera with an integrated lens, only one phase difference detection pixel may be provided for the position of one exit pupil.

An example of a pixel adjacent to an image generating pixel

FIG. 8 schematically shows pixels adjacent to the image generation pixels of the second image sensor 200 in accordance with the first embodiment of the present invention and pixels adjacent to the image generation pixels of a conventional image sensor. In addition, with reference to Fig. 8, an example of the influence of a (light receiving element) pixel of the phase difference determination adjacent to (with the light receiving element) with the image generating pixel under the condition of the penetration of light of a small wavelength will be described. That is, it is assumed that the amount of light penetration with a small wavelength changes and, therefore, the wavelength property of the light received by the light receiving pixel of the image generating pixel changes slightly.

Fig. 8 (a) shows an area (six rows and ten columns) in which image generation pixels and phase difference determination pixels of a conventional image sensor are arranged, in which both image generation pixels and phase difference determination pixels are provided. Fig. 8 (a) shows a region in which eight pixels of phase difference determination are located in one row, this row being third from the top and all other pixels are image generating pixels.

As shown in FIG. 8 (a), in a conventional image sensor, in which both image generation pixels and phase difference detection pixels are provided, phase difference detection pixels are partially located. Therefore, only the image generation pixels surrounding the partially located phase difference determination pixels are image generation pixels located adjacent to the phase difference determination pixels.

Here, with reference to FIG. 8 (b), we describe three G pixels (G pixels 511-513) that are located adjacent to the various pixels and which are located in the region shown in FIG. 8 (a).

On Fig (b) indicated G pixels 511-513 shown in Fig.8 (a), together with arrows illustrating the penetration of light from the pixels for determining the phase difference.

A G pixel 511 is a G pixel, all eight neighboring pixels of which are image generating pixels. The adjacent pixels of this G pixel 511 do not contain a phase difference determination pixel and, therefore, the properties of this G pixel 511 coincide with the pixel properties of the image sensor, which do not contain phase difference determination pixels.

A G pixel 512 is a G pixel, seven of its eight neighboring pixels are image generating pixels and one neighboring pixel is a phase difference determination pixel. This G pixel 512 is located next to one phase difference detection pixel and, therefore, this phase difference determination pixel affects the G pixel 512. When, for example, the phase difference determination pixel does not contain a color filter, the light of a short wavelength penetrates the G pixel 512 of neighboring pixel determine the phase difference. This leads to the fact that the wavelength property of the light received by the light receiving element G of the pixel 512 is slightly different from the wavelength property of the G pixel 511.

A G pixel 513 is a G pixel, five of its eight neighboring pixels are image generation pixels and three neighboring pixels are phase difference determination pixels. This G pixel 513 is located next to the three phase difference determination pixels and, therefore, these three phase difference determination pixels affect the G pixel 513. That is, the amount of light penetration increases compared to the G pixel 512. Therefore, the wavelength of the light received by the light receiving element G of the pixel 513 is different from the wavelength property G of the pixel 511 and the wavelength property G of the pixel 512.

Thus, in a conventional image sensor, in which both image generation pixels and phase difference determination pixels are provided, there are image generation pixels that are located next to the phase difference determination pixels and image generation pixels that are not located next to the difference determination pixels phases. Therefore, a problem arises in that the wavelength property of the light received by the light receiving pixel elements of the image generating image changes.

Fig. 8 (c) shows the region in which the row contains G pixels and B pixels as the image generation pixels in the second image sensor 200 in accordance with the first embodiment of the present invention, and the rows in which the phase difference detection pixels are located in vertically next to the row. Fig. 8 (c) will describe in the case of light-receiving elements of three rows and eight columns (three × four pixels) in the second row and fourth row from above the area 210 in FIG. 3.

As shown in FIG. 8 (c), in the second row image sensor 200 (upper and lower rows), the rows of the image generating pixels are rows in which the phase difference detection pixels are arranged. Therefore, all image generation pixels are image generation pixels located adjacent to the phase difference determination pixels.

In this case, the adjacent phase difference determination pixel will be described with reference to FIG. 8 (d) by focusing on the light receiving element (light receiving element 521) in the G pixel 230.

In FIG. 8 (d), the light receiving element 521 shown in FIG. 8 (c) is illustrated with arrows indicating light penetration from the phase difference detection pixels.

As for the light receiving element 521, two of the eight adjacent light receiving elements adjacent are light receiving elements, and six are light receiving pixels of the phase difference determination. This light receiving element 521 is located next to six phase receiving light elements of the phase difference determination and, therefore, it is affected by six light receiving pixel elements of the phase difference determination. In addition, in the second image sensor 200, the lines of pixels for determining the phase difference and the lines of pixels for generating the image are arranged alternately with each other, and therefore, all the pixels for generating the image except for the ends of the lines are located next to six light-receiving pixel elements for determining the phase difference (the ratio of the determination pixels the phase difference and pixel generation of the image is fixed).

As shown in FIG. 8 (d) in the second image sensor 200, the light receiving elements of all image generating pixels at the ends of the second image sensor 200 are affected by six light receiving pixel elements of the phase difference determination and therefore the wavelength property of the light received by the light receiving elements pixel-generating image becomes uniform. That is, the pixels at the ends of the second image sensor 200 are not used (excluded from the effective pixels), so that it is not necessary to adjust the wavelength property of the light received by the light receiving elements.

Thus, the ratio of the light receiving pixel elements of the determination of the phase difference and the light receiving pixel elements of the image generation is made uniform for the light receiving elements adjacent to the light receiving pixel elements of the image generation in the effective pixel region, so that it is possible to uniformize the property of the light receiving pixel elements of the generating Images. In addition, although the case of the first embodiment of the present invention is described when the image generating pixel contains two light receiving elements, the image generating pixel is not limited to this example and it is possible to obtain the same effect even when the image generating pixel contains one light receiving element. That is, the ratio of the pixels for determining the phase difference and the image generation pixels is fixed for each pixel located next to the image generation pixels in the effective pixel region (pixels that receive light from the object and generate the image), so that it is possible to uniformize the property of the light-receiving pixel elements image generation.

An example image generated by a second image sensor

Fig. 9 schematically shows a received image generated based on a signal of a second image sensor 200 in accordance with a first embodiment of the present invention and a received image generated based on a signal of a conventional image sensor. In addition, in FIG. 9, the obtained image that is generated is an image containing the maximum number of pixels that can be generated by each image sensor.

Fig. 9 (a) shows a received image (received image 550), which is generated based on signals supplied from a conventional image sensor (image sensor 540), which contains image generation pixels and phase difference detection pixels, and an image sensor 540 is shown.

In the image sensor 540, the phase difference detection pixels are partially arranged in four lines and the places where these phase difference detection pixels are located are schematically illustrated by dashed lines (position 541 of the phase difference determination pixels). Further, the value (the number of light receiving elements (pixels)) in the horizontal direction (read direction) of the image sensor 540 is W1 the value (the number of light receiving elements (pixels)) in the vertical direction (direction perpendicular to the reading direction) is H1.

In the resulting image 550, the locations of the image data containing the positions of the pixels for determining the phase difference are schematically indicated by dashed lines (positions 551 pixels of additional data). Further, the magnitude (number of light receiving elements) in the horizontal direction (read direction) of the obtained image 550 is W2 and the magnitude (number of light receiving elements) in the vertical direction is H2.

Next, generation of the acquired image 550 by the image sensor 540 will be described.

In the image sensor 540, part of the pixels are phase difference determination pixels and, when generating the obtained image, image data at the position of the phase difference determination image is predicted from the data of the surrounding image generation pixels and supplemented. Further, the image sensor 540 contains one light receiving element in one image generating pixel, so that the maximum number of pixels of the obtained image generated based on a signal from the signal of the image sensor 540 is equal to the number of light receiving elements in the image sensor 540.

That is, as shown in FIG. 9 (a), the obtained image 550 generated from the signal of a conventional image sensor is an image containing a position (position 551 pixels of additional data) in which position data (position 541 of the pixel for determining the phase difference in the sensor is supplemented) 540 images) of a pixel for determining the phase difference. Further, in the resulting image 550, the number (W2) of pixels in the horizontal direction coincides with the number (W1) of light-receiving elements (pixels) in the horizontal direction of the image sensor 540 and the number (H2) of pixels in the vertical direction also coincides with the number (H1) of light-receiving elements (pixels) in the vertical direction of the image sensor 540. When, for example, the number of effective light receiving elements (the number of light receiving elements used to generate the obtained image) of the image sensor 540 is 4592 columns and 3056 rows, then the resulting image 550 is generated containing the number of pixels equal to 4592 columns x3056 rows.

FIG. 9 (b) shows a second image sensor 200 according to a first embodiment of the present invention and a received image (obtained image 560) generated from a signal supplied from this second image sensor 200.

In the second image sensor 200, the lines of the pixels for determining the phase difference and the lines of the captured images are arranged alternately with each other and the lines of these pixels for determining the phase difference are schematically shown by several dashed lines. Further, the magnitude (number of light receiving elements) in the horizontal direction (read direction) of the second image sensor 200 is W11 and the magnitude (number of light receiving elements) in the vertical direction is H11. Further, in the obtained image 560, the magnitude (number of pixels) in the horizontal direction (read direction) of the obtained image 560 is W12 and the magnitude (number of pixels) in the vertical direction is H12.

Next, generation of the acquired image 560 by the second image sensor 200 will be described.

In the second image sensor 200, the phase lines of the phase difference determination pixels and the lines of image generation pixels are arranged alternately with each other, and when generating the obtained image, this obtained image is generated using only the data of the image generation pixel lines. Further, half the pixels are pixels for determining the phase difference and, therefore, when generating the obtained image, the image data at the positions of the pixels of the determination of the phase difference do not supplement. Thus, the maximum number of pixels in the vertical direction of the received image generated from the signal of the second image sensor 200 is equal to half the number of light receiving elements in the vertical direction of the image sensor 540 (the number of pixels is also equal to half). Moreover, since the second image sensor 200 contains two light receiving elements in one image generation pixel, the maximum number of pixels in the horizontal direction of the received image generated from the signal of the second image sensor 200 is equal to half the number of light receiving elements in the horizontal direction of the image sensor 540 ( the number of pixels is equal).

That is, as shown in FIG. 9 (b), the obtained image 560 generated from the signal of the second image sensor 200 is an image that does not contain data obtained by supplementing the data at the pixel positions of the phase difference determination, and which is generated only by data generated by the image pickup element. Further, in the obtained image 560, the number (W12) of pixels in the horizontal direction is equal to half the number (W11) of light-receiving elements in the horizontal direction of the image sensor 200 and the number (H12) of pixels in the vertical direction is equal to half the number (H11) of light-receiving elements in the vertical direction of the sensor 200 images. When, for example, the number of effective light receiving elements of the second image sensor 200 is 4592 columns and 3056 rows, the resulting image 560 is generated containing the number of pixels equal to 2296 columns and 1528 rows.

Thus, in the second image sensor 200, even though the lines of the phase difference determination pixels and the lines of image generation pixels are arranged alternating with each other, the proportions of the generated image can be the same as in the image sensor in which only the image generating pixels are located. That is, the proportions of the image (real-time image) generated from the signal of the second image sensor 200 and the image (photographic image) generated from the signal of the first image sensor 140 can be made the same. Thus, it is possible to easily generate a real-time image for a photographic image from a signal from the second image sensor 200 (without performing specially corrected processing).

In addition, although a case has been described with the first embodiment of the present invention, where phase difference detection pixels are used, each of which contains two light receiving elements, and image generation pixels, each of which contains two light receiving elements, the present invention is in no way limited to this case. Even when image generation pixels are used, each of which contains one light receiving element, by generating an image using two pixels with the same color filters and by continuing a pair of pixels (pixel block of the generated image) in the reading direction, the proportions can be made the same.

An example of the read speed of the second image sensor

10 is a diagram illustrating an example of a data reading speed for a second image sensor 200 in accordance with a first embodiment of the present invention and an example of a data reading speed for a conventional image sensor. Next, FIG. 10 shows a data reading speed in the case where the image sensor generates a received image with a maximum number of pixels.

In addition, similarly to FIG. 9, for FIG. 10, it is assumed that each image sensor contains 4592 columns and 3056 rows of light receiving elements. That is, the second image sensor 200 according to the first embodiment of the present invention contains 2296 columns and 3056 lines of pixels, and a conventional image sensor contains 4592 columns and 3056 lines of pixels. Further, most of the pixels in a conventional image sensor are image generation pixels and the read time does not become shorter even when one to three lines are skipped, and for ease of description, we assume that the data is read from all the pixels for determining the phase difference.

10 (a) shows the time required to read data of all pixels located on one line (data read time associated with the read direction) in a diagram in which the horizontal axis is the axis showing the data read time. 10 (a) as data read times, a read time (time T1) of data for a conventional image sensor and a read time (time T2) for a second image sensor 200 according to the first embodiment of the present invention.

Next, we describe the difference between time T1 and time T2. A conventional image sensor contains one light receiving element in one image generation pixel, and this image sensor reads data from pixels 4,592 times for each row. That is, the time T1 refers to a time that is associated with 4592 times of reading data.

Meanwhile, the second image sensor 200 contains two light receiving elements in one image generation pixel, and this image sensor reads data from pixels 2296 times for each row. That is, the time T2 refers to the time that is associated with 2296 times of reading data.

As shown in FIG. 10 (a), the second image sensor 200 according to the first embodiment of the present invention contains two light receiving elements in one image generating pixel and has a faster readout speed for a row than a conventional image sensor.

10 (b) shows the time needed to read data of all pixels in a direction that is perpendicular to the read direction (data read time regarding the direction perpendicular to the read direction), in a diagram in which the horizontal axis is the axis showing the data read time. 10 (b) shows the time (time T3) for a conventional image sensor and the time (time T4) for a second image sensor 200, when using the phase difference detection pixels in one line, the phase difference is determined (when the pupil is separated in the reading direction ) Next, FIG. 10 (b) shows the time (time T5) of reading data for the second image sensor 200, when using the phase difference detection pixels in a plurality of rows, the phase difference is determined (when the pupil is separated in a direction that is perpendicular to the reading direction).

Next, we describe the difference between time T3, time T4 and time T5. Most of the pixels in a conventional image sensor are image generation pixels, and in rows in which phase difference detection pixels are provided, image generation pixels also exist, so there are very few lines from which pixel data cannot be read. That is, in a conventional image sensor, read lines are detected 3056 times (detected in the y-axis direction). That is, the time T3 refers to the time that is associated with 3056 times of reading data.

At the same time, in the second image sensor 200, the lines of pixels for generating the image and the lines of pixels for determining the phase difference are arranged alternately with each other and the number of times that the read lines needed to generate the obtained image are determined to be 1528 times (half of 3056 lines). When the pupil separation in the horizontal direction is carried out for lines of pixels for determining a phase difference, the pupil separation can be performed using pixel data for determining the phase difference in at least one line. Moreover, when the pupil is divided in the vertical direction, the pupil separation can be performed using pixel data arranged in columns of two pixels arranged in a pair of pixels among the pixels in rows for which the pupil has been divided in the vertical direction. The time T4 refers to the time that is associated with 1528 times +1 times reading data when the pupil is divided in the horizontal direction, and the time T5 refers to the time that is connected with 1528 times +764 times of reading data when the pupil is divided in the vertical direction.

As shown in FIG. 10 (b), in the second image sensor 200, which corresponds to the first embodiment of the present invention, rows in which only image generation pixels are located and rows in which only phase difference determination pixels are located are alternately arranged with each other Thus, in comparison with a conventional image sensor, the number of lines that are not readable increases. Thus, the read speed of data becomes higher compared to a conventional image sensor.

10 (c) shows the time required to read all pixel data when one acquired image is generated (read time regarding the entire image sensor), in a diagram in which the horizontal axis is the axis showing the data read time. 10 (c) as data read times, a read time (time T6) for a conventional image sensor and a read time (time T7) for a second image sensor 200 are used to determine the difference using phase difference detection pixels in one row phases. Next, FIG. 10 (c) shows a time (time T8) of reading data for the second image sensor 200 when the phase difference is determined using the phase difference determination pixels in 764 lines.

Next, we describe the difference between time T6, time T7 and time T8. In a conventional image sensor, 3056 rows are read that are read (determined in the y direction), and data is read from the pixels of each particular row 4592 times. That is, data is read from pixels 3056 × 4592 times. Time T6 refers to time relating to reading data 3056 × 4592 times.

In this case, when using the phase difference detection pixels in one line, the phase difference is determined, the second image sensor 200 sets lines that read 1528 + 1 times, and reads the data from the pixels of each set data 2296 times. That is, data is read from pixels (1528 + 1) × 2296 times. Time T7 refers to the time regarding data reading (1528 + 1) × 2296 times.

Further, when the phase difference is determined in the vertical direction, the lines to be read are set 1528 + 764 times, and the data is read from the pixels of each installed line 2296 times (for ease of description, the data is read from all the pixels in the pixel lines of the phase difference determination). That is, data is read from pixels (1528 + 764) × 2296 times. Time T8 refers to the time regarding data reading (1528 + 764) × 2296 times.

As shown in FIG. 10 (c), the second image sensor 200 according to the first embodiment of the present invention has a higher read speed for a row than a conventional image sensor.

Thus, for the first embodiment of the present invention, by obtaining the pixel ratio of determining the phase difference adjacent to the image generating pixels (light receiving elements), it is possible to uniformize the property of the image generating pixels. Thus, when generating the obtained image, it is possible to reduce the correction processing regarding the property of each pixel.

Further, for the first embodiment of the present invention, in the rows of the image generating pixels, the image generating pixels are arranged according to the Bayer pattern using, as one pair, two light receiving elements that contain filters of the same property. Due to this, it is possible to generate the obtained image using the same processing as the processing with the usual Bayer template, and when generating the obtained image, reduce the adjustment processing that relates to colors.

Further, for the first embodiment of the present invention, one pixel contains two light receiving elements in the image generation pixels and the phase difference determination pixels. Due to this, it is possible to reduce the time required for reading data from pixels in the reading direction. Further, the region of the light receiving plane in one pixel is expanded, so that it is possible to intensify the signal generated by one pixel. Moreover, it is possible to generate the obtained image having the same proportions as for the image sensor, in which only the image generating pixels are located.

2. Modified Example

A case has been described with the first embodiment of the present invention, in which, in the second image sensor 200, in line, alternating between each other, are arranged phase difference detection pixels that separate the pupil in the read direction, and phase difference detection pixels that should separate the pupil in direction perpendicular to the reading direction. In this case, the pixels for determining the phase difference and the pixels for generating the image can be arranged in a different way. For example, the lines of pixels for determining the phase difference and the lines of pixels for generating the image can be arranged alternating with each other so that the number of pixels for determining the phase difference located next to the pixels for generating the image is uniform (fixed ratio) for all image generating pixels. Thus, the pixel positions of the phase difference determination can include various patterns in addition to the pattern described in the first embodiment of the invention.

Therefore, as an example of various patterns, an example of an image sensor that is opposite to the second image sensor that corresponds to the first embodiment of the invention will be described below with reference to FIG. 11, wherein the positions of the phase difference detection pixels that form the pair differ. Next, with reference to FIGS. 12 and 13, an example of an image sensor in which phase difference detection pixels are the only pixels that perform pupil separation in the reading direction will be described. Moreover, with reference to FIG. 14, an example of an image sensor will be described in which, alternating with each other every two other lines, rows of pixels for determining a phase difference and rows of pixels for generating an image are arranged. Example of pixel arrangement of the second image sensor FIGS. 11 to 14 schematically show the arrangement of light receiving elements of the second image sensor according to a modified example of the first embodiment of the present invention. For simplicity of description, FIGS. 11-14 will be described using an area of a portion of light receiving elements (light receiving elements of sixteen rows and sixteen columns) of each pixel forming a second image sensor 200. In addition, after FIGS. 11-14, the description will focus on the difference from the area 210, which corresponds to the first embodiment of the present invention, and which is shown in FIG. 3.

11 shows an example of the arrangement of the light receiving elements of the second image sensor, in which the positions of the pair of pixels for determining the phase difference that form the pair are opposite to the positions of the same pixels of the first embodiment and correspond to a modified example of the first embodiment of the present invention.

11 shows a region 710, which is the region of the light receiving elements 16 rows and 16 columns of the second image sensor, in which the positions of the pixels for determining the phase difference forming a pair are opposite to those of the same pixels of the first embodiment of the invention, and which is the region corresponding to area 210 shown in Fig.3. 11, the horizontal D1 line 721, the horizontal D2 line 723, the horizontal D3 line 725, and the horizontal D4 line 727 are arranged as lines in which light-receiving elements are located, separated by the pupil in the reading direction. Next, the vertical determination line 722, the vertical determination line 724, the vertical determination line 726 and the vertical determination line 728 are shown as lines in which the light receiving elements are arranged to be separated by the pupil in the vertical direction. The positions of the light receiving elements that form the pairs in these rows are opposite to the positions in the rows in which the light receiving elements are separated by the pupil in the region 210 shown in FIG. 3. For example, when comparing horizontal D1 of line 721 and horizontal D1 of line 321 (see FIG. 3), the positions of the phase difference detection pixel D1a and the phase difference determination pixel D1b are opposite. In addition, similarly to the lines in which the light receiving elements shared by the pupil in the reading direction are located, the positions of the light receiving elements that form pairs are opposite even in the lines in which the light receiving elements separated by the pupil are located in the direction perpendicular to the reading direction.

Thus, even when the positions of the phase difference determination pixels that form the pairs are different from the positions for the first embodiment of the present invention, it is possible to fix the ratio for the phase difference determination pixels adjacent to the image generation pixels, similarly to the first embodiment of the present invention.

12 shows the arrangement of the light receiving elements of the second image sensor, in which only the phase difference detection pixels separated by the pupil in the read direction are located in the pixel line of the phase difference determination pixel in accordance with a modified example of the first embodiment of the present invention.

12 shows a region 730, which is a region of light receiving elements 16 rows and 16 columns of a second image sensor in which only phase difference detection pixels separated by the pupil in the read direction are located in rows of phase difference determination pixels, and which is an area corresponding to the region 210 shown in FIG. 12, horizontal lines D1 line 731, horizontal D2 line 732, horizontal D3 line 733, horizontal D4 line 735, horizontal D6 line 736, horizontal D7 line 737 are shown as lines in which light receiving elements are separated by the pupil in the reading direction and horizontal D8 line 738. Horizontal D5 line 735 - horizontal D8 line 738 are lines in which the positions of the matching exit pupils for the pixels for determining the phase difference differ from horizontal D1 line 731 - horizontal D4 with Rocky 735. Further, the pixel rows determining a phase difference in the pixels 730 are arranged for determining a phase difference, which form a pair.

Thus, by arranging the phase difference detection pixels only separated by the pupil in the read direction, so that the phase difference detection pixels that form the pairs are arranged, it is possible to maintain more exit pupil positions than the second image sensor 200, which corresponds to the first embodiment of the invention.

On Fig shows an example of the location of the second image sensor, which is different from Fig and in which only shared by the pupil in the read direction, the pixels for determining the phase difference are located in the pixel line of the determination of the phase difference in accordance with a modified example of the first embodiment of the present invention.

13 shows a region 740, which is a region of light receiving elements 16 rows and 16 columns of a second image sensor in which only phase difference detection pixels separated by the pupil in the reading direction are arranged in rows of phase difference determination pixels, and the pattern of the region 740 is different from the pattern region 730 shown in Fig. 12. 13, horizontal lines D1a line 741, horizontal D1b line 742, horizontal D2a line 743, horizontal D2b line 744, horizontal D3a line 745, horizontal D3b line are shown as lines in which light receiving elements are located, separated by the pupil in the reading direction 746, horizontal D4a row 747 and horizontal D4b row 748. Horizontal D1a row 741 is a row in which only phase difference detection pixels D1a are located, and horizontal D1b row 742 is a row in which only pi We sat D1b determine the phase difference. Similarly, horizontal D2a line 743-horizontal D4b line 748 are lines in which only phase difference pixels D2a - D4b are located.

Thus, by arranging the phase difference detection pixels only, which are separated by the pupil in the reading direction, so that the phase difference detection pixels that form the pairs are arranged in separate rows, it is possible to narrow the step between the phase difference detection pixels that receive light and which the pupil divides same direction, and improve the accuracy of determining the phase difference.

In addition, there are cases when only the phase difference detection pixels shared by the pupil in the read direction, as shown in FIGS. 12 and 13, are located in the rows of the phase difference determination pixels and, in addition, there are cases where only the pupil shared in the direction perpendicular to the direction readout, phase difference determination pixels are arranged in rows of phase difference determination pixels.

On Fig shows an example of the location of the light-receiving elements of the second image sensor, in which the row of pixels for determining the phase difference and the row of pixels for generating the image are located alternately every two lines.

FIG. 14 shows a region 750, which is a region of light receiving elements 16 rows and 16 columns of a second image sensor, in which rows of phase difference detection pixels and rows of image generation pixels are arranged alternately with each other each other two rows, and which is an area, the corresponding region 210 shown in Fig.3. On Fig shows that the two lines in which the pixels of the image generation are located, and the two lines in which the pixels are used to determine the phase difference are located alternating with each other. In the case of this arrangement, the light receiving elements of the image generation pixels are located next to the light receiving elements of the three phase difference determination pixels. That is, even when the lines of the image generation pixels and the lines of the phase difference determination pixels are arranged alternately with each other, as described in the first embodiment of the invention, it is possible to fix the ratio of the phase difference determination pixels located adjacent to the image generation pixels.

In addition, even when the lines of the image generation pixel are located every two other lines or the lines of the phase difference determination pixels are located every three other lines, it is possible to fix the ratio of the phase difference determination pixels located adjacent to the image generation pixels. In this case, by performing corrective processing so that the proportions coincide with the proportions of the photographic image when generating the resulting image, it is possible to generate a photographic image in real time.

As shown in FIGS. 11 to 14, in accordance with a location that is different from that in the first embodiment of the present invention, it is possible to fix the ratio of the phase difference determination pixels located adjacent to the image generation pixels.

In addition, although a first embodiment of the invention and a modified example of the present invention have been described in which each of the phase difference pixels and the image generation pixels contains two light receiving elements, the present invention is not limited to this case. When, for example, the data is transmitted to such an extent that the number of pixels does not need to be reduced by half, the pixels for determining the phase difference and pixels for generating an image that contain one light receiving element for each pixel, so that the ratio of the pixels for determining the phase difference located next to the image generation pixels. Further, by creating a light receiving element of a rectangular shape (having a size that corresponds to two light receiving elements corresponding to the first embodiment), when a second image is made, it is possible to form one pixel using one light receiving element.

In addition, although it is assumed that the second image sensor 200 is a CMOS sensor in the first embodiment and a modified example of the present invention, the present invention is in no way limited to this case and in some cases a CCD (charge coupled device) sensor can be used. Further, although it is intended to use the image generated from the signal of the second image sensor 200 as a real-time image, the present invention is in no way limited to this case and, for example, in some cases, films can be stored in the memory unit 181.

In addition, an embodiment of the present invention is a typical embodiment of the present invention and the entities corresponding to the embodiment of the present invention and the entities defining the inventions in the claims correspond to each other, which is clearly described in an embodiment of the present invention. Similarly, entities defining inventions in the claims, and entities corresponding to an embodiment of the present invention and denoted by the same names as entities defining inventions correspond to each other. However, the present invention is in no way limited to this embodiment and can be implemented by various kinds of modifications of this embodiment of the invention, which are within the scope of the present invention and do not deviate from the main idea of the present invention.

Further, the processing process described in the embodiment of the present invention can be considered a method including a set of these processes, a program, as a result of which the computer executes a set of these processes, or a storage medium on which this program is recorded. For this storage medium, CD discs (compact disc), MD discs (mini-discs), DVD (digital versatile disc) discs, memory cards, Blu-ray discs (registered trademark) can be used.

List of Reference Items

one hundred imaging device 110 lens unit 111 zoom lens 112 diaphragm 113 focus lens 120 operating reception unit 130 Control block 140 first image sensor 150 first signal processing unit 160 film mirror 170 second signal processing unit 181 memory block 182 display unit 183 focus adjustment decision block 184 drive unit 200 second image sensor

Claims (13)

1. The image acquisition element containing:
a plurality of phase difference determination pixels configured to generate signals for deciding on focus adjustment by determining a phase difference; and
a plurality of image generating pixels configured to generate signals for generating an image,
wherein the first group of pixels formed by arranging a portion of the pixels for determining the phase difference from the plurality of pixels for determining the phase difference in a specific direction, and the second group of pixels formed by arranging a portion of the pixels of generating the image from the plurality of pixels for generating the image in the specified direction, are arranged alternately in the direction perpendicular to the specified specific direction, while
the first group of pixels contains a first line formed by arranging in a certain direction of pixels for determining a phase difference to be separated by the pupil in a certain direction, and a second line formed by arranging in a specified direction of pixels of determining a phase difference to be divided by a pupil in a perpendicular direction,
the first line and the second line are alternately across the second group of pixels. 2. The image acquisition element according to claim 1, wherein each of the plurality of image generation pixels has a fixed ratio of phase difference pixels and image generation pixels for each adjacent pixel in the region of the image receiving element receiving light from the object. 3. The image acquisition element of claim 1, wherein
the first group of pixels comprises a plurality of phase difference determination pixels forming one or a plurality of lines, and
the second group of pixels contains a plurality of image generating pixels forming one or two lines. 4. The image acquisition element according to claim 1, wherein said specific direction is a reading direction when reading data generated by phase difference determination pixels and image generation pixels from phase difference pixels and image generation pixels. 5. The image acquisition element of claim 1, wherein
the first group of pixels contains many pixels for determining the phase difference forming one line,
a second group of pixels comprises a plurality of image generation pixels forming one line, and
two consecutive image generation pixels from a plurality of image generation pixels, containing color filters with the same properties and located in the specified direction, form a pair of image generation pixels, and each pixel is located using a pair of image generation pixels as pixel blocks. 6. The image pickup element according to claim 5, wherein the plurality of image generating pixels are arranged in accordance with the Bayer pattern in pixel blocks in the image pickup element. 7. The image acquisition element according to claim 1, in which two pixels for determining a phase difference from a plurality of pixels for determining a phase difference, performing pupil separation in one direction and receiving light divided in one direction of the specified one direction, are configured to form a pair of difference determination pixels phase in the form of two consecutive pixels for determining the phase difference located in a certain direction, with each pixel being located using the specified pair of pixels of determination phase difference as pixel blocks. 8. The image acquisition element according to claim 1, in which two consecutive light-receiving elements from light-receiving elements of a plurality of image generating pixels containing color filters with the same properties and located in a specific direction are configured to form a pair of light-receiving elements, each a pixel is positioned using two pixels belonging to the indicated pair of light receiving elements as pixel blocks. 9. The image acquisition element according to claim 1, in which two light-receiving elements from light-receiving elements of a plurality of phase difference determination pixels, performing pupil separation in one direction and receiving light divided in one direction of said one direction, form a pair of light-receiving elements, wherein each element is located using two pixels related to the specified pair of light receiving elements as a block of pixels. 10. The image acquisition element of claim 1, wherein
the phase difference determination pixel contains a plurality of phase difference determination pixels corresponding to a plurality of exit pupils located at different positions in the direction of the optical axis, wherein
the first line is formed by arranging the pixels for determining the phase difference from the plurality of pixels for determining the phase difference containing exit pupils located at the same positions. 11. The image acquisition element of claim 1, wherein
the plurality of phase difference determination pixels comprise a plurality of phase difference determination pixels corresponding to a plurality of exit pupils located at different positions in the direction of the optical axis, wherein
the second line is formed by arranging the pixels for determining the phase difference containing the exit pupils located at the same positions in a position matching the position in the specified direction. 12. An image acquisition element comprising:
a plurality of phase difference determination pixels configured to generate signals for deciding on focus adjustment by determining a phase difference; and
a plurality of image generating pixels configured to generate signals for generating an image,
wherein each of the plurality of image generation pixels has a fixed ratio of the phase difference pixels and the image generation pixels for each adjacent pixel in the region of the image receiving element receiving light from the object,
the first group of pixels contains a first line formed by arranging in a certain direction of pixels for determining a phase difference to be separated by the pupil in a certain direction, and a second line formed by arranging in a specified direction of pixels of determining a phase difference to be divided by a pupil in a perpendicular direction,
the first line and the second line are alternately across the second group of pixels. 13. An image forming apparatus comprising:
an image acquisition element comprising a plurality of phase difference determination pixels configured to generate signals for deciding to adjust focus by determining a phase difference, and a plurality of image generation pixels configured to generate signals for generating an image, wherein the first group of pixels formed by the location of the pixels for determining the phase difference from the set of pixels for determining the phase difference in a certain direction, and a second group of pixels formed by arranging the image generating pixels from the plurality of image generating pixels in the specified specific direction are arranged alternately in a direction perpendicular to the specified specific direction;
a focus adjustment decision block adapted to make a focus adjustment decision by determining a phase difference based on signals generated by the phase difference determination pixels; and
an image generating unit for generating an image based on signals generated by image generating pixels, wherein
the first group of pixels contains a first line formed by arranging in a certain direction of pixels for determining a phase difference to be separated by the pupil in a certain direction, and a second line formed by arranging in a specified direction of pixels of determining a phase difference to be divided by a pupil in a perpendicular direction,
the first line and the second line are alternately across the second group of pixels.

Images