JP6680310B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging device.

  An electronic device has been proposed that includes an image sensor (hereinafter, referred to as a stacked image sensor) in which a backside illuminated image sensor chip and a signal processing chip are stacked (see Patent Document 1). In the laminated image pickup device, the backside illuminated image pickup chip and the signal processing chip are laminated so as to be connected to each other through microbumps for each predetermined region.

JP 2006-49361 A

  However, in conventional image pickup devices, there are not many proposals for dividing an image into the above regions and acquiring a picked-up image for each region, and the usability of the image pickup device cannot be said to be sufficient.

An imaging device according to a first aspect of the present invention is an imaging device in which a plurality of regions having a plurality of photoelectric conversion units that convert light into electric charges are arranged in a row direction and a column direction, and a first of the plurality of regions. The first timing of starting the transfer of the charges converted by the first photoelectric conversion unit included in the area, and the second area of the plurality of areas that is adjacent to the first area on the row direction side have A period between a second timing at which transfer of charges converted by a second photoelectric conversion unit arranged next to the first photoelectric conversion unit on the row direction side is started, and a second timing is the second timing, It is shorter than the period between the third timing of the first region, which starts transfer of the charges converted by the third photoelectric conversion unit arranged on the row direction side, from the first photoelectric conversion unit, and the third timing. Control unit to control Provided.
  An imaging device according to a second aspect of the present invention is an imaging device in which a plurality of regions having a plurality of photoelectric conversion units for converting light into electric charges are arranged in a row direction and a column direction, and a first of the plurality of regions. The first timing of starting the transfer of the charges converted by the first photoelectric conversion unit included in the area, and the second area of the plurality of areas that is adjacent to the first area on the row direction side have A period between the first timing and the second timing at which transfer of the charges converted by the second photoelectric conversion section arranged next to the first photoelectric conversion section on the row direction side is started is the first timing, It is shorter than the period between the third timing of the first region, which starts transfer of the charges converted by the third photoelectric conversion unit arranged on the row direction side, from the first photoelectric conversion unit, and the third timing. Control unit to control Provided.

  ADVANTAGE OF THE INVENTION According to this invention, the distortion of the image in the boundary part which divides a unit area | region is suppressed, and a user-friendly image pick-up element can be implement | achieved.

It is sectional drawing of a laminated image sensor. It is a figure explaining the pixel array and unit area of an imaging chip. It is a figure explaining the circuit of a unit area. It is a block diagram showing the functional composition of an image sensor. It is a figure which illustrates the array of unit areas and the array of cells on the imaging surface of the imaging device. FIG. 6A is a diagram for explaining readout control for pixels included in four unit regions in a cell, and FIG. 6B shows a readout order of pixel signals read out by the readout control of FIG. 6A. It is a figure showing. It is a figure showing the read-out order of the pixel signal about four adjacent cells. It is a block diagram which illustrates the composition of the imaging device by one embodiment. It is a figure which illustrates the pixel column for focus detection. FIG. 10A is a diagram for explaining readout control for pixels included in four unit regions in a cell in the modified example 1, and FIG. 10B is a pixel signal read out by the readout control in FIG. 10A. It is a figure showing the reading order of. FIG. 9 is a diagram showing a pixel signal readout order according to a modification 1 with respect to four adjacent cells. FIG. 12A is a diagram for explaining readout control for pixels included in four unit regions in a cell in Modification 5, and FIG. 12B is a pixel signal read out by the readout control in FIG. 12A. It is a figure showing the reading order of.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.
<Explanation of stacked image sensor>
First, the laminated image sensor 100 mounted in the electronic device (for example, the image pickup apparatus 1) according to the embodiment of the present invention will be described. The multilayer image sensor 100 is described in Japanese Patent Application No. 2012-139026 previously filed by the applicant of the present application. FIG. 1 is a cross-sectional view of the stacked image sensor 100. The image pickup device 100 includes a backside illuminated image pickup chip 113 that outputs a pixel signal corresponding to incident light, a signal processing chip 111 that processes the pixel signal, and a memory chip 112 that stores the pixel signal. The image pickup chip 113, the signal processing chip 111, and the memory chip 112 are stacked, and are electrically connected to each other by conductive bumps 109 such as Cu.

  As shown in the figure, the incident light mainly enters in the Z-axis plus direction indicated by the outline arrow. In the present embodiment, the surface of the imaging chip 113 on which incident light is incident is referred to as a back surface. Further, as shown on the coordinate axes, the left side of the paper surface orthogonal to the Z axis is the X axis plus direction, and the front direction of the paper surface orthogonal to the Z axis and the X axis is the Y axis plus direction. In some of the subsequent figures, the coordinate axes are displayed so that the orientation of each figure can be understood with reference to the coordinate axes in FIG.

  An example of the imaging chip 113 is a backside illumination type MOS image sensor. The PD layer 106 is arranged on the back surface side of the wiring layer 108. The PD layer 106 has a plurality of PDs (photodiodes) 104 that are two-dimensionally arranged and accumulate charges according to incident light, and a transistor 105 provided corresponding to the PDs 104.

  The color filter 102 is provided on the incident side of the incident light in the PD layer 106 via the passivation film 103. The color filters 102 have a plurality of types that transmit different wavelength regions, and have a specific arrangement corresponding to each of the PDs 104. The arrangement of the color filters 102 will be described later. The group of the color filter 102, the PD 104, and the transistor 105 forms one pixel.

  A microlens 101 is provided on the incident side of the color filter 102 for incident light, corresponding to each pixel. The micro lens 101 collects incident light toward the corresponding PD 104.

  The wiring layer 108 has a wiring 107 for transmitting the pixel signal from the PD layer 106 to the signal processing chip 111. The wiring 107 may be a multilayer, and may be provided with a passive element and an active element.

  A plurality of bumps 109 are arranged on the surface of the wiring layer 108. The plurality of bumps 109 are aligned with the plurality of bumps 109 provided on the opposite surfaces of the signal processing chip 111, and the image pickup chip 113 and the signal processing chip 111 are aligned by being pressed. The bumps 109 are joined together and electrically connected.

  Similarly, a plurality of bumps 109 are arranged on surfaces of the signal processing chip 111 and the memory chip 112 that face each other. The bumps 109 are aligned with each other, and the signal processing chip 111 and the memory chip 112 are pressed and the like, so that the aligned bumps 109 are joined and electrically connected.

  Note that the bonding between the bumps 109 is not limited to Cu bump bonding by solid-phase diffusion, and micro-bump bonding by solder melting may be employed. Further, the bumps 109 may be provided, for example, about one in each unit area described later. Therefore, the size of the bump 109 may be larger than the pitch of the PD 104. In a peripheral region other than the pixel region where the pixels are arranged, a bump larger than the bump 109 corresponding to the pixel region may be additionally provided.

  The signal processing chip 111 has TSVs (through silicon vias) 110 that connect circuits provided on the front and back surfaces to each other. The TSV 110 is preferably provided in the peripheral area. The TSV 110 may also be provided in the peripheral area of the imaging chip 113 and the memory chip 112.

  FIG. 2 is a diagram for explaining the pixel array of the image pickup chip 113 and the unit area 131. In particular, this shows a state in which the imaging chip 113 is observed from the back side. In the pixel area, for example, 20 million or more pixels are arranged in a matrix. In the present embodiment, for example, 16 pixels of 4 pixels × 4 pixels adjacent to each other form one unit region 131. The grid lines in the figure show the concept that adjacent pixels are grouped to form a unit area 131. The number of pixels forming the unit region 131 is not limited to this, and may be about 1000, for example, 32 pixels × 64 pixels, or more or less.

  As shown in a partially enlarged view of the pixel area, the unit area 131 includes four so-called Bayer arrays composed of four pixels of green pixels Gb, Gr, blue pixels B, and red pixels R vertically and horizontally. The green pixel is a pixel having a green filter as the color filter 102 and receives light in the green wavelength band of incident light. Similarly, a blue pixel is a pixel having a blue filter as the color filter 102 and receives light in the blue wavelength band, and a red pixel is a pixel having a red filter as the color filter 102 and light in the red wavelength band. Receive light.

  In the present embodiment, a plurality of blocks are defined so that each block includes at least one unit area 131, and each block can control the pixels included in each block with different control parameters. That is, it is possible to acquire image pickup signals having different image pickup conditions between a pixel group included in a certain block and a pixel group included in another block. Examples of control parameters are a frame rate, a gain, a thinning rate, the number of addition rows or columns for adding pixel signals, the charge accumulation time or number, the number of digitized bits, and the like. Further, the control parameter may be a parameter in image processing after acquiring an image signal from a pixel.

  FIG. 3 is a diagram illustrating a circuit in a unit area. In FIG. 3, the unit area 131 is formed by 9 pixels of 3 pixels × 3 pixels adjacent to each other. The number of pixels included in the unit area 131 is not limited to this. The two-dimensional position of the unit area 131 is indicated by a pixel A or the like.

  The reset transistors of the pixels included in the unit region 131 are individually turned on and off for each pixel. In the example shown in FIG. 3, a reset wiring 300 for turning on / off the reset transistor of the pixel A is provided, and a reset wiring 310 for turning on / off the reset transistor of the pixel B is provided separately from the reset wiring 300. Similarly, a reset wiring 320 for turning on / off the reset transistor of the pixel C is provided separately from the reset wirings 300 and 310. Dedicated lines for turning on and off the respective reset transistors are also arranged from the other pixels D to I.

  The transfer transistors of the pixels included in the unit region 131 are also individually turned on / off for each pixel. In the example shown in FIG. 3, the transfer wiring 302 for turning on / off the transfer transistor of the pixel A, the transfer wiring 312 for turning on / off the transfer transistor of the pixel B, and the transfer wiring 322 for turning on / off the transfer transistor of the pixel C are separately provided. . Dedicated lines for selecting the respective transfer transistors are arranged from the other pixels D to I as well.

  The selection transistors of the pixels included in the unit region 131 are also individually turned on / off for each pixel. In the example shown in FIG. 3, a selection wiring 306 for turning on / off the selection transistor of the pixel A, a selection wiring 316 for turning on / off the selection transistor of the pixel B, and a selection wiring 326 for turning on / off the selection transistor of the pixel C are separately provided. . Dedicated lines for selecting the respective selection transistors are arranged from the other pixels D to I as well.

  The power supply wiring 304 is commonly connected to each of the pixels A to I included in the unit area 131. Similarly, the output wiring 308 is commonly connected to each of the pixels A to I included in the unit area 131. Further, the power supply wiring 304 is commonly connected among a plurality of unit areas, but the output wiring 308 is provided for each unit area.

  By individually turning on / off the reset transistor and the transfer transistor in the unit region 131, the charge accumulation start time, the charge end time, and the transfer timing are independently included for each pixel A to pixel I included in the unit region 131. The charge storage can be controlled. Further, by individually turning on / off the selection transistors of the unit region 131, the pixel signals of the pixels A from the pixels A can be output via the common output wiring 308.

  Here, there is a so-called rolling shutter system in which charge accumulation is controlled in a regular order with respect to rows and columns for each of the pixels A to I included in the unit region 131. In the rolling shutter system, pixels are selected for each row and then a column is designated, so that pixel signals are output in the order of “ABCDEFGHI” in the example of FIG.

  By thus configuring the circuit with the unit region 131 as a reference, the charge storage time can be controlled for each unit region 131. In other words, pixel signals with different frame rates can be output between the unit areas 131. Further speaking, while one unit area 131 is made to accumulate charge once, the other unit area 131 is made to accumulate charge many times to output a pixel signal each time. It is also possible to output each frame for a moving image at a different frame rate between the unit areas 131.

  FIG. 4 is a block diagram showing a functional configuration of the image sensor 100. The analog multiplexer 411 sequentially selects the nine PDs 104 forming the unit area 131 and outputs the pixel signals of the respective PDs to the output wiring 308 provided corresponding to the unit area 131. The multiplexer 411 is formed on the imaging chip 113 together with the PD 104.

  The pixel signal output through the multiplexer 411 is processed by the signal processing circuit 412 formed in the signal processing chip 111, which performs correlated double sampling (CDS) / analog / digital (A / D) conversion, and then performs CDS and A / D conversion. D conversion is performed. The A / D-converted pixel signal is delivered to a demultiplexer 413 and stored in a pixel memory 414 corresponding to each pixel. The demultiplexer 413 and the pixel memory 414 are formed on the memory chip 112.

  The arithmetic circuit 415 processes the pixel signal stored in the pixel memory 414 and delivers it to the subsequent image processing unit. The arithmetic circuit 415 may be provided in the signal processing chip 111 or may be provided in the memory chip 112. Although FIG. 4 shows connections for one unit area 131, in reality, these exist for each unit area 131 and operate in parallel. However, the arithmetic circuit 415 does not have to exist for each unit area 131, and, for example, one arithmetic circuit 415 may perform sequential processing by sequentially referring to the values of the pixel memory 414 corresponding to each unit area 131. Good.

  As described above, the output wiring 308 is provided corresponding to each of the unit areas 131. Since the image pickup device 100 has the image pickup chip 113, the signal processing chip 111, and the memory chip 112 stacked, by using the electrical connection between the chips using the bumps 109 for the output wiring 308, each chip is arranged in the plane direction. The wiring can be routed without increasing the size.

  Pixel-sequential read control for the unit area 131 is performed in cooperation with independent control for each of the four adjacent unit areas 131. Here, for convenience, four adjacent unit areas 131 are named as a cell C. FIG. 5 is a diagram exemplifying an array of unit areas 131 and an array of cells C on the image pickup surface of the image pickup device 100 (image pickup chip 113).

  FIG. 6 is an enlarged view of one cell C in FIG. 5, and FIG. 6A is a diagram illustrating read control for pixels included in the four unit regions 131a to 131d in the cell C. In FIG. 6A, four adjacent unit areas 131a to 131d each include 16 pixels. In the present embodiment, among the unit areas 131a to 131d, the pixel at the position closest to the intersection P of the vertical and horizontal boundary lines that partition the four unit areas 131a to 131d is the read start pixel (hatched in FIG. 6A). Shown). Then, pixel signals are sequentially read in a pixel in the direction away from the point P in the horizontal direction and in the direction away from the point P in the vertical direction, and the pixel farthest from the point P in each of the unit regions 131a to 131d is read. Pixels.

  Specifically, in the case of the unit region 131a, reading is performed in such a manner that the reading is started in the horizontal left direction from the reading start pixel located in the lower right, while scanning is performed in the vertical upward direction, and the reading end pixel located in the upper left is sequentially read pixel by pixel. Controlled. As a result, pixel signals of 16 pixels forming the unit area 131a are sequentially read.

  In the case of the unit region 131b, the reading is controlled so that the reading is started in the horizontal left direction from the reading start pixel located in the upper right, the scanning is performed vertically downward, and the pixels are sequentially read to the reading end pixel located in the lower left. As a result, the pixel signals of 16 pixels forming the unit area 131b are sequentially read.

  In the case of the unit area 131c, the readout control is performed so that the readout is started in the horizontal right direction from the readout start pixel located in the lower left, the scanning is performed in the vertical upward direction, and the pixels are sequentially read to the readout end pixel located in the upper right. Thereby, the pixel signals of 16 pixels forming the unit area 131c are sequentially read.

  In the case of the unit area 131d, the reading is controlled so that the reading is started in the horizontal right direction from the reading start pixel located in the upper left, the scanning is performed in the vertical downward direction, and the pixels are sequentially read to the reading end pixel located in the lower right. Thereby, the pixel signals of 16 pixels forming the unit area 131d are sequentially read.

  In the cell C, when the read control in each of the four unit areas 131a to 131d is performed in parallel at the same timing, the pixel signals of 64 pixels (4 × 16 pixels) included in the cell C are divided into 16 times and sequentially. Read out.

  FIG. 6B is a diagram showing the reading order of the pixel signals read by the reading control illustrated in FIG. 6A. Number 1 corresponds to the read start pixel, and number 16 corresponds to the read end pixel. Since the four unit regions 131a to 131d are performed in parallel at the same timing, the pixel signals are read out from the four pixels indicated by the same number in the cell C at the same timing. According to FIG. 6B, pixel signals are read out at the same timing from pixels vertically adjacent to each other with a horizontal boundary line separating the four unit regions 131a to 131d interposed therebetween. In addition, pixel signals are read out at the same timing from pixels that are adjacent to each other on the left and right with a vertical boundary line that divides the four unit regions 131a to 131d in between.

  When the above-described read control for independently performing the control independently for each of the four unit areas adjacent to each other is performed in parallel for all the cells C illustrated in FIG. 5 at the same timing, all the read operations included in the imaging chip 113 are performed. Pixel signals of pixels are sequentially read in 16 times.

  FIG. 7 is a diagram showing the reading order of the pixel signals read by the above-described read control for four adjacent cells C. Number 1 corresponds to the read start pixel, and number 16 corresponds to the read end pixel. Since the four cells C are performed in parallel at the same timing, the pixel signals are read out at the same timing from the 16 pixels indicated by the same numbers in FIG.

  According to FIG. 7, pixel signals are read out at the same timing from pixels vertically adjacent to each other across a horizontal boundary line that partitions four adjacent cells C. Further, pixel signals are also read out at the same timing from pixels that are adjacent to each other on the left and right with a vertical boundary line that partitions four adjacent cells C in between.

  As described above, according to the present embodiment, the pixel signals acquired at the same timing are obtained from pixels that are vertically and horizontally adjacent to each other with the boundary line that partitions the four unit regions 131a to 131d forming the cell C interposed therebetween. be able to. Furthermore, it is possible to obtain pixel signals acquired at the same timing from pixels that are vertically and horizontally adjacent to each other with a boundary line that partitions four adjacent cells C interposed therebetween.

  When performing pixel sequential reading, as described above, the charge accumulation timing is slightly shifted between the 16 pixels forming the unit region 131. This timing shift appears as image distortion when a moving subject is photographed by the image pickup apparatus 1.

  Such image distortion also occurs at the boundary between the unit regions 131 and the unit regions 131. In the present embodiment, however, the boundary line that divides the four unit regions 131a to 131d forming the cell C is sandwiched. Since the readout control is performed so that the acquisition timings of the pixel signals are the same between the adjacent pixels, image distortion in the boundary portion that partitions the four unit regions 131a to 131d in the cell C (the pixel signals on both sides of the boundary portion are It is possible to prevent image cracking caused by a large difference.

  Further, the image distortion as described above also occurs at the boundary between the adjacent cells C, and in the present embodiment, the pixels adjacent to each other with the boundary line separating the four adjacent cells C sandwiched therebetween. Since the readout control is performed so that the pixel signals are acquired at the same timing between pixels, image distortion at the boundary between adjacent cells C (image cracking caused by a large difference in pixel signals on both sides of the boundary) is also prevented. You can

<Description of imaging device>
FIG. 8 is a block diagram illustrating the configuration of the image pickup apparatus 1 including the image pickup element 100 described above. In FIG. 8, the imaging device 1 includes an imaging optical system 10, an imaging unit 20, an image processing unit 30, a work memory 40, a display unit 50, a recording unit 60, and a control unit 70.

  The imaging optical system 10 is composed of a plurality of lenses and guides the light flux from the object scene to the imaging unit 20. The imaging optical system 10 may be configured integrally with the imaging device 1 or may be replaceable with the imaging device 1. Further, the imaging optical system 10 may include a focus lens or a zoom lens.

  The image capturing section 20 includes the image capturing element 100 described above and a drive section 21 that drives the image capturing element 100. The image sensor 100 is drive-controlled by the control signal output from the drive unit 21, and as described above, it is possible to perform the read control in which the control independently performed for each of the four adjacent unit regions is performed in cooperation. The control unit 70 gives a read control instruction to the drive unit 21.

  The image processing unit 30 cooperates with the work memory 40 to perform image processing on the image data captured by the image capturing unit 20. In the present embodiment, the image processing unit 30 performs not only normal image processing (color signal processing, gamma correction, etc.) but also detection processing of a main subject included in the image. The detection of the main subject by the image processing unit 30 can be performed using a known face detection function. In addition to face detection, a human body included in an image may be detected as a main subject, as described in, for example, Japanese Unexamined Patent Publication No. 2010-16621 (US2010 / 0002940).

  The work memory 40 temporarily stores image data before and after JPEG compression and before and after MPEG compression. The display unit 50 includes, for example, a liquid crystal display panel 51, and displays an image (still image or moving image) captured by the image capturing unit 20 and various types of information, and displays an operation input screen. The display unit 50 has a configuration in which a touch panel 52 is laminated on the display surface of a liquid crystal display panel 51. The touch panel 52 outputs a signal indicating the position touched by the user on the liquid crystal display panel 51.

  The recording unit 60 stores various data such as image data acquired in response to a main imaging instruction (release operation by a release button (not shown)) in a storage medium such as a memory card. The control unit 70 has a CPU and controls the overall operation of the imaging device 1. The control unit 70 causes each unit area 131 of the image sensor 100 (imaging chip 113) to acquire an image at a predetermined frame rate and gain, and cooperates with each other to perform control independently for each of the four adjacent unit areas. The control parameter is instructed to the drive unit 21 so as to perform the read control.

  Further, the control unit 70 causes the AE / AWB calculation unit 72 to perform automatic exposure calculation and determination of the white balance adjustment value based on the pixel signal read from the image sensor 100. The AE / AWB calculator 72 calculates the exposure (exposure time, gain, etc.) so that the average level of the pixel signals approaches a predetermined level, for example. Further, the AE / AWB calculation unit 72 determines an adjustment value used for expressing a white color as white.

  The control unit 70 further causes the AF (autofocus) calculation unit 71 to calculate the focus adjustment state by the image pickup optical system 10 based on the pixel signal read from the image pickup device 100. The AF calculation unit 71 detects the focus adjustment state by the phase difference detection method. Therefore, a pixel for focus detection is provided at a predetermined position on the image pickup surface of the image pickup device 100 (image pickup chip 113) instead of the image pickup pixel. FIG. 9 is a diagram exemplifying pixel rows 91 to 95 for focus detection.

  The AF calculation unit 71 performs the phase difference detection calculation using the output signals from the focus detection pixels that form the pixel columns 91 to 95, for example, at the time of acquiring the live view image, thereby performing the focus adjustment by the imaging optical system 10. The state (specifically, the defocus amount) is detected. The live view image is also referred to as a preview image before the main image capturing (image capturing according to the release operation) is performed, and is a monitor image acquired by the image sensor 100 at a predetermined frame rate (for example, 30 fps). The focus detection pixel and the phase difference detection calculation are publicly known as described in, for example, Japanese Patent Application Laid-Open No. 2009-94881, and thus detailed description thereof will be omitted. The control unit 70 adjusts the focus of the main subject by moving the position of the focus lens forming the imaging optical system 10 according to the defocus amount calculated by the AF calculation unit 71.

  Here, the influence of the image distortion generated during the pixel sequential reading on the AF calculation (phase difference detection calculation) will be described. As described above, the shift in the charge accumulation timing between pixels when performing pixel sequential reading appears as image distortion when capturing a moving subject. As illustrated in FIG. 9, when the pixel columns 91 to 95 are provided so as to straddle a plurality of cells C, the pixel columns 91 to 95 also straddle the unit regions 131 included in the cells C. Become.

  If it is assumed that the control is not performed so that the pixel signal acquisition timings are the same between the focus detection pixels that are adjacent to each other with the boundary line that divides the unit regions 131a to 131d interposed therebetween, the boundary line will be sandwiched. Therefore, the phase difference information is significantly different, which leads to a decrease in the detection accuracy of the focus adjustment state (specifically, the defocus amount).

  However, in the present embodiment, the read control is performed so that the pixel signal acquisition timings are the same between the pixels that are adjacent to each other with the boundary line that partitions the four unit regions 131a to 131d that form the cell C interposed therebetween. It is possible to prevent a decrease in the detection accuracy of the focus adjustment state (specifically, the defocus amount) at the boundary portion that partitions the four unit regions 131a to 131d in C.

  Further, as described above, the phenomenon that the phase difference information greatly differs across the boundary line may occur at the boundary between the adjacent cells C, but in the present embodiment, four adjacent cells C are used. Since the readout control is performed so that the pixel signal acquisition timings are the same between the adjacent pixels across the boundary line that divides the cell, the focus adjustment state (specifically, the defocus amount) at the boundary that divides the adjacent cell C. It is possible to prevent a decrease in the detection accuracy of.

According to the embodiment described above, the following operational effects can be obtained.
(1) The image pickup device 100 has a plurality of pixels, and an image pickup chip 113 in which a plurality of unit regions 131 capable of reading out pixel signals of sequentially selected pixels are arranged, and for each unit region 131 adjacent to each other, Output wirings 308 that sequentially select pixels in mutually adjacent unit areas 131 in a direction symmetrical with respect to the adjacent boundary lines and output pixel signals at substantially the same time from the mutually adjacent unit areas 131. I did it. As a result, the pixel signals can be acquired at the same timing between pixels that are adjacent to each other with the boundary line that divides the unit region 131 in between. It is possible to obtain a high-quality image by suppressing image cracking caused by a large difference.

(2) In the image pickup device 100 of (1) above, the output wiring 308 has two unit regions (131a, 131a, 131b, 131c, 131d) vertically adjacent to each other. , 131b, 131c, and 131d), pixels are sequentially selected in a direction symmetrical with respect to a horizontal boundary line that partitions two vertically adjacent unit areas, and pixel signals are output. As a result, the pixel signal acquisition timing can be made the same between pixels that are vertically adjacent to each other across the horizontal boundary line that divides the unit area 131. Therefore, image distortion at the boundary portion that divides the unit area 131 (both sides of the boundary portion) can be obtained. Thus, it is possible to obtain a high-quality image by suppressing image cracking caused by a large difference in pixel signal.

(3) In the image sensor 100 according to (1) above, the output wiring 308 includes two unit regions (131a, 131a, 131c, 131b, 131d) adjacent in the horizontal direction and two unit regions (131a, adjacent in the horizontal direction). , 131c, 131b, and 131d) at substantially the same time, pixels are sequentially selected in a direction symmetrical with respect to a vertical boundary line that partitions two unit regions that are horizontally adjacent to each other, and pixel signals are output. As a result, the pixel signal acquisition timing can be made the same between pixels that are adjacent to each other on the left and right with a vertical boundary line that divides the unit area 131 in between. Thus, it is possible to obtain a high-quality image by suppressing image cracking caused by a large difference in pixel signal.

(4) In the imaging device 100 of (1) above, the output wiring 308 has four unit regions (131a, 131b) for every four unit regions (131a, 131b, 131c, 131d) that are vertically and horizontally adjacent to each other. , 131c, 131d) at substantially the same time, pixels are sequentially selected in a symmetrical direction with respect to an intersection P of vertical and horizontal boundary lines that partition the four unit regions, and pixel signals are output. As a result, the pixel signal acquisition timing can be made the same between pixels that are vertically and horizontally adjacent to each other with the boundary line that partitions the unit regions 131a to 131d sandwiched therebetween, so that an image in the boundary portion that partitions the unit regions 131a to 131d can be obtained. Distortion (image cracking caused by a large difference in pixel signals on both sides of the boundary portion) can be suppressed to obtain a high-quality image.

(5) In the image sensor 100 of (1) to (4) above, since the plurality of pixels include the image-capturing pixels and the focus-detecting pixels, in addition to suppressing image cracking in the boundary portion that partitions the unit region 131, It is also possible to suppress a decrease in the detection accuracy of the focus adjustment state (specifically, the defocus amount) at the boundary portion that partitions the unit region 131.

(6) In the imaging device 1 of (5) above, since the imaging chip 113 and the signal processing chip 111 that processes a signal from the imaging chip 113 are stacked, each chip does not need to be enlarged in the plane direction. The image sensor 100 can be made compact.

(7) Since the image pickup apparatus 1 which is an example of the electronic apparatus includes the camera unit having the image pickup element 100, it is possible to provide the image pickup apparatus 1 that obtains a high-quality image.

(Modification 1)
The reading direction for the pixels included in the four unit regions 131a to 131d in the cell C may be different from that in the above-described embodiment. FIG. 10 is an enlarged view of one cell C in FIG. 5, and FIG. 10A illustrates the read control for the pixels included in the four unit regions 131a to 131d in the cell C in the first modification. It is a figure. In FIG. 10A, 16 pixels are included in each of four adjacent unit areas 131a to 131d.

  In the first modification, in each of the unit areas 131a to 131d, the pixel at the position closest to the intersection P of the vertical and horizontal boundary lines that partition the four unit areas 131a to 131d is the read start pixel (hatched in FIG. 10A). Shown). Then, pixel signals are sequentially read out in a direction in which the pixel signals are once separated from the point P in the horizontal direction and returned to the point P side in the horizontal direction, and in a direction away from the point P in the vertical direction. The pixel farthest from the point P in the direction is the read end pixel.

  In the case of the unit area 131a, the operation of vertically reading from the reading start pixel located at the lower right in the horizontal left direction, repeating the operation of folding and reading in the horizontal right direction is performed in the vertical upward direction, and pixels are sequentially read to the reading end pixel located at the upper right. The reading is controlled so as to read. As a result, pixel signals of 16 pixels forming the unit area 131a are sequentially read.

  In the case of the unit area 131b, the reading start pixel located in the upper right is read in the horizontal left direction, the operation is repeated vertically and the reading is performed in the horizontal right direction, and scanning is performed in the vertical downward direction. The reading is controlled so as to read. As a result, the pixel signals of 16 pixels forming the unit area 131b are sequentially read.

  In the case of the unit region 131c, while repeating the operation of reading in the horizontal right direction from the reading start pixel located in the lower left, folding back and reading in the horizontal left direction, scanning is performed vertically upward, and pixels are sequentially read to the reading end pixel located in the upper left. The reading is controlled so as to read. Thereby, the pixel signals of 16 pixels forming the unit area 131c are sequentially read.

  In the case of the unit area 131d, while repeating the operation of reading in the horizontal right direction from the reading start pixel located in the upper left, folding back and reading in the horizontal left direction, scanning is performed vertically downward, and pixel sequentially to the reading end pixel located in the lower left. Read-out control is performed so that the data is read out. Thereby, the pixel signals of 16 pixels forming the unit area 131d are sequentially read.

  In the cell C, when the read control in each of the four unit areas 131a to 131d is performed in parallel at the same timing, the pixel signals of 64 pixels (4 × 16 pixels) included in the cell C are divided into 16 times and sequentially. Read out.

  FIG. 10B is a diagram showing the reading order of the pixel signals read by the reading control illustrated in FIG. 10A. Number 1 corresponds to the read start pixel, and number 16 corresponds to the read end pixel. Since the four unit regions 131a to 131d are performed in parallel at the same timing, the pixel signals are read out from the four pixels indicated by the same number in the cell C at the same timing. According to FIG. 10B, pixel signals are read out at the same timing from pixels vertically adjacent to each other with a horizontal boundary line that divides the four unit regions 131a to 131d in between. In addition, pixel signals are read out at the same timing from pixels that are adjacent to each other on the left and right with a vertical boundary line that divides the four unit regions 131a to 131d in between.

  When the above-described read control for independently performing the control independently for each of the four unit areas adjacent to each other is performed in parallel for all the cells C illustrated in FIG. 5 at the same timing, all the read operations included in the imaging chip 113 are performed. Pixel signals of pixels are sequentially read in 16 times. FIG. 11 is a diagram showing a read order of pixel signals read by the read control according to the modified example 1 with respect to four adjacent cells C. Number 1 corresponds to the read start pixel, and number 16 corresponds to the read end pixel. Since the four cells C are performed in parallel at the same timing, pixel signals are read out at the same timing from the 16 pixels indicated by the same numbers in FIG.

  According to FIG. 11, pixel signals are read out at the same timing from pixels vertically adjacent to each other across a horizontal boundary line that partitions four adjacent cells C. Further, pixel signals are also read out at the same timing from pixels that are adjacent to each other on the left and right with a vertical boundary line that partitions four adjacent cells C in between.

  As described above, also in the case of the modified example 1, pixel signals acquired at the same timing from pixels that are vertically and horizontally adjacent to each other with the boundary line that divides the four unit regions 131a to 131d forming the cell C interposed therebetween. Obtainable. Furthermore, it is possible to obtain pixel signals acquired at the same timing from pixels that are vertically and horizontally adjacent to each other with a boundary line that partitions four adjacent cells C interposed therebetween.

  When the pixel sequential reading as described above is performed, the charge accumulation timing is slightly shifted between the 16 pixels forming the unit region 131. When capturing a moving subject, image distortion due to this timing shift may occur at the boundary between the unit regions 131 and 131. In Modified Example 1, the cell C is configured. The four unit areas 131a to 131d in the cell C are partitioned because the read control is performed so that the pixel signals are acquired at the same timing between the pixels adjacent to each other across the boundary line that partitions the four unit areas 131a to 131d. It is possible to prevent image distortion at the boundary (image cracking caused by a large difference in pixel signals on both sides of the boundary).

  Further, the image distortion as described above may occur at the boundary between the adjacent cells C, but in the modified example 1, the adjacent cells are adjacent to each other with a boundary line separating the four adjacent cells C interposed therebetween. Since the readout control is performed so that the pixel signal acquisition timings are the same between pixels, image distortion at the boundary between adjacent cells C (image cracking caused by a large difference in pixel signals on both sides of the boundary) is also possible. Can be prevented.

(Modification 2)
The relationship between the horizontal direction and the vertical direction in the above description may be switchable as appropriate. That is, the pixel signal is read in the vertical direction from the point P as a starting point, and the configuration is switched to the horizontal scanning.

(Modification 3)
Although the pixel rows 91 to 95 for focus detection arranged in the horizontal direction are illustrated in FIG. 9, the pixel rows for focus detection may be arranged in the vertical direction.

(Modification 4)
The reading direction for the pixels included in the four unit areas 131a to 131d in the cell C may be oblique. FIG. 12 is an enlarged view of one cell C in FIG. 5, and FIG. 12A illustrates read control for pixels included in the four unit regions 131a to 131d in the cell C in the modification 4. It is a figure. In FIG. 12A, four adjacent unit areas 131a to 131d each include 16 pixels.

  In the modified example 4, among the unit areas 131a to 131d, the pixel at the position closest to the intersection P of the vertical and horizontal boundary lines that partition the four unit areas 131a to 131d is the read start pixel (hatched in FIG. 12A). Shown). Then, the pixels farthest from the point P in each of the unit areas 131a to 131d are set as the read end pixels while obliquely reading from the pixels closer to the point P in order.

  In the case of the unit area 131a, reading is performed from the reading start pixel located at the lower right, then diagonal reading is performed in the upper right direction, folding is performed, and diagonal reading is performed in the lower left direction. Fold back again and read diagonally to the upper right, then fold back and read diagonally to the lower left. Further, the reading is controlled pixel-sequentially so as to be folded back, read diagonally in the upper right direction, and finally read from the end pixel. As a result, pixel signals of 16 pixels forming the unit area 131a are sequentially read.

  In the case of the unit area 131b, reading is performed from the reading start pixel located at the upper right, then diagonally reading is performed in the lower right direction, folding is performed, and diagonally reading is performed in the upper left direction. Fold it again and read it diagonally to the lower right, then fold it back and read diagonally to the upper left. Further, the reading is controlled pixel by pixel so that the reading is performed by folding back and reading diagonally in the lower right direction, and finally reading from the end pixel. As a result, the pixel signals of 16 pixels forming the unit area 131b are sequentially read.

  In the case of the unit area 131c, the reading is started from the reading start pixel located at the lower left, the diagonal reading is performed in the upper left direction, the folding is performed, and the diagonal reading is performed in the lower right direction. Fold back again and read diagonally to the upper left, then fold back and read diagonally to the lower right. Further, the reading control is performed pixel by pixel so that the reading is performed by folding back, reading diagonally in the upper left direction, and finally reading from the end pixel. Thereby, the pixel signals of 16 pixels forming the unit area 131c are sequentially read.

  In the case of the unit area 131d, the reading is started from the reading start pixel located at the upper left, then diagonally read in the lower left direction, folded, and diagonally read in the upper right direction. Fold back again and read diagonally to the lower left, then fold back and read diagonally to the upper right. Further, the reading is controlled in order of pixels so that the reading is performed by folding back, reading diagonally in the lower left direction, and finally reading from the end pixel. Thereby, the pixel signals of 16 pixels forming the unit area 131d are sequentially read.

  In the cell C, when the read control in each of the four unit areas 131a to 131d is performed in parallel at the same timing, the pixel signals of 64 pixels (4 × 16 pixels) included in the cell C are divided into 16 times and sequentially. Read out.

  FIG. 12B is a diagram showing the reading order of the pixel signals read by the reading control illustrated in FIG. Number 1 corresponds to the read start pixel, and number 16 corresponds to the read end pixel. Since the four unit regions 131a to 131d are performed in parallel at the same timing, the pixel signals are read out from the four pixels indicated by the same number in the cell C at the same timing. According to FIG. 12B, pixel signals are read out at the same timing from pixels vertically adjacent to each other with a horizontal boundary line that divides the four unit regions 131a to 131d in between. In addition, pixel signals are read out at the same timing from pixels that are adjacent to each other on the left and right with a vertical boundary line that divides the four unit regions 131a to 131d in between.

  When the above-described read control for independently performing the control independently for each of the four unit areas adjacent to each other is performed in parallel for all the cells C illustrated in FIG. 5 at the same timing, all the read operations included in the imaging chip 113 are performed. Pixel signals of pixels are sequentially read in 16 times. Then, also in the modified example 4, as in the case of the above-described embodiment and the modified example 1, the pixel signals of the pixel signals are adjoined between the pixels adjacent to each other with the boundary line that partitions the four unit regions 131a to 131d forming the cell C interposed therebetween. Since the acquisition timings are the same, it is possible to prevent image distortion (so-called image cracking) at the boundary between the four unit areas 131a to 131d in the cell C.

  Further, also in the modified example 4, as in the case of the above-described embodiment and modified example 1, the acquisition timing of the pixel signal becomes the same between the pixels that are adjacent to each other across the boundary line that partitions the four adjacent cells C. Therefore, it is possible to prevent image distortion (so-called image cracking) at the boundary between adjacent cells C.

(Modification 5)
In the above-described embodiment, an example has been described in which the charge accumulation timings of the pixels in the unit region 131 are sequentially shifted in the horizontal direction in the pixel sequence. The multilayer image pickup device 100 is configured by changing the arrangement of the reset wirings 300, 310, 320, ..., Transfer wirings 302, 312, 322, ... And the selection wirings 306, 316, 326 ,. In the region 131, resetting and pixel signal reading can be performed for each horizontal line or vertical line. Therefore, a case where pixel signals are read out in a horizontal line sequence will be described below.

  In the fifth modification, the horizontal line closest to the intersection P in the unit areas 131a to 131d described above is set as the read start line. Then, on both the upper side and the lower side of the point P, the horizontal lines distant from the point P are shifted in timing so that the charge accumulation timing is delayed. In this way, in each of the unit areas 131a to 131d, the horizontal line farthest from the point P is set as the read end line.

  When the read control in each of the four unit areas 131a to 131d forming the cell C is performed in parallel at the same timing, the pixel signals of 16 horizontal lines (4 × 4 horizontal lines) included in the cell C are changed four times. It is read separately in order.

  In Modification 5, the horizontal lines adjacent to each other across the horizontal boundary line that divides the four unit regions 131a to 131d forming the cell C from each other serve as the read start line. It is possible to prevent image distortion (so-called image cracking) at the boundary between the upper and lower parts of the unit areas 131a to 131d. In the case of horizontal line sequential reading, the horizontal lines that are adjacent to each other across the vertical boundary line that divides the four unit regions 131a to 131d in the cell C into the left and right originally have the same charge accumulation timing. Distortion (so-called image cracking) does not originally occur.

  Furthermore, in Modification 5, since the horizontal lines that are adjacent to each other across the horizontal boundary line that partitions the upper and lower sides of the four adjacent cells C both serve as read end lines, the boundary line that partitions the adjacent cell C into the upper and lower parts. Image distortion (so-called image cracking) can also be prevented. In the case of horizontal line sequential reading, the horizontal line adjacent to each other across the vertical boundary line that divides the adjacent cell C into right and left originally has the same charge accumulation timing, and therefore the image distortion at this boundary portion (so-called image crack). Originally does not occur.

(Modification 6)
The imaging device 1 according to the above-described embodiment may be configured by a high-performance mobile phone or a tablet terminal. In this case, the camera unit mounted on the high-performance mobile phone (or tablet terminal) is configured by using the above-mentioned laminated image pickup device 100.

  The above description is merely an example, and the present invention is not limited to the configuration of the above embodiment. The configurations of the above-described embodiment and each modified example may be appropriately combined.

DESCRIPTION OF SYMBOLS 1 ... Imaging device 10 ... Imaging optical system 20 ... Imaging part 30 ... Image processing part 40 ... Work memory 50 ... Display part 60 ... Recording part 70 ... Control part 71 ... AF operation part 100 ... Imaging element 109 ... Bump 111 ... Signal processing Chip 112 ... Memory chip 113 ... Imaging chips 131, 131a to 131d ... Unit area 308 ... Output wiring

Claims (16)

An imaging device having a plurality arranged in a region having a plurality of photoelectric conversion portions for converting light into electric charge in the row direction and column direction,
The first timing of starting the transfer of the charges converted by the first photoelectric conversion unit included in the first region of the plurality of regions, and the one of the plurality of regions adjacent to the first region from the first region in the row direction side. A period between the second region arranged and a second timing at which transfer of charges converted by the second photoelectric conversion unit arranged next to the first photoelectric conversion unit on the row direction side is started. However, the second timing, and the third timing of starting transfer of the charges converted by the third photoelectric conversion unit arranged on the row direction side from the first photoelectric conversion unit, which is included in the first region, A control unit that controls to be shorter than the period between
An imaging device including.   The imaging according to claim 1, wherein the control unit performs control so that a period between the first timing and the second timing is shorter than a period between the first timing and the third timing. apparatus. An imaging device having a plurality arranged in a region having a plurality of photoelectric conversion portions for converting light into electric charge in the row direction and column direction,
The first timing of starting the transfer of the charges converted by the first photoelectric conversion unit included in the first region of the plurality of regions, and the one of the plurality of regions adjacent to the first region from the first region in the row direction side. A period between the second region arranged and a second timing at which transfer of charges converted by the second photoelectric conversion unit arranged next to the first photoelectric conversion unit on the row direction side is started. However, the first timing, and a third timing of starting transfer of charges converted by the third photoelectric conversion unit arranged on the row direction side from the first photoelectric conversion unit, which is included in the first region, A control unit that controls to be shorter than the period between
An imaging device including.   The image pickup apparatus according to claim 1, wherein the control unit controls the first timing and the second timing to be substantially the same. The control unit includes, from the first photoelectric conversion unit to the column direction side , the first timing and a third region of the plurality of regions that is adjacent to the first region on the column direction side. In the period between the fourth timing at which the transfer of the charges converted by the fourth photoelectric conversion unit arranged next to is started, and the period between the third timing and the fourth timing, The image pickup apparatus according to claim 1, wherein the image pickup apparatus is controlled so as to be shortened. The control unit includes, from the first photoelectric conversion unit to the column direction side , the first timing and a third region of the plurality of regions that is adjacent to the first region on the column direction side. In the period between the fourth timing at which the transfer of the charges converted by the fourth photoelectric conversion unit arranged next to the second timing is started, the period between the first timing and the third timing is shorter than the period between the first timing and the third timing. The image pickup apparatus according to claim 1, wherein the image pickup apparatus is controlled so as to be shortened.   The image pickup apparatus according to claim 5, wherein the control unit controls the first timing and the fourth timing to be substantially the same. The image sensor receives light from an optical system,
The control unit is included in the optical system using a signal generated by the charges converted by the first photoelectric conversion unit and a signal generated by the charges converted by the second photoelectric conversion unit. The imaging device according to claim 1, wherein driving of the lens is controlled.   The control unit controls the driving of the lens by using a signal generated by the charges converted by the first photoelectric conversion unit and a signal generated by the charges converted by the fourth photoelectric conversion unit. The imaging device according to any one of claims 5 to 7. The image pickup device has a plurality of transfer units for transferring the charges converted by the photoelectric conversion unit,
Wherein the control unit, the imaging device according to any one of claims 1 to 9 for controlling the timing of starting the transfer of the electric charge converted by the photoelectric conversion unit by the transfer unit. The imaging device, the imaging device according to any one of claims 1 to 10 having a signal processing unit for performing signal processing on the generated signal by the converted electric charges in the photoelectric conversion unit. The image pickup apparatus according to claim 11 , wherein the signal processing unit includes a circuit that converts a signal generated by the charges converted by the photoelectric conversion unit into a digital signal. The imaging device according to claim 12 , wherein the circuit is arranged in each of the regions. The imaging device according to any one of claims 11 to 13 , wherein the imaging element includes an imaging chip on which the photoelectric conversion unit is arranged and a signal processing chip on which the signal processing unit is arranged. The imaging apparatus according to any one of claims 14 to claim 11, comprising a storage unit for storing the signal on which signal processing has been performed by the signal processing unit. The image pickup apparatus according to claim 15 , wherein the image pickup element has a memory chip in which the storage unit is arranged.

Images