JP2023054229A - Electronic apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To generate plural types of images for the same subject.

SOLUTION: An electronic apparatus includes: a plurality of pixel blocks arranged in parallel along the line direction, having a pixel including a photoelectric conversion part for converting light to charge, and control wiring connected to the pixel, to which a control signal for controlling the pixel is outputted; and a generation part for generating first image data based on a first signal read from a pixel included in a first pixel block within the plurality of pixel blocks, and second image data based on a second signal read from a pixel included in a second pixel block within the plurality of pixel blocks.

SELECTED DRAWING: Figure 3

COPYRIGHT: (C)2023,JPO&INPIT

Description

The present invention relates to electronic equipment.

2. Description of the Related Art There has been proposed an electronic device provided with an image pickup device in which a back-illuminated image pickup chip and a signal processing chip are stacked (hereinafter, this image pickup device will be referred to as a stacked image pickup device) (see Patent Document 1, for example). In the stacked imaging device, a back-illuminated imaging chip and a signal processing chip are stacked such that they are connected via microbumps for each block unit in which a plurality of pixels are grouped together.

JP-A-2006-49361

However, there are not many proposals for obtaining an image by capturing an image in units of a plurality of blocks in electronic devices equipped with conventional stacked imaging devices, and the usability of electronic devices equipped with stacked imaging devices has not been sufficient.

An object of the present invention is to generate a plurality of types of images for the same subject.

An aspect of the present invention provides an electronic device. An electronic device includes pixels including photoelectric conversion units that convert light into electric charges, and control wirings that are connected to the pixels and output control signals for controlling the pixels, and are arranged side by side in the row direction. a plurality of pixel blocks. The electronic device comprises first image data based on first signals read from pixels of a plurality of first pixel blocks among the plurality of pixel blocks, and pixels of a plurality of second pixel blocks among the plurality of pixel blocks. and a generating unit that generates second image data based on the second signal read from.

According to the aspects of the present invention, multiple types of images can be generated for the same subject.

1 is a cross-sectional view of a stacked imaging device; FIG. It is a figure explaining the pixel arrangement|sequence of an imaging chip, and a unit group. FIG. 4 is a circuit diagram corresponding to a unit group of imaging chips; 3 is a block diagram showing the functional configuration of an imaging device; FIG. 1 is a block diagram showing the configuration of an electronic device according to a first embodiment; FIG. 1 is a diagram showing the appearance of a digital camera, which is an example of an electronic device; FIG. 3 is a functional block diagram of an image processing unit and a system control unit; FIG. It is a figure which shows the arrangement|sequence pattern in each block. 4 is a flowchart for explaining a shooting operation executed by a system control unit; 9 is a flowchart for explaining array pattern setting processing; FIG. 10 is a diagram showing a setting example of a second array pattern when a second still image mode is executed; 4 is a timing chart showing charge accumulation timings in a first still image mode and a second still image mode; FIG. 10 is a diagram showing a display example when still images are displayed on the first display section and the second display section; FIG. 11 is a diagram showing a setting example of a second array pattern when a second moving image mode is executed; FIG. 11 is a timing chart showing charge accumulation timings in the second moving image mode; FIG. FIG. 10 is a diagram showing a display example in which a moving image is displayed on the first display portion and a still image is displayed on the second display portion; FIG. 11 is a diagram showing a fifth array pattern in each block; FIG. 11 is a diagram showing a sixth array pattern in each block; FIG. 10 is a timing chart showing the timing of charge accumulation in the second embodiment; FIG. FIG. 10 is a diagram showing a display example when still images are displayed on the first display section and the second display section in the second embodiment; FIG. 11 is a block diagram showing the configuration of an imaging device and an electronic device according to a third embodiment;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the present invention is not limited to this. In addition, in the drawings, in order to describe the embodiments, the scale is changed as appropriate, such as by enlarging or emphasizing a portion.

<First embodiment>
FIG. 1 is a cross-sectional view of a stacked imaging device. The stacked imaging device 100 is described in Japanese Patent Application No. 2012-139026 previously filed by the applicant of the present application. The imaging device 100 includes an imaging chip 113 that outputs pixel signals corresponding to incident light, a signal processing chip 111 that processes the pixel signals, and a memory chip 112 that stores the pixel signals. These imaging chip 113, signal processing chip 111, and memory chip 112 are stacked and electrically connected to each other by conductive bumps 109 such as Cu.

Incidentally, as shown in the figure, the incident light is mainly incident in the Z-axis plus direction indicated by the white arrow. In the present embodiment, the surface of the imaging chip 113 on which incident light is incident is referred to as the rear surface. Also, as shown in the coordinate axes, the leftward direction of the paper perpendicular to the Z-axis is the positive X-axis direction, and the frontward direction of the paper perpendicular to the Z-axis and the X-axis is the positive Y-axis direction. In the following several figures, the coordinate axes are displayed with reference to the coordinate axes of FIG. 1 so that the direction of each figure can be understood.

An example of the imaging chip 113 is a back-illuminated MOS image sensor. The PD layer 106 is arranged on the back side of the wiring layer 108 . The PD layer 106 has a plurality of photodiodes (hereinafter referred to as PDs) 104 arranged two-dimensionally and storing charges according to incident light, and transistors 105 provided corresponding to the PDs 104 . .

A color filter 102 is provided on the incident light side of the PD layer 106 with a passivation film 103 interposed therebetween. The color filter 102 is a filter that passes a specific wavelength region of visible light. This color filter 102 has a plurality of types that transmit different wavelength regions, and has a specific arrangement corresponding to each of the PDs 104 . The arrangement of the color filters 102 will be described later. A set of color filter 102, PD 104, and transistor 105 forms one pixel.

A microlens 101 is provided on the incident light side of the color filter 102 so as to correspond to each pixel. The microlens 101 collects incident light toward the corresponding PD 104 .

The wiring layer 108 has wiring 107 for transmitting pixel signals from the PD layer 106 to the signal processing chip 111 . The wiring 107 may be multi-layered and may be provided with passive and active elements. A plurality of bumps 109 are arranged on the surface of the wiring layer 108 . These bumps 109 are aligned with the bumps 109 provided on the opposite surface of the signal processing chip 111 . By pressurizing the imaging chip 113 and the signal processing chip 111, the aligned bumps 109 are bonded and electrically connected.

Similarly, a plurality of bumps 109 are arranged on surfaces of the signal processing chip 111 and the memory chip 112 facing each other. These bumps 109 are aligned with each other. By applying pressure to the signal processing chip 111 and the memory chip 112, the aligned bumps 109 are bonded and electrically connected.

The bonding between the bumps 109 is not limited to Cu bump bonding by solid phase diffusion, and may be microbump bonding by solder melting. Also, about one bump 109 may be provided for one unit group, which will be described later. Therefore, the size of the bumps 109 may be larger than the pitch of the PDs 104 . Also, bumps larger than the bumps 109 corresponding to the pixel regions may be provided in peripheral regions other than the pixel region (pixel region 113A shown in FIG. 2) in which pixels are arranged.

The signal processing chip 111 has a TSV (Through-Silicon Via) 110 that connects circuits provided on the front surface and the back surface. The TSV 110 is provided in the peripheral area. Also, the TSV 110 may be provided in the peripheral area of the imaging chip 113 or in the memory chip 112 .

FIG. 2 is a diagram for explaining the pixel array and unit groups of the imaging chip. FIG. 2 particularly shows a state in which the imaging chip 113 is observed from the back side. A region in which pixels are arranged in the imaging chip 113 is called a pixel region 113A. More than 20 million pixels are arranged in a matrix in the pixel area 113A. In the example shown in FIG. 2, 16 pixels of adjacent 4×4 pixels form one unit group 131 . The grid lines in FIG. 2 illustrate the concept that adjacent pixels are grouped together to form unit groups 131 . The number of pixels forming the unit group 131 is not limited to this, and may be about 1000, for example, 32 pixels×64 pixels, or may be more or less.

As shown in the partially enlarged view of the pixel region 113A, the unit group 131 contains four so-called Bayer arrays each including four pixels of green pixels Gb and Gr, blue pixels B, and red pixels R, vertically and horizontally. A green pixel is a pixel having a green filter as the color filter 102, and receives light in the green wavelength band among incident light. Similarly, a blue pixel is a pixel having a blue filter as the color filter 102 and receives light in the blue wavelength band. A red pixel is a pixel having a red filter as the color filter 102 and receives light in the red wavelength band.

FIG. 3 is a circuit diagram corresponding to a unit group of imaging chips. In FIG. 3, a rectangle encircled by dotted lines typically represents a circuit corresponding to one pixel. Note that at least part of each transistor described below corresponds to the transistor 105 in FIG.

As described above, the unit group 131 is formed from 16 pixels. The 16 PDs 104 corresponding to each pixel are connected to transfer transistors 302 respectively. A gate of each transfer transistor 302 is connected to a TX wiring 307 to which a transfer pulse is supplied. In this embodiment, the TX wiring 307 is commonly connected to 16 transfer transistors 302 .

The drain of each transfer transistor 302 is connected to the source of each corresponding reset transistor 303 , and the so-called floating diffusion FD (charge detector) between the drain of the transfer transistor 302 and the source of each reset transistor 303 is connected to the amplification transistor 304 . connected to the gate. A drain of each reset transistor 303 is connected to a Vdd wiring 310 to which a power supply voltage is supplied. A gate of each reset transistor 303 is connected to a reset wiring 306 to which a reset pulse is supplied. In this embodiment, the reset wiring 306 is commonly connected to the 16 reset transistors 303 .

A drain of each amplifying transistor 304 is connected to a Vdd wiring 310 supplied with a power supply voltage. Also, the source of each amplification transistor 304 is connected to the drain of each corresponding selection transistor 305 . A gate of each selection transistor 305 is connected to a decoder wiring 308 to which a selection pulse is supplied. In this embodiment, the decoder wiring 308 is provided independently for each of the 16 selection transistors 305 . A source of each selection transistor 305 is connected to a common output wiring 309 . A load current source 311 supplies current to the output wiring 309 . That is, the output wiring 309 for the selection transistor 305 is formed by a source follower. The load current source 311 may be provided on the imaging chip 113 side or may be provided on the signal processing chip 111 side.

Here, the flow from the start of charge accumulation to the pixel output after the end of charge accumulation will be described. A reset pulse is applied to the reset transistor 303 through the reset wiring 306 . At the same time, a transfer pulse is applied to the transfer transistor 302 through the TX wiring 307 . This resets the potentials of the PD 104 and the floating diffusion FD.

When the application of the transfer pulse is released, the PD 104 converts the incident light it receives into charges and accumulates them. After that, when the transfer pulse is applied again while the reset pulse is not applied, the charges accumulated in the PD 104 are transferred to the floating diffusion FD. As a result, the potential of the floating diffusion FD changes from the reset potential to the signal potential after charge accumulation. Then, when a selection pulse is applied to the selection transistor 305 through the decoder wiring 308 , fluctuations in the signal potential of the floating diffusion FD are transmitted to the output wiring 309 via the amplification transistor 304 and the selection transistor 305 . By such circuit operation, a pixel signal corresponding to the reset potential and the signal potential is output from the unit pixel to the output wiring 309 .

As shown in FIG. 3, in this embodiment, the reset wiring 306 and the TX wiring 307 are common to the 16 pixels forming the unit group 131 . That is, the reset pulse and the transfer pulse are each applied simultaneously to all 16 pixels. Therefore, all the pixels forming the unit group 131 start charge accumulation at the same timing and finish charge accumulation at the same timing. However, pixel signals corresponding to the accumulated charges are selectively output to the output wiring 309 by sequentially applying selection pulses to the respective selection transistors 305 . Also, the reset wiring 306 , the TX wiring 307 , and the output wiring 309 are provided separately for each unit group 131 .

By configuring the circuit on the basis of the unit group 131 in this way, the charge accumulation time can be controlled for each unit group 131 . In other words, it is possible to output pixel signals with different charge accumulation times between the unit groups 131 . Furthermore, while one unit group 131 is caused to perform one charge accumulation, the other unit group 131 is caused to repeat charge accumulation many times and to output a pixel signal each time. It is also possible to output each moving image frame at a different frame rate between the unit groups 131 .

FIG. 4 is a block diagram showing the functional configuration of the imaging device. Analog multiplexer 411 sequentially selects 16 PDs 104 forming unit group 131 . Then, the multiplexer 411 outputs the pixel signal of each of the 16 PDs 104 to the output wiring 309 provided corresponding to the unit group 131 . A multiplexer 411 is formed in the imaging chip 113 together with the PD 104 .

The analog pixel signal output via the multiplexer 411 is amplified by the amplifier 412 formed in the signal processing chip 111 . Then, the pixel signal amplified by the amplifier 412 is processed by a signal processing circuit 413 formed in the signal processing chip 111 that performs correlated double sampling (CDS)/analog/digital conversion. Signal processing of correlated double sampling is performed, and A/D conversion (conversion from analog signal to digital signal) is performed. Noise in the pixel signal is reduced by subjecting the pixel signal to signal processing of correlated double sampling in the signal processing circuit 413 . A/D-converted pixel signals are transferred to a demultiplexer 414 and stored in pixel memories 415 corresponding to respective pixels. Demultiplexer 414 and pixel memory 415 are formed in memory chip 112 .

The arithmetic circuit 416 processes the pixel signal stored in the pixel memory 415 and transfers it to the subsequent image processing unit. The arithmetic circuit 416 may be provided in the signal processing chip 111 or may be provided in the memory chip 112 . Although FIG. 4 shows connections for one unit group 131, in reality, these units exist for each unit group 131 and operate in parallel. However, the arithmetic circuit 416 may not exist for each unit group 131 . For example, one arithmetic circuit 416 may sequentially refer to the values of the pixel memory 415 corresponding to each unit group 131 and process them sequentially.

As described above, the output wiring 309 is provided corresponding to each unit group 131 . The imaging device 100 has an imaging chip 113, a signal processing chip 111, and a memory chip 112 stacked. Therefore, by using the bumps 109 as the output wirings 309 for electrical connection between the chips, the wiring can be routed without increasing the size of each chip in the planar direction.

Next, blocks set in the pixel area 113A (see FIG. 2) of the image sensor 100 will be described. In this embodiment, the pixel area 113A of the image sensor 100 is divided into a plurality of blocks. A plurality of blocks are defined to include at least one unit group 131 per block. Pixels included in each block are controlled with different control parameters. That is, pixel signals with different control parameters are obtained for a pixel group included in a certain block and a pixel group included in another block. Control parameters include, for example, charge accumulation time or number of accumulations, frame rate, gain, thinning rate, number of addition rows or addition columns for adding pixel signals, number of bits for digitization, and the like. Furthermore, the control parameter may be a parameter in image processing after acquiring image signals from pixels.

Here, the charge accumulation time is the time from when the PD 104 starts accumulating charges until it ends. The number of charge accumulations refers to the number of times the PD 104 accumulates charges per unit time. A frame rate is a value representing the number of frames processed (displayed or recorded) per unit time in a moving image. The unit of frame rate is fps (Frames Per Second). The higher the frame rate, the smoother the movement of the subject (that is, the object being imaged) in the moving image.

A gain is a gain factor (amplification factor) of the amplifier 412 . By changing this gain, the ISO sensitivity can be changed. The ISO sensitivity is a standard for photographic film established by ISO, and indicates how weak light the photographic film can record. However, in general, the ISO sensitivity is also used when expressing the sensitivity of the imaging device 100 . In this case, the ISO sensitivity is a value representing the ability of the image sensor 100 to capture light. Increasing the gain also improves the ISO sensitivity. For example, if the gain is doubled, the electric signal (pixel signal) is also doubled, and even if the amount of incident light is halved, appropriate brightness can be obtained. However, increasing the gain also amplifies the noise contained in the electrical signal, resulting in increased noise.

Also, the thinning rate refers to the ratio of the number of pixels whose pixel signals are not read out to all the number of pixels in a predetermined area. For example, when the thinning rate of a predetermined area is 0, it means that pixel signals are read out from all pixels in the predetermined area. Further, when the thinning rate of a predetermined area is 0.5, it means that pixel signals are read out from half of the pixels in the predetermined area. Specifically, when the unit group 131 has a Bayer array, every other unit of the Bayer array in the vertical direction, that is, pixels from which pixel signals are alternately read out by two pixels (by two rows) in a pixel unit and read out. Pixels that are not displayed are set. It should be noted that the resolution of the image decreases when the readout of the pixel signals is thinned out. However, since 20 million or more pixels are arranged in the imaging device 100, even if thinning is performed at a thinning rate of 0.5, an image can be displayed with 10 million or more pixels. Therefore, it is considered that the user (photographer) does not mind the decrease in resolution.

The number of rows to be added refers to the number of pixels in the vertical direction (the number of rows) to be added when pixel signals of pixels adjacent to each other in the vertical direction are added. The number of columns to be added refers to the number of pixels in the horizontal direction (the number of columns) to be added when pixel signals of horizontally adjacent pixels are added. Such addition processing is performed in the arithmetic circuit 416, for example. The arithmetic circuit 416 adds the pixel signals of a predetermined number of vertically or horizontally adjacent pixels, thereby providing the same effect as reading out pixel signals by thinning at a predetermined thinning rate. In addition, in the above-described addition processing, the average value may be calculated by dividing the added value by the number of rows or columns added by the arithmetic circuit 416 .

Also, the number of bits for digitization refers to the number of bits when the signal processing circuit 413 converts an analog signal into a digital signal in A/D conversion. As the number of bits of the digital signal increases, luminance, color change, etc. are expressed in more detail.

In the present embodiment, the accumulation condition refers to a condition regarding charge accumulation in the image sensor 100 . Specifically, the accumulation condition refers to the charge accumulation time or the number of accumulations, the frame rate, and the gain among the control parameters described above. The frame rate is included in the accumulation conditions because the frame rate can change according to the charge accumulation time and the number of accumulations. In addition, the amount of light for proper exposure changes according to the gain, and the charge accumulation time or number of times of accumulation may also change according to the amount of light for proper exposure. Therefore, gain is included in the accumulation condition.

Also, the imaging conditions refer to conditions related to imaging of a subject. Specifically, the imaging conditions refer to control parameters including the accumulation conditions described above. The imaging conditions include control parameters for controlling the image sensor 100 (for example, charge accumulation time or number of times, frame rate, gain) and control parameters for controlling readout of signals from the image sensor 100 ( For example, a thinning rate), control parameters for processing the signal from the image sensor 100 (for example, the number of addition rows or addition columns for adding pixel signals, the number of bits for digitization, the image processing unit 30 described later image processing control parameters for executing) are also included.

FIG. 5 is a block diagram showing the configuration of the electronic device according to the first embodiment. The electronic device 1 shown in FIG. 5 is composed of devices such as a digital camera, a smart phone, a mobile phone, a personal computer, etc., which have an imaging function. As shown in FIG. 5, the electronic device 1 includes a lens unit 10, an imaging unit 20, an image processing unit 30, a work memory 40, a display unit 50, an operation unit 55, a recording unit 60, and a system control unit . The lens unit 10 is an imaging optical system configured from a plurality of lens groups. The lens unit 10 guides the light flux from the subject to the imaging unit 20 . The lens unit 10 may be integrated with the electronic device 1 or may be an interchangeable lens detachable from the electronic device 1 . Further, the lens unit 10 may incorporate a focus lens or may incorporate a zoom lens.

The imaging unit 20 has an imaging device 100 and a driving unit 21 . The driving unit 21 is a control circuit that controls the driving of the imaging device 100 according to instructions from the system control unit 70 . Here, the driving unit 21 controls the timing (or timing cycle) of applying the reset pulse and the transfer pulse to the reset transistor 303 and the transfer transistor 302, respectively, thereby setting the charge accumulation time or the number of times of accumulation, which are control parameters. Control. Further, the drive unit 21 controls the frame rate by controlling the timing (or timing cycle) of applying the reset pulse, the transfer pulse, and the selection pulse to the reset transistor 303, the transfer transistor 302, and the selection transistor 305, respectively. do. Further, the drive unit 21 controls the thinning rate by setting the pixels to which the reset pulse, transfer pulse, and selection pulse are applied.

Further, the drive unit 21 controls the ISO sensitivity of the image sensor 100 by controlling the gain (also referred to as gain factor or amplification factor) of the amplifier 412 . Further, the drive unit 21 sets the number of addition rows or the number of addition columns for adding the pixel signals by sending an instruction to the arithmetic circuit 416 . Further, the drive unit 21 sets the number of bits for digitization by sending an instruction to the signal processing circuit 413 . Further, the driving unit 21 sets blocks in the pixel area (imaging area) 113A of the image sensor 100 . In this way, the drive unit 21 functions as an image pickup device control unit that causes the image pickup device 100 to pick up images under different image pickup conditions for each of a plurality of blocks and output pixel signals. The system control unit 70 instructs the drive unit 21 about the position, shape, range, and the like of the block.

The imaging device 100 transfers pixel signals from the imaging device 100 to the image processing unit 30 . Using the work memory 40 as a work space, the image processing unit 30 performs various image processing on the RAW data composed of the pixel signal of each pixel to generate image data. The image processing section 30 is provided with a first image processing section 30A and a second image processing section 30B. When the image processing load is high, processing is assigned to the first image processing section 30A and the second image processing section 30B. Then, the first image processing section 30A and the second image processing section 30B execute the assigned processes in parallel.

In the present embodiment, as will be described later, the system control unit 70 (specifically, the dividing unit 71 shown in FIG. 7) divides the pixel area (imaging area) 113A of the image sensor 100 into at least a first area and a second area. divide into regions and Further, the system control unit 70 (specifically, the drive control unit 72 shown in FIG. 7) drives and controls the imaging device 100 so that the first area and the second area are imaged under different imaging conditions. In this case, for example, the first image processing section 30A executes image processing of the signal from the first area. Also, the second image processing unit 30B executes image processing of the signal from the second area. Note that the pixel region (imaging region) 113A of the image sensor 100 is not limited to being divided into two regions, the first region and the second region. It can be divided into multiple regions such as Image processing for a plurality of regions is appropriately assigned to the first image processing section 30A and the second image processing section 30B. The allocation of image processing may be determined in advance based on the number and range of divided regions, or may be determined by the system control unit 70 based on the number and range of divided regions.

The image processing unit 30 executes various image processing. For example, the image processing unit 30 generates RGB image signals by performing color signal processing (color tone correction) on the signals obtained in the Bayer array. The image processing unit 30 also performs image processing such as white balance adjustment, sharpness adjustment, gamma correction, and gradation adjustment on the RGB image signal. Further, the image processing unit 30 performs processing for compressing in a predetermined compression format (JPEG format, MPEG format, etc.) as necessary. The image processing section 30 outputs the generated image data to the recording section 60 . The image processing unit 30 also outputs the generated image data to the display unit 50 .

In this embodiment, the image processing unit 30 performs processing for detecting the main subject from the image data in addition to the processing described above. Here, the “main subject” refers to a subject that attracts the user's (photographer's) attention or is presumed to attract the user's attention. There is not only one main subject in the image data, but there may also be a plurality of main subjects (see FIG. 14, for example).

Control parameters (imaging conditions) also include parameters referred to when the image processing unit 30 performs image processing. For example, the control parameters include parameters such as color signal processing (color tone correction), white balance adjustment, gradation adjustment, and compression rate. A signal read out from the image pickup device 100 changes according to the charge accumulation time or the like, and a parameter referred to when image processing is performed changes according to the change of the signal. The image processing unit 30 sets different control parameters for each block and executes image processing such as color signal processing based on these control parameters.

The image processing unit 30 extracts frames at predetermined timings from among the plurality of frames obtained in time series from the imaging unit 20 . Alternatively, the image processing unit 30 discards frames at predetermined timings among the plurality of frames obtained in time series from the imaging unit 20 . As a result, the amount of data can be reduced, and the load of post-processing can be reduced. Also, the image processing unit 30 calculates one or more frames to be interpolated between each frame based on a plurality of frames obtained in time series from the imaging unit 20 . Then, the image processing unit 30 adds one or more calculated frames between each frame. As a result, it is possible to reproduce moving images with smoother movements during moving image reproduction. Further, although the drive unit 21 is configured to control the thinning rate, the configuration is not limited to this. For example, although the driving unit 21 reads out pixel signals from all pixels, the image processing unit 30 or the arithmetic circuit 416 may control the thinning rate by discarding predetermined pixel signals among the read out pixel signals. good.

The work memory 40 temporarily stores image data and the like when image processing is performed by the image processing unit 30 . The display unit 50 is configured by, for example, a liquid crystal display panel. The display unit 50 has a first display unit 51, a first touch panel 52, a second display unit 53, and a second touch panel 54, as shown in FIG.

The first display unit 51 displays images (still images, moving images, live view images) captured by the imaging unit 20 and various information. The first touch panel 52 is formed on the display screen of the first display section 51 . The first touch panel 52 outputs a signal indicating the position touched by the user to the system control unit 70 when the user selects an image (thumbnail image to be described later: see FIG. 13). The second display unit 53 displays images (still images, moving images, live view images) captured by the imaging unit 20 and various information. The second touch panel 54 is formed on the display screen of the second display section 53 . The second touch panel 54 outputs a signal indicating the position touched by the user to the system control unit 70 when the user selects an image or the like.

The operation unit 55 includes a release switch, a moving image switch, various operation switches, and the like, which are operated by the user. The operation unit 55 outputs a signal to the system control unit 70 according to the user's operation. The recording unit 60 has two card slots into which two storage media (a first recording medium 61 and a second recording medium 62) such as memory cards can be loaded. The recording unit 60 stores image data and various data generated by the image processing unit 30 in recording media (first recording medium 61 and second recording medium 62) loaded in the card slot. In the present embodiment, as described above, the first image processing section 30A and the second image processing section 30B perform image processing based on the signal from the first area and image processing based on the signal from the second area, respectively. and run in parallel. In this case, the first recording medium 61 stores the image data based on the signal from the first area in accordance with the operation of the release switch or moving picture switch. Also, the second recording medium 62 stores image data based on the signal from the second area in accordance with the operation of the release switch or moving picture switch. Also, the recording unit 60 has an internal memory. The recording unit 60 can also record image data and various data generated by the image processing unit 30 in the internal memory.

The system control unit 70 controls the overall processing and operation of the electronic device 1 . The system control unit 70 has a CPU (Central Processing Unit) 70A. In this embodiment, the system control unit 70 divides the imaging surface (pixel region 113A) of the imaging device 100 (imaging chip 113) into a plurality of blocks, and sets different charge accumulation times (or charge accumulation times) and frame rates between the blocks. , to acquire an image with gain. For this reason, the system control unit 70 instructs the drive unit 21 about the position, shape, range, and storage conditions for each block. In addition, the system control unit 70 acquires an image with a thinning rate different between blocks, the number of addition rows or addition columns for adding pixel signals, and the number of bits for digitization. For this reason, the system control unit 70 instructs the driving unit 21 on imaging conditions for each block (thinning rate, number of rows or columns to be added for adding pixel signals, and number of bits for digitization). Further, the image processing unit 30 executes image processing under different imaging conditions (color signal processing, white balance adjustment, gradation adjustment, control parameters such as compression ratio) between blocks. Therefore, the system control unit 70 instructs the image processing unit 30 on imaging conditions for each block (control parameters such as color signal processing, white balance adjustment, gradation adjustment, and compression rate).

Also, the system control unit 70 causes the recording unit 60 to record the image data generated by the image processing unit 30 . Further, the system control unit 70 causes the display unit 50 to output the image data generated by the image processing unit 30, thereby displaying an image on the display unit 50 (one or both of the first display unit 51 and the touch panel 52). display. Alternatively, the system control unit 70 reads the image data recorded in the recording unit 60 and causes the display unit 50 to output the image data to the display unit 50 (one or both of the first display unit 51 and the touch panel 52). display an image. Images displayed on the display unit 50 include still images, moving images, and live view images. Here, the live view image is an image displayed on the display unit 50 by sequentially outputting the image data generated by the image processing unit 30 to the display unit 50 . The live view image is used by the user to check the image of the subject being imaged by the imaging unit 20 . A live view image is also called a through image or a preview image.

FIG. 6 is a diagram showing the appearance of a digital camera, which is an example of electronic equipment. Note that FIG. 6 shows the appearance of the electronic device (digital camera) 1 viewed from the back. As shown in FIG. 6, the first display unit 51 is a display panel having a rectangular display screen. This first display unit 51 is provided on the back surface of the electronic device 1 . The first touch panel 52 is formed on the display screen of the first display section 51 .

The second display unit 53 is a display panel having a rectangular display screen. An end portion of the second display portion 53 is rotatably connected by a hinge (not shown) provided on the back surface of the electronic device 1 and below the first display portion 51 . The first display portion 51 is opened and closed by the second display portion 53 by rotating the second display portion 53 about the hinge.

A release switch 55a, a mode dial 55b, and a moving image switch 55c are provided on the upper surface of the electronic device 1. As shown in FIG. The release switch 55a is a switch that is pushed by the user when capturing a still image. By half-pressing the release switch 55a, shooting preparations such as AF (Automatic Focusing) and AE (Automatic Exposure) are performed. The mode dial 55b is a dial that is rotated by the user when setting various scene modes such as portrait, landscape, and night scene. The moving picture switch 55c is a switch that is pushed by the user when capturing a moving picture. A multi-selector 55 d is provided on the back side of the electronic device 1 and on the side of the first display section 51 . The multi-selector 55d is a key for the user to select a menu (menu for setting a shooting mode) displayed on the first display section 51 or the second display section 53 by using up, down, left, and right arrow keys and an OK switch. and switches. The operation unit 55 has a release switch 55a, a mode dial 55b, a moving image switch 55c, and a multi-selector 55d. Note that the operation unit 55 may have switches other than these.

7 is a functional block diagram of an image processing unit and a system control unit shown in FIG. 5. FIG. As shown in FIG. 7, the first image processing section 30A includes an image generation section 31A and a detection section 32A. The image generation unit 31A generates image data by performing various image processing on RAW data composed of pixel signals of pixels in the first region output from the imaging unit 20 . Also, the detection unit 32A detects the main subject from the image data generated by the image generation unit 31A. In this embodiment, the detection unit 32A compares a plurality of pieces of image data obtained in time series from the live view image generated by the image generation unit 31A, and detects a moving subject (moving subject) as the main subject. Further, the detection unit 32A detects the main subject using a face detection function as described in Japanese Patent Application Laid-Open No. 2010-16621 (US2010/0002940), for example. In addition to face detection, the detection unit 32A detects a human body included in image data as a main subject, as described in Japanese Patent Application Laid-Open No. 2010-16621 (US2010/0002940), for example.

Also, the second image processing section 30B includes an image generating section 31B. The image generator 31B generates image data by performing various image processing on the RAW data composed of the pixel signals of the pixels in the second region output from the imaging unit 20 . Although the second image processing section 30B does not include a detection section, it may include a detection section. Alternatively, the first image processing section 30A may not include the detection section 32A, and the second image processing section 30B may include the detection section. In the present embodiment, the image generation section 31A and the image generation section 31B may be collectively referred to as the image generation section 31 in some cases.

The system control unit 70 also includes a division unit 71 , a drive control unit 72 and a display control unit 73 . The dividing unit 71 divides the pixel area (imaging area) 113A of the image sensor 100 into a plurality of areas in units of blocks. The dividing unit 71 divides the pixel region 113A into a plurality of regions based on a predetermined arrangement pattern in each block of the pixel region 113A (see FIGS. 8A to 8D). The drive control unit 72 sets imaging conditions for a plurality of areas. Further, the drive control section 72 executes drive control of the imaging device 100 according to the user's operation of the release switch 55a and the moving image switch 55c. The drive control unit also executes drive control of the image sensor 100 when capturing a live view image (that is, after starting a shooting operation after power-on). The display control unit 73 causes the display unit 50 to output the image data generated by the image generation unit 31, and displays an image (still image, moving image, live image) on one or both of the first display unit 51 and the second display unit 53. View image) is displayed.

In the system control unit 70, the division unit 71, the drive control unit 72, and the display control unit 73 are implemented by the CPU 70A executing processes based on the control program.

Next, the arrangement pattern in each block set by the dividing section 71 will be described. FIG. 8 is a diagram showing an arrangement pattern in each block. Here, FIG. 8A shows the first array pattern in each block. Also, FIG. 8B shows the second array pattern in each block. Also, FIG. 8C shows a third arrangement pattern in each block. Also, FIG. 8D shows a fourth arrangement pattern in each block.

The first array pattern shown in FIG. 8A is an array pattern in which the pixel region 113A is divided into two regions, the first region and the second region. In this first array pattern, in the pixel region 113A, the first region is composed of blocks in odd numbered columns (2m−1), and the second region is composed of blocks in even numbered columns (2m). That is, each block in the pixel area 113A is divided into odd-numbered columns and even-numbered columns. m is a positive integer (m=1, 2, 3, . . . ).

The second array pattern shown in FIG. 8B is also an array pattern in which the pixel region 113A is divided into two regions, the first region and the second region. In this second array pattern, in the pixel region 113A, the first region is composed of blocks in odd-numbered rows (2n−1), and the second region is composed of blocks in even-numbered rows (2n). That is, each block in the pixel area 113A is divided into odd-numbered rows and even-numbered rows. n is a positive integer (n=1, 2, 3, . . . ).

The third array pattern shown in FIG. 8C is also an array pattern in which the pixel region 113A is divided into two regions, the first region and the second region. In this third array pattern, in the pixel region 113A, blocks in odd rows (2n−1) in odd columns (2m−1) and blocks in even rows (2n) in even columns (2m) A first area is configured. In addition, the second area is made up of blocks in odd rows (2n−1) in even columns (2m) and blocks in even rows (2n) in odd columns (2m−1). That is, each block in the pixel region 113A is divided into a checkered pattern. m and n are positive integers (m = 1, 2, 3, ..., n = 1, 2, 3, ...). As shown in FIGS. 8A to 8C, in the present embodiment, the first area and the second area are not necessarily composed only of continuous blocks, but composed of discrete blocks. ing.

A fourth array pattern shown in FIG. 8D is an array pattern in which the pixel region 113A is divided into three regions, a first region, a second region, and a third region. In this fourth arrangement pattern, in the pixel region 113A, the first region is composed of blocks from the columns of multiples of 3 to the columns two columns before (3m−2), and the second region is composed of blocks from the columns of multiples of 3 to the first column. It consists of the blocks in the previous column (3m-1), and the third area consists of the blocks in columns that are multiples of 3 (3m). m is a positive integer (m=1, 2, 3, . . . ).

In FIG. 8, a small number of blocks are set in the pixel area 113A in order to make the arrangement of blocks in each area easier to see, but a larger number of blocks than those shown in FIG. 8 are set. You may do so.

Next, a shooting operation according to the first embodiment will be described. FIG. 9 is a flowchart for explaining the shooting operation executed by the system control unit. Also, FIG. 10 is a flowchart for explaining the array pattern setting process. In the process shown in FIG. 9, when the electronic device 1 is powered on, the system control unit 70 starts the shooting operation. Further, although not shown in FIG. 9, when shooting is started, the display control unit 73 displays the live view image captured by the imaging unit 20 on the first display unit 51, and sets the shooting mode. menu is displayed on the second display unit 53 . At this time, since the live view image does not need to be an image in which the subject moves smoothly, the drive control unit 72 drives and controls the imaging element 100 so as to capture an image at a low frame rate. Note that the display control unit 73 may display the live view image on the second display unit 53 and display the menu on the first display unit 51 . Further, the display control section 73 may display the live view image and the menu on the same display section (the first display section 51 or the second display section 53).

The user selects a shooting mode by operating the multi-selector 55 d and selecting a menu displayed on the second display section 53 . The dividing unit 71 confirms the shooting mode selected by the user's operation of the multi-selector 55d (step S1).

Here, as shooting modes, a still image mode for shooting still images and a moving image mode for shooting moving images are provided. Further, as still image modes, a first still image mode and a second still image mode are provided. Also, as moving image modes, a first moving image mode and a second moving image mode are provided.

The first still image mode is a photographing mode in which the image pickup device 100 takes a still image of a subject with the pixel region 113A of the image pickup device 100 as one region without dividing the pixel region (image pickup region) 113A of the image pickup device 100 by the dividing unit 71. Say. This first still image mode is a normal still image shooting mode that is commonly used. The second still image mode is a photographing mode in which the dividing unit 71 divides the pixel area 113A into a plurality of areas, and the imaging element 100 photographs a still image of the same subject in each of the plurality of areas. In this second still image mode, processing for continuously capturing still images of the same subject in each of a plurality of areas can be executed in parallel. Therefore, more still images can be shot per unit time when the still images are continuously shot in the second still image mode than in the first still image mode. That is, high-speed continuous shooting can be performed in the second still image mode than in the first still image mode. The second still image mode is also called a high-speed continuous shooting mode or still image-still image mixed mode.

The first moving image mode is a shooting mode in which the image sensor 100 shoots a moving image of a subject using the pixel area 113A of the image sensor 100 as one area without dividing the pixel area (imaging area) 113A of the image sensor 100 by the dividing unit 71. . This first moving image mode is a normal moving image shooting mode that is commonly used. In the second moving image mode, the dividing unit 71 divides the pixel region 113A into a plurality of regions, the imaging device 100 captures a still image of the subject in one of the plurality of regions, and A shooting mode in which a moving image of the same subject is shot in an area. The second moving image mode is also called a still image-moving image simultaneous shooting mode or a still image-moving image mixed mode.

When the user selects the shooting mode, the user may touch the position corresponding to the menu on the second touch panel 54 instead of operating the multi selector 55d.

The dividing unit 71 determines whether or not the shooting mode selected by the user is the still image mode (step S2). When the dividing unit 71 determines that the shooting mode is the still image mode, it determines whether the still image mode is the first still image mode (step S3). When determining that the still image mode is the first still image mode, the dividing unit 71 performs processing for setting the shooting mode to the first still image mode (step S4). On the other hand, if the division unit 71 determines that the still image mode is not the first still image mode, that is, if it determines that it is the second still image mode, the dividing unit 71 performs processing for setting the shooting mode to the second still image mode. (step S5).

In the process of step S4 or step S5, the dividing unit 71 executes the array pattern setting process shown in FIG. In the process shown in FIG. 10, the division unit 71 instructs the image processing unit 30 (first image processing unit 30A) to detect the main subject (step S21). The detection unit 32A compares a plurality of pieces of image data obtained in time series from live view images to detect a moving subject and a non-moving subject (not moving subject). The detection unit 32A then outputs the detection result to the system control unit 70 together with the image data. The dividing section 71 confirms the presence or absence of the main subject based on the detection result of the detecting section 32A. Then, the dividing unit 71 sets an area according to the main subject and the shooting mode in the pixel area 113A (step S22).

Specifically, the dividing unit 71 does not divide the pixel region 113A into a plurality of regions when the imaging mode is the first still image mode. That is, the division unit 71 sets all the pixel regions 113A as one region. At this time, the division unit 71 outputs an instruction signal instructing the drive unit 21 to set all the pixel regions 113A as one region.

On the other hand, when the photographing mode is the second still image mode, the dividing section 71 selects one of the array patterns shown in FIGS. 8A to 8D. Then, the dividing section 71 confirms whether or not the main subject is a moving subject based on the detection result of the detecting section 32A. If the main subject is not a moving subject but a non-moving subject, the dividing section 71 sets the first area and the second area according to the third arrangement pattern shown in FIG. 8C. If the main subject is a moving subject, the dividing section 71 confirms the moving direction of the moving subject. When the movement direction of the moving subject is mainly in the vertical direction, for example, when the main subject is a child sliding on a slide or a waterfall, the dividing unit 71 divides the first array pattern shown in FIG. A first area and a second area are set. When the movement direction of the moving subject is mainly in the left-right direction, for example, when the main subject is a person running or when panning is being performed, the division unit 71 may be divided into the following directions as shown in FIG. A first area and a second area are set according to the second array pattern. Furthermore, when the moving subject moves at a high speed in the vertical direction, the dividing section 71 sets the first area, the second area, and the third area according to the fourth arrangement pattern shown in FIG. 8(D). Note that, in step S22, the dividing section 71 outputs an instruction signal to the driving section 21 to instruct the positions of the blocks in each area (the first area and the second area, the first area to the third area).

FIG. 11 is a diagram showing a setting example of the second array pattern when the second still image mode is executed. Note that in FIG. 11, each block is enlarged to make the arrangement of the blocks easier to see. However, a block smaller than the block size shown in FIG. 11 is actually set in the pixel region 113A. In the example shown in FIG. 11, the detection unit 32A detects persons O1 and O2 playing soccer and a soccer ball O3 as main subjects (moving subjects). Based on the detection result of the detection unit 32A, the dividing unit 71 determines that the main objects O1 to O3 are moving objects, and that the direction of movement of the moving objects is mainly the horizontal direction. As a result, the dividing unit 71 sets the first area and the second area according to the second array pattern shown in FIG. 8B. At this time, the division unit divides the pixel area 113A so that the first area and the second area include the main subjects O1 to O3.

Returning to the description of FIG. 10, the drive control unit 72 sets imaging conditions for the area set in step S22 (the first area and the second area in the example shown in FIG. 11) based on the detection result of the detection unit 32A. (step S23). Specifically, the drive control unit 72 outputs to the drive unit 21 an instruction signal that instructs imaging conditions (charge accumulation time, gain, etc.) according to the main subject. The drive control unit 72 also outputs an instruction signal to the image processing unit 30 to instruct imaging conditions (parameters such as color signal processing, white balance adjustment, gradation adjustment, compression rate, etc.) according to the main subject. For example, when the detection unit 32A detects a moving object, the drive control unit 72 increases the gain (ISO sensitivity) and increases the charge accumulation time (that is, exposure time, shutter speed). Further, when the moving subject is not detected by the detection section 32A, the drive control section 72 reduces the gain and delays the charge accumulation time.

Returning to the description of FIG. 9, the drive control unit 72 determines whether or not the user has operated the release switch 55a (full-press operation following half-press operation) (step S6). When the drive control unit 72 determines that the release switch 55a has been operated, it causes the imaging unit 20 to perform imaging in the still image mode (first still image mode or second still image mode) (step S7).

FIG. 12 is a timing chart showing charge accumulation timings in the first still image mode and the second still image mode. In the first still image mode (normal continuous shooting mode) shown in FIG. 12A, all pixel regions 113A are set as one region as described above. In the first still image mode, while the release switch 55a is being operated (full-press operation), the drive control unit 72 drives so as to repeatedly capture still images for all the pixel regions 113A. An instruction signal is output to the unit 21 . In FIG. 12A, the drive unit 21 starts charge accumulation in the pixel region 113A at time t1, and ends charge accumulation in the pixel region 113A at time t3. The drive unit 21 reads pixel signals from each pixel in the pixel region 113A and resets the charge accumulated in each pixel. Thereafter, the drive unit 21 starts charge accumulation in the pixel region 113A at time t4, and ends charge accumulation in the pixel region 113A at time t7. The drive unit 21 repeatedly executes such drive control of the imaging element 100 while the release switch 55a is being operated.

In the example shown in FIG. 12(A), the drive unit 21 continuously performs imaging four times from time t1 to t15. The time from time t1 to t3, the time from time t4 to t7, the time from time t8 to t11, and the time from time t12 to t15 are the charge accumulation time (exposure time). This charge accumulation time (exposure time) is set in the imaging condition setting process in step S23. Further, the pixel signal of each pixel read out from the image sensor 100 is amplified by the gain instructed by the dividing section 71 in the amplifier 412 and then output to the image processing section 30 . The image generation unit 31 (for example, the image generation unit 31A) confirms parameters used in image processing such as color signal processing based on the instruction signal output from the division unit 71 and instructing imaging conditions. Then, the image generation unit 31 generates image data by performing various image processing on the RAW data made up of the pixel signal of each pixel based on the parameters.

In the second still image mode (high-speed continuous shooting mode) shown in FIG. 12B, the dividing section 71 sets, for example, a first area and a second area. In the second still image mode, while the release switch 55a is being operated (full-press operation), the drive control unit 72 repeatedly captures a still image in the first area, and in the second area. In response, an instruction signal is output to the drive unit 21 so as to repeatedly execute still image pickup. In FIG. 12B, the driving section 21 starts charge accumulation in the first region at time t1, and ends charge accumulation in the first region at time t3. The drive unit 21 reads pixel signals from each pixel in the first region and resets the charge accumulated in each pixel. Thereafter, the drive unit 21 starts charge accumulation in the first region at time t4, and ends charge accumulation in the first region at time t7. The drive unit 21 repeatedly executes such drive control of the imaging element 100 while the release switch 55a is being operated.

Further, in FIG. 12B, the drive unit 21 starts charge accumulation in the second region at time t2, and ends charge accumulation in the second region at time t5. The drive unit 21 reads pixel signals from each pixel in the second region and resets the charge accumulated in each pixel. Thereafter, the drive unit 21 starts charge accumulation in the second region at time t6, and ends charge accumulation in the second region at time t9. The drive unit 21 repeatedly executes such drive control of the imaging element 100 while the release switch 55a is being operated.

In the example shown in FIG. 12(B), the drive unit 21 continuously performs imaging four times from time t1 to t15 in the first region. Further, in parallel with the four times of imaging in the first area, the drive unit 21 continuously performs four times of imaging in the second area from time t2 to t16. Therefore, the drive unit 21 continuously performs image pickup eight times between times t1 and t16 in the first and second regions.

The time from t1 to t3, the time from t4 to t7, the time from t8 to t11, and the time from t12 to t15 are the charge accumulation time (exposure time) in the first region. This charge accumulation time (exposure time) is set in the imaging condition setting process in step S23. Also, the time from time t2 to t5, the time from time t6 to t9, the time from time t10 to t13, and the time from time t14 to t16 are the charge accumulation time (exposure time) in the second area. This charge accumulation time (exposure time) is also set in the imaging condition setting process in step S23.

Further, the pixel signal of each pixel read from the first region of the image sensor 100 is amplified by the gain instructed by the dividing section 71 in the amplifier 412 and then output to the image processing section 30 . The image generation unit 31A confirms parameters used in image processing such as color signal processing based on the instruction signal output from the division unit 71 and instructing the imaging conditions of the first region. Then, the image generator 31A generates image data of the first region by performing various types of image processing on the RAW data made up of pixel signals of pixels of the first region based on the parameters.

Further, the pixel signal of each pixel read out from the second region of the image sensor 100 is amplified by the gain instructed by the dividing section 71 in the amplifier 412 and then output to the image processing section 30 . The image generator 31B confirms parameters used in image processing such as color signal processing based on the instruction signal output from the dividing unit 71 and instructing the imaging conditions of the second region. Then, the image generator 31B generates image data of the second region by performing various image processing on the RAW data made up of pixel signals of pixels of the second region based on the parameters. Further, the image generating section 31 (image synthesizing section 31A or 31B) synthesizes the image data of the first area and the image data of the second area.

In the second still image mode shown in FIG. 12B, the drive control unit 72 causes the driving unit 21 to cause the timing to start imaging the first region and the timing to start imaging the second region to be different (shifted). The imaging device 100 is driven and controlled. Therefore, in the first still image mode shown in FIG. 12(A), for example, if it is possible to capture 30 frames of still images per second, in the second still image mode shown in FIG. 12(B), Nearly 60 frames can be captured in one second, which is almost double that in the first still image mode. In this case, since the pixel area 113A is divided into the first area and the second area, the number of pixels of the still image is halved. However, even if it is half of 20 million pixels, a still image of 10 million pixels will be captured. Therefore, it is considered that sufficient image quality is ensured for the user.

Note that, in the second still image mode, when the division unit 71 sets the first region to the third region in the pixel region 113A according to the fourth arrangement pattern shown in FIG. Faster continuous shooting can be achieved than when the second area is set. For example, if it is possible to capture 30 frames of still images per second in the first still image mode, when three regions are set in the pixel region 113A in the second still image mode, the first still image Nearly 90 frames can be captured per second, which is about three times the mode. It is expected that the imaging device 100 will continue to have more pixels. Therefore, even if the pixel area 113A is divided into three and the number of pixels in one still image is reduced to ⅓, the user places more importance on high-speed continuous shooting than deterioration of image quality.

Returning to the description of FIG. 9, the display control unit 73 outputs the image data generated by the image processing unit 30 to the display unit 50 to display a still image on the first display unit 51 or the second display unit 53 ( step S8). When the drive control unit 72 captures a still image in the first still image mode, the display control unit 73 causes the first display unit 51 to display the still image. On the other hand, when the drive control unit 72 captures still images in the second still image mode, the display control unit 73 displays a plurality of still images continuously captured at high speed on the first display unit 51 as thumbnail images. indicate. The display control unit 73 also enlarges and displays the thumbnail image selected by the user on the second display unit 53 .

FIG. 13 is a diagram showing a display example when still images are displayed on the first display section and the second display section. As shown in FIG. 13, the display control unit 73 displays eight thumbnail images (still images) 511 to 518 side by side on the first display unit 51 . For example, a thumbnail image 511 is a still image obtained by the first imaging in FIG. 12(B). Similarly, thumbnail images 512 to 518 are still images captured the second to eighth times in FIG. 12B, respectively.

Further, as shown in FIG. 13, on the first touch panel 52, eight touch areas 511a to 518a are formed so as to overlap the eight thumbnail images 511 to 518, respectively. When each of the touch areas 511a to 518a detects that it has been pressed (touched) by the user, it outputs a detection signal indicating the pressed position (which touch area) to the system control unit .

The display control unit 73 causes the second display unit 53 to display an enlarged thumbnail image corresponding to the touch area pressed by the user. In the example shown in FIG. 13, the thumbnail image 513 corresponding to the touch area 513a is enlarged and displayed on the second display unit 53 by the user pressing the touch area 513a.

Returning to the description of FIG. 9, when the dividing unit 71 determines that the shooting mode is not the still image mode in step S2, that is, when it determines that the shooting mode is the moving image mode, the moving image mode is the first moving image mode. It is determined whether or not there is (step S10). When the dividing unit 71 determines that the moving image mode is the first moving image mode, the dividing unit 71 performs processing for setting the shooting mode to the first moving image mode (step S11). On the other hand, if the dividing unit 71 determines that the moving image mode is not the first moving image mode, that is, if it determines that the moving image mode is the second moving image mode, it performs processing for setting the shooting mode to the second moving image mode (step S12). ).

In the process of step S11 or step S12, the dividing unit 71 executes the array pattern setting process shown in FIG. In the process shown in FIG. 10, the division unit 71 instructs the image processing unit 30 (first image processing unit 30A) to detect the main subject (step S21). The detection unit 32A compares a plurality of pieces of image data obtained in time series from live view images to detect a moving subject and a non-moving subject. Further, in the present embodiment, the detection unit 32A recognizes a face from the image data based on the eyes, mouth, skin color, etc., and detects the face as the main subject. Furthermore, in the present embodiment, in addition to face detection, the detection unit 32A detects a human body (person) included in image data as a main subject. The detection unit 32A then outputs the detection result to the system control unit 70 together with the image data. The dividing section 71 confirms the presence or absence of the main subject based on the detection result of the detecting section 32A. Then, the dividing unit 71 sets an area according to the main subject and the shooting mode in the pixel area 113A (step S22).

Specifically, the dividing unit 71 does not divide the pixel region 113A into a plurality of regions when the shooting mode is the first moving image mode. That is, the division unit 71 sets all the pixel regions 113A as one region. At this time, the division unit 71 outputs an instruction signal instructing the drive unit 21 to set all the pixel regions 113A as one region.

On the other hand, when the shooting mode is the second moving image mode, the dividing section 71 selects one of the array patterns shown in FIGS. 8A to 8D. Then, the dividing section 71 confirms whether or not the main subject is a moving subject based on the detection result of the detecting section 32A. If the main subject is not a moving subject but a non-moving subject, the dividing section 71 sets the first area and the second area according to the third arrangement pattern shown in FIG. 8C. If the main subject is a moving subject, the dividing section 71 confirms the moving direction of the moving subject. When the movement direction of the moving subject is mainly the vertical direction, the dividing section 71 sets the first area and the second area according to the first array pattern shown in FIG. 8A. When the movement direction of the moving subject is mainly the horizontal direction, the dividing section 71 sets the first area and the second area according to the second arrangement pattern shown in FIG. 8B. Furthermore, when the moving subject moves at a high speed in the vertical direction, the dividing section 71 sets the first area, the second area, and the third area according to the fourth arrangement pattern shown in FIG. 8(D). Note that, in step S22, the dividing section 71 outputs an instruction signal to the driving section 21 to instruct the positions of the blocks in each area (the first area and the second area, the first area to the third area).

FIG. 14 is a diagram showing a setting example of the second array pattern when the second moving image mode is executed. Note that in FIG. 14, each block is enlarged to make the arrangement of the blocks easier to see. However, a block smaller than the block size shown in FIG. 14 is actually set in the pixel region 113A. In the example shown in FIG. 14, the detection unit 32A detects persons O1 and O2 playing soccer and a soccer ball O3 as main subjects (moving subjects). Further, the detection unit 32A detects the persons O1 and O2 included in the image data as main subjects. Based on the detection result of the detection unit 32A, the dividing unit 71 determines that the main objects O1 to O3 are moving objects, and that the direction of movement of the moving objects is mainly the horizontal direction. As a result, the dividing unit 71 sets the first area and the second area according to the second array pattern shown in FIG. 8B. Also, the dividing unit 71 determines that the main subjects O1 and O2 are people. As a result, the dividing unit 71 sets the areas 200 and 201 surrounding the main subjects O1 and O2 as the second areas A, and the areas other than the areas 200 and 201 surrounding the main subjects O1 and O2 as the second areas. Set as B.

Returning to the description of FIG. 10, the drive control unit 72 controls the areas set in step S22 (in the example shown in FIG. 14, the first area, the second area A, and the second area The imaging conditions of B) are set (step S23). Specifically, the drive control unit 72 outputs to the drive unit 21 an instruction signal that instructs imaging conditions (frame rate, gain, etc.) according to the main subject. The drive control unit 72 also outputs an instruction signal to the image processing unit 30 to instruct imaging conditions (parameters such as color signal processing, white balance adjustment, gradation adjustment, compression rate, etc.) according to the main subject.

For example, when the detection unit 32A detects a moving subject, the drive control unit 72 increases the gain (ISO sensitivity) of the first area and shortens the charge accumulation time of the first area. Further, when the moving subject is not detected by the detection section 32A, the drive control section 72 lowers the gain of the first area and delays the charge accumulation time of the first area. Further, when the moving subject is detected by the detecting section 32A, the driving control section 72 sets the moving subject area (the areas 200 and 201 surrounding the main subjects O1 and O2, that is, the second area A) to the frame rate raise the Also, the frame rate of the area of the non-moving subject (the area other than the areas 200 and 201 surrounding the main subjects O1 and O2, that is, the second area B) is set lower than that of the second area A.

Returning to the description of FIG. 9, the drive control unit 72 determines whether or not the user has operated the moving image switch 55c (step S13). When the drive control unit 72 determines that the moving image switch 55c has been operated, it causes the imaging unit 20 to perform imaging in the moving image mode (first moving image mode or second moving image mode) (step S14). It should be noted that since imaging in the first moving image mode is similar to normal moving image imaging, detailed description thereof will be omitted.

FIG. 15 is a timing chart showing charge accumulation timing in the second moving image mode. In the second moving image mode (still image-moving image mix mode) shown in FIG. 15, for example, a first area, a second area A, and a second area B are set. In the second moving image mode, while the moving image switch 55c is being operated, the drive control unit 72 repeatedly captures a still image in the first area, and in the second area A and the second area B In response, an instruction signal is output to the drive unit 21 so as to execute moving image pickup. In FIG. 15, the drive unit 21 causes each pixel in the first region to capture a still image for the charge accumulation time T1 while the moving image switch 55c is being operated. Further, while the moving image switch 55c is being operated, the driving unit 21 causes each pixel in the second area A to capture a moving image for the charge accumulation time T2A. Further, while the moving image switch 55c is being operated, the driving unit 21 causes each pixel in the second area B to capture a moving image with the charge accumulation time T2B longer than the charge accumulation time T2A. The frame rate changes according to the charge accumulation time. Therefore, the frame rate of the moving image differs between when the image is captured during the charge accumulation time T2A and when the image is captured during the charge accumulation time T2B. For example, the frame rate corresponding to the charge accumulation time T2A of the second region A is 60 fps, and the frame rate corresponding to the charge accumulation time T2B of the second region B is 30 fps. The charge accumulation time and frame rate are set in the imaging condition setting process in step S23.

Further, the pixel signal of each pixel read from the first region of the image sensor 100 is amplified by the gain instructed by the dividing section 71 in the amplifier 412 and then output to the image processing section 30 . The image generation unit 31A confirms parameters used in image processing such as color signal processing based on the instruction signal output from the division unit 71 and instructing the imaging conditions of the first region. Then, the image generator 31A generates image data of the first region by performing various types of image processing on the RAW data made up of pixel signals of pixels of the first region based on the parameters.

Also, the pixel signal of each pixel read from the second region A of the image sensor 100 is amplified by the gain instructed by the dividing section 71 in the amplifier 412 and then output to the image processing section 30 . The image generation unit 31B checks parameters used in image processing such as color signal processing based on the instruction signal output from the division unit 71 and instructing the imaging conditions of the second area A. FIG. Then, the image generator 31B generates image data of the second region A by performing various image processing on the RAW data composed of pixel signals of pixels of the second region A based on the parameters.

Further, the pixel signal of each pixel read out from the second region B of the image sensor 100 is amplified by the gain instructed by the dividing section 71 in the amplifier 412 and then output to the image processing section 30 . The image generation unit 31B checks parameters used in image processing such as color signal processing based on the instruction signal output from the division unit 71 and instructing the imaging conditions of the second region B. FIG. Then, the image generator 31B generates image data of the second region B by performing various image processing on the RAW data made up of pixel signals of pixels of the second region B based on the parameters. Also, the image generator 31 (image generator 31A or 31B) synthesizes the image data of the second area A and the image data of the second area B. FIG. Furthermore, the image generator 31 (image generator 31A or 31B) synthesizes the image data of the first area, the image data of the second area A, and the image data of the second area B. FIG.

Since the frame rate of the second area A is set higher than the frame rate of the second area B in this way, the main subjects O1 and O2 of the person in the moving image move smoothly.

Returning to the description of FIG. 9, the display control unit 73 outputs the image data of the moving image generated by the image processing unit 30 to the display unit 50, thereby displaying the moving image on the first display unit 51 (step S8). Further, the display control unit 73 outputs the image data of the still image generated by the image processing unit 30 to the display unit 50 to display the still image on the second display unit 53 (step S8).

FIG. 16 is a diagram showing a display example when a moving image is displayed on the first display unit and a still image is displayed on the second display unit. As shown in FIG. 16, the display control unit 73 displays a moving image (a moving image of two people playing soccer) obtained by synthesizing the second area A and the second area B generated by the image generating unit 31 as a first display. It is displayed on the display unit 51 . Also, the display control unit 73 displays the still image of the first area generated by the image generation unit 31 .

As described above, in the first embodiment, the drive control unit 72 that drives and controls the imaging device 100, and the dividing unit 71 that divides the imaging region 113A of the imaging device 100 into at least the first region and the second region. and an image generation unit 31 for generating a first image by imaging the first area and a second image by imaging the second area of the same subject. According to such a configuration, it is possible to generate a plurality of types of images (a plurality of still images, a still image and a moving image, etc.) for the same subject. Therefore, it is possible to generate a plurality of types of images according to the subject and shooting conditions, and the usability of the electronic device 1 having the imaging element 100 is improved.

Further, the drive control unit 72 drives and controls the imaging device 100 by making the timing of starting imaging of the first area and the timing of starting imaging of the second area different. According to such a configuration, it is possible to generate a plurality of types of images for the same subject at various timings. Also, many images can be generated per unit time. Therefore, the user can take an image without missing an opportune imaging timing.

Further, since the drive control unit 72 picks up the image of the second area while picking up the image of the first area, the image pick-up of the first area and the image of the second area can be executed in parallel. Images with overlapping exposure times can be captured. Therefore, the same subject can be imaged at a timing that has not been possible until now. In addition, the drive control unit 72 makes at least one of the frame rate, gain, and exposure time different as the imaging condition for the first area and the second area of the image sensor 100 . With such a configuration, the user can obtain a plurality of types of images captured under different imaging conditions.

Further, since the image generation unit 31 generates a still image based on at least one of the imaging of the first area and the imaging of the second area, it is possible to generate a plurality of types of still images for the same subject. can. In addition, since the image generation unit 31 generates a moving image based on either the imaging of the first area or the imaging of the second area, it is possible to generate a still image and a moving image for the same subject. In addition, since the image generation unit 31 performs correction by differentiating at least one of white balance, gradation, and color tone correction for the first image and the second image, the user can perform correction based on different parameters. A plurality of types of images that have undergone image processing can be obtained.

Moreover, since the dividing unit 71 forms the first area from a plurality of discrete areas (a plurality of discrete blocks), the resolution of the image is not partially lowered. In addition, since the division unit 71 variably divides the first area and the second area, it is possible to divide into areas according to various situations such as the shooting mode and the type of subject.

Further, the detection unit 32A for detecting the main subject from the image generated by the image generation unit 31 is provided, and the division unit 71 performs division so that the main subject is included in the first area and the second area. In contrast, an image of the first area and an image of the second area can be generated. Further, since the display control section 73 is provided for displaying the image generated by the image generation section 31 on the display section 50 , the user can confirm the image displayed on the display section 50 . In addition, since the imaging device 100 has a structure in which the back-illuminated imaging chip and the signal processing chip are stacked, the volume for accommodating the imaging device 100 can be reduced. In addition, the drive control of the imaging device 100 can be performed based on the instruction from the system control unit 70, the burden on the system control unit 70 is reduced, and the mounting of the imaging device 100 on the electronic device 1 is facilitated. .

In addition, in the electronic device 1 according to the first embodiment shown in FIG. 5, the display unit 50 may be configured to be provided outside the electronic device. In this case, each of the system control unit 70 and the display unit 50 is provided with a communication unit that transmits and receives signals (image data, control signals, etc.) in a wired or wireless manner. Further, the image processing section 30 and the system control section 70 may be integrated. In this case, a system control unit having one or more CPUs performs the functions of the image processing unit 30 and the system control unit 70 by executing processing based on a control program. Further, although the image processing section 30 has two image processing sections 30A and 30B, it may be configured to have only one image processing section.

Next, a modified example of the first embodiment will be described. In FIGS. 8A to 8C, the arrangement pattern of each block is set so that the area of the first area and the area of the second area are the same. That is, the arrangement pattern of each block is set such that the number of pixels in the first area and the number of pixels in the second area are the same. In addition, in FIG. 8D, the arrangement pattern of each block is set so that the area of the first area, the area of the second area, and the area of the third area are the same. That is, the arrangement pattern of each block is set so that the number of pixels in the first area, the number of pixels in the second area, and the number of pixels in the third area are the same. However, the arrangement pattern of each block may be set such that the area (number of pixels) of each region is different.

FIG. 17 is a diagram showing a fifth array pattern in each block. A fifth array pattern shown in FIG. 17 is an array pattern in which the pixel region 113A is divided into a first region and a second region. In this fifth arrangement pattern, in the pixel region 113A, the second region is composed of blocks of columns (3m) in multiples of 3, and the first region is blocks other than the second region, i.e., It consists of blocks in columns (3m-2, 3m-1). m is a positive integer (m=1, 2, 3, . . . ). In the case of such an array pattern, the ratio of the area of the first region to the area of the second region is 2:1.

FIG. 18 is a diagram showing a sixth array pattern in each block. The sixth array pattern shown in FIG. 18 is also an array pattern in which the pixel region 113A is divided into a first region and a second region. In this sixth array pattern, in the pixel region 113A, blocks in the row (4n-1) one row before the row of multiples of 4 in the odd-numbered column (2m-1) and blocks of 4 in the even-numbered column (2m). The second area is composed of blocks in the row (4n-3) three rows before the multiple row, and the first area is composed of blocks other than the second area. m and n are positive integers (m = 1, 2, 3, ..., n = 1, 2, 3, ...). In the case of such an array pattern, the ratio of the area of the first region to the area of the second region is 3:1.

In step S22 of FIG. 10, when the dividing unit 71 determines that the shooting mode selected by the user is the second moving image mode, the dividing unit 71 selects the fifth arrangement pattern shown in FIG. 17 or the sixth arrangement pattern shown in FIG. A first area and a second area are set according to the following. If the dividing unit 71 determines that the main subject is a non-moving subject based on the detection result of the detecting unit 32A, the dividing unit 71 divides the first area and the second area according to the sixth arrangement pattern shown in FIG. set. Further, when the division unit 71 determines that the main subject is a moving subject based on the detection result of the detection unit 32A and that the movement direction of the moving subject is mainly the vertical direction, the dividing unit 71 performs the fifth step shown in FIG. A first area and a second area are set according to the arrangement pattern.

Then, in step S14, the driving control section 72 outputs an instruction signal to the driving section 21 to cause the driving section 21 to capture a still image in the first area and a moving image in the second area. When the first area and the second area are set according to the fifth arrangement pattern, the still image has twice the number of pixels as the moving image. That is, a still image has twice the resolution of a moving image. Further, when the first area and the second area are set according to the sixth arrangement pattern, the number of pixels of the still image is three times that of the moving image. That is, a still image has three times the resolution of a moving image. This requires still images to have finer image quality than moving images. Also, in the case of moving images, since the subject is often moving, deterioration in image quality is less conspicuous than in still images. For this reason, more areas are allocated to still images than to moving images. Note that if the number of pixels in the pixel area 113A is 20 million pixels, even if the number of pixels in the moving image (the number of pixels in the second area) is reduced to 1/3 or 1/4, Pixels are reserved. Such a number of pixels is comparable to that of commercially available video cameras.

<Second embodiment>
In the above-described first embodiment, as shown in FIG. 12B, in the second still image mode, the timing of starting imaging of the first area is different from the timing of starting imaging of the second area. On the other hand, in the second embodiment, in the second still image mode, the timing of starting imaging of the first region and the timing of starting imaging of the second region are set to be the same, and the exposure time (that is, charge accumulation) of the first region is time) and the exposure time of the second region are made different.

FIG. 19 is a timing chart showing the timing of charge accumulation in the second embodiment. In the second still image mode shown in FIG. 19, a first area and a second area are set. As shown in FIG. 19, while the release switch 55a is being operated, the drive unit 21 repeatedly captures still images for each pixel in the first region with a charge accumulation time (exposure time) T11. In addition, while the release switch 55a is being operated, the drive unit 21 repeatedly captures still images for each pixel in the second region with the charge accumulation time (exposure time) T12. Here, the timing of starting imaging of the first area and the timing of starting imaging of the second area are the same. On the other hand, the charge accumulation time T11 of the first region and the charge accumulation time T12 of the second region are different. That is, the charge accumulation time T12 is set longer than the charge accumulation time T11. The charge accumulation time is set in the imaging condition setting process in step S23.

A pixel signal of each pixel read out from the first region of the image sensor 100 is amplified by the gain instructed by the dividing section 71 in the amplifier 412 and then output to the image processing section 30 . The image generation unit 31A confirms parameters used in image processing such as color signal processing based on the instruction signal output from the division unit 71 and instructing the imaging conditions of the first region. Then, the image generator 31A generates image data of the first region by performing various types of image processing on the RAW data made up of pixel signals of pixels of the first region based on the parameters.

Further, the pixel signal of each pixel read out from the second region of the image sensor 100 is amplified by the gain instructed by the dividing section 71 in the amplifier 412 and then output to the image processing section 30 . The image generator 31B confirms parameters used in image processing such as color signal processing based on the instruction signal output from the dividing unit 71 and instructing the imaging conditions of the second region. Then, the image generator 31B generates image data of the second region by performing various image processing on the RAW data made up of pixel signals of pixels of the second region based on the parameters. Also, the image generator 31 (image synthesizing unit 31A or 31B) synthesizes the image data of the first area and the image data of the second area.

FIG. 20 is a diagram showing a display example when still images are displayed on the first display section and the second display section in the second embodiment. In FIG. 20 , the display control unit 73 displays a still image of the first area (an image of a person captured at night) in the left area 53L of the display screen of the second display unit 53 . Further, the display control unit 73 displays the still image of the second area in the right area 53R of the display screen of the second display unit 53 . Further, the display control unit 73 displays a still image obtained by synthesizing the still image of the first area and the still image of the second area in the central area 51</b>G of the first display unit 51 .

In general, HDR (High Dynamic
Range) imaging is widely known. In HDR imaging, a plurality of images are captured while changing imaging conditions (for example, exposure), and an image with little blown-out highlights or blocked-up shadows is generated by synthesizing the images. However, in the conventional HDR, for example, since the imaging time for imaging two images with different imaging conditions is different, the subject may move or the user (photographer) may move the electronic device 1. There is In this case, since the multiple images are not images of the same subject, it is difficult to synthesize the images. On the other hand, in the second embodiment, the imaging times of two images with different imaging conditions can be the same time (or substantially the same time). Therefore, the configuration of the second embodiment can solve the problems of conventional HDR imaging. The HDR mode is configured to be selectable according to the user's operation of the multi-selector 55d.

<Third Embodiment>
In the third embodiment, the electronic device 1 in the first embodiment described above is separated into an imaging device 1A and an electronic device 1B.

FIG. 21 is a block diagram showing configurations of an imaging device and an electronic device according to the third embodiment. In the configuration shown in FIG. 21, the imaging device 1A is a device for imaging a subject. The imaging apparatus 1A includes a lens unit 10, an imaging unit 20, an image processing unit 30, a work memory 40, an operation unit 55, a recording unit 60, and a first system control unit 75. In addition, the configuration of 10, the imaging unit 20, the image processing unit 30, the work memory 40, the operation unit 55, and the recording unit 60 in the imaging apparatus 1A is the same as the configuration shown in FIG. Therefore, the same configurations are denoted by the same reference numerals, and overlapping descriptions are omitted.

Further, the electronic device 1B is a device that displays images (still images, moving images, live view images). The electronic device 1B includes a display section 50 and a second system control section (control section) 70B. Note that the configuration of the display unit 50 in the electronic device 1B is the same as the configuration shown in FIG. Therefore, the same configurations are denoted by the same reference numerals, and overlapping descriptions are omitted.

The first system control section 75 has a first communication section 75A. The second system control section 76 also has a second communication section 76B. The first communication section 75A and the second communication section 76B transmit and receive signals to and from each other by wire or wirelessly. Also, the first system control unit 75 has a configuration corresponding to, for example, the division unit 71 and the drive control unit 72 in the configuration shown in FIG. Further, the second system control section 76 has only a configuration corresponding to, for example, the display control section 73 among the configurations shown in FIG.

The configuration shown in FIG. 7 (the division unit 71, the drive control unit 72, and the display control unit 73) may be provided in either the first system control unit 75 or the second system control unit . All the configuration shown in FIG. 7 may be provided in the first system control unit 75 or the second system control unit 76, and part of the configuration shown in FIG. 7 may be provided in the second system control unit 76 .

The imaging device 1A is composed of, for example, a digital camera, a smart phone, a mobile phone, a personal computer, etc., each having an imaging function and a communication function, and the electronic device 1B is, for example, a smart phone, a mobile phone, a portable personal computer, etc. It consists of portable terminals such as computers.

The first system control unit 75 shown in FIG. 21 is implemented by a CPU (not shown) executing processing based on a control program. Also, the second system control unit 76 shown in FIG. 21 is implemented by a CPU (not shown) executing processing based on a control program.

In the configuration shown in FIG. 21, the image processing section 30 and the first system control section 75 may be integrated. In this case, a system control unit having one or more CPUs performs processing based on a control program to perform the function of the image processing unit 30 and the function of the first system control unit 75 .

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. Various modifications and improvements can be made to the above embodiments without departing from the scope of the present invention. Also, one or more of the requirements described in the above embodiments may be omitted. Such modifications, improvements, and omissions are also included in the technical scope of the present invention. Moreover, it is also possible to appropriately combine the configurations of the above-described embodiments and modifications and apply them.

For example, in the above-described first and second embodiments, the electronic device 1 includes the imaging unit 20, the image processing unit 30 including the image generation unit 31, and the system control unit including the division unit 71 and the drive control unit 72. 70, the lens unit 10, the recording unit 60, and the like may not be provided. That is, these configurations may be configured separately from the electronic device 1 . Further, in the above-described third embodiment, the lens unit 10, the recording unit 60, and the like may be configured separately in the imaging device 1A as well.

Further, in each of the above-described embodiments, the arrangement of the color filters 102 is the Bayer arrangement, but an arrangement other than this arrangement may be used. Also, the number of pixels forming the unit group 131 should include at least one pixel. Also, it is sufficient that each block includes at least one pixel. Therefore, it is possible to perform imaging under different imaging conditions for each pixel.

Further, in each of the above-described embodiments, the drive unit 21 may be partially or wholly mounted on the imaging chip 113 , or may be partially or wholly mounted on the signal processing chip 111 . Also, part of the configuration of the image processing unit 30 may be mounted on the imaging chip 113 or the signal processing chip 111 . Also, part of the configuration of the system control unit 70 may be mounted on the imaging chip 113 or the signal processing chip 111 .

In each of the above-described embodiments, all of the gain, charge accumulation time (exposure time, shutter speed), and frame rate are configured to be changeable as imaging conditions. Just do it. Also, only the case where the imaging conditions are automatically set has been described, but they may be set according to the operation of the operation unit 55 or the like by the user.

Further, in each of the above-described embodiments, the block arrangement patterns are illustrated in FIGS. 8A to 8D, 17, and 18, but are not limited to these arrangement patterns. Alternatively, the user may select a block arrangement pattern by operating the operation unit 55 or the like. Further, the place where the still image or moving image captured by the imaging unit 20 is displayed may be the first display unit 51 or the second display unit 53 . Further, in each of the above-described embodiments, the case where the size of the block area is set in advance has been described, but the user may set the size of the block area.

Further, in the first embodiment described above, the dividing unit 71 recognizes the subject based on the live view image and sets the area. However, when the release switch 55a or the moving image switch 55c is half-pressed, the division unit 71 may recognize the subject based on the image at that time and set the area.

Further, in the above-described first embodiment, a photographing mode for panning may be provided. Panning is a photographing method that expresses the sense of speed of a moving subject by blurring the background (non-moving subject) without blurring the moving subject. In the panning shooting mode, a panning image is taken in which the charge accumulation time (exposure time) is long in the first area and the background flows, and in the second area the charge accumulation time is shorter than that of the first area. A panning image is captured. Then, the image generator 31 (or the user) synthesizes the panning image of the first area and the panning image of the second area as appropriate.

DESCRIPTION OF SYMBOLS 1, 1B... Electronic equipment, 1A... Imaging device, 20... Imaging part, 30... Image processing part, 31, 31A, 31B... Image generation part, 32A... Detection part, 50... Display part, 51... First display part, 52... First touch panel, 53... Second display unit, 54... Second touch panel, 70... System control unit, 70A... First system control unit, 70B... Second system control unit (control unit), 71... Division unit, 72... drive control section, 73... display control section, 100... imaging element

Claims (1)

A plurality of pixels arranged side by side in the row direction, each having a pixel including a photoelectric conversion portion that converts light into an electric charge and a control wiring that is connected to the pixel and outputs a control signal for controlling the pixel. and a pixel block of
first image data based on the first signals read from the pixels of the plurality of first pixel blocks among the plurality of pixel blocks; and the pixels of the plurality of second pixel blocks among the plurality of pixel blocks. and a generator that generates second image data based on the second signal read from the electronic device.

Images