JP6822507B2 - Electronics - Google Patents

Description

The present invention relates to electronic devices.

An electronic device including an image pickup device in which a back-illuminated image pickup chip and a signal processing chip are laminated (hereinafter, this image pickup device is referred to as a stacked image pickup device) has been proposed (see, for example, Patent Document 1). In the stacked image sensor, the back-illuminated image sensor and the signal processing chip are laminated so as to be connected to each other in block units in which a plurality of pixels are grouped via micro bumps.

Japanese Unexamined Patent Publication No. 2006-49361

However, in the conventional electronic device equipped with a stacked image sensor, there are not many proposals for acquiring an image by taking an image for each of a plurality of blocks, and the usability of the electronic device provided with the stacked image sensor is not sufficient.

An object of the present invention is to confirm changes in images corresponding to changes in imaging conditions by displaying a plurality of images captured under different imaging conditions on a display unit.

The electronic device according to one aspect of the present invention is a region for imaging a subject, and is a plurality of pixels that generate a signal by photoelectrically converted charges and a signal line that is connected to the plurality of pixels and outputs a signal. A control line connected to a plurality of pixels and for reading a signal into a signal line, and a plurality of image pickup elements arranged in a second direction in which an imaging region including the first direction intersects the first direction are provided. You can. The electronic device may include a setting unit for setting imaging conditions in the imaging region . The electronic device is arranged in each of the first direction and the second direction of the plurality of imaging regions, and the first image of the subject imaged in the plurality of first imaging regions in which the first imaging condition is set by the setting unit. And, among the plurality of the imaging regions, the images are taken in a plurality of second imaging regions that are arranged in the first direction and the second direction, respectively, and the second imaging conditions different from the first imaging conditions are set by the setting unit. A control unit may be provided for displaying the second image of the subject on the display unit so that the setting unit selects the imaging conditions set in the plurality of imaging regions .

According to the aspect of the present invention, by displaying a plurality of images captured under different imaging conditions on the display unit, it is possible to confirm the change in the image corresponding to the change in the imaging conditions.

It is sectional drawing of the image pickup device of this embodiment. It is a figure explaining the pixel arrangement and the unit group of an image pickup chip. It is a circuit diagram corresponding to the unit group of the image pickup chip. It is a block diagram which shows the functional structure of an image sensor. It is a figure which shows the arrangement pattern in each block. It is sectional drawing which shows the schematic structure of the digital camera which is an example of an electronic device. It is a block diagram which shows the structure of the digital camera which concerns on 1st Embodiment. It is a figure which shows the display part which concerns on the digital camera of 1st Embodiment. It is a flowchart for demonstrating the photographing operation executed by the system control unit of 1st Embodiment. It is a figure which shows the display example of the display surface in 1st Embodiment. It is a figure which shows the display example of the display surface in 1st Embodiment. It is a figure which shows the display example of the display surface in 1st Embodiment. It is a figure which shows the display example of the display surface in 1st Embodiment. It is a figure which shows the display part which concerns on the digital camera of 2nd Embodiment. It is a flowchart for demonstrating the photographing operation executed by the system control unit of 2nd Embodiment. It is a figure which shows the display example of the display surface in 2nd Embodiment. It is a figure which shows the display example of the display surface in 2nd Embodiment. It is a functional block diagram of the image processing unit and the system control unit which concerns on the digital camera of the 3rd Embodiment. It is a figure which shows the display example when the image is displayed on the 1st display part and the 2nd display part in 3rd Embodiment. It is a figure which shows the display example of the display surface in 4th Embodiment. It is a figure which shows the display example of the display surface 51D when the electronic zoom is performed in 5th Embodiment. It is a figure which shows the display example of the display surface in 6th Embodiment. It is a figure which shows the display example of the display surface in 7th Embodiment. It is a timing chart which shows the light emission timing of the strobe and the timing of charge accumulation in 8th Embodiment. It is a block diagram which shows the structure of the image pickup apparatus and the electronic apparatus which concerns on 9th Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the present invention is not limited to this. In addition, in the drawings, in order to explain the embodiment, the scale may be changed as appropriate, such as drawing a part in a large or emphasized manner. In each of the following embodiments, an interchangeable lens digital camera will be described as an example of an electronic device.

<First Embodiment>
FIG. 1 is a cross-sectional view of the image sensor 100 of the present embodiment. The image sensor 100 is described in Japanese Patent Application No. 2012-139026 previously filed by the applicant of the present application. The image sensor 100 is a memory that stores a pixel signal processed by the image pickup chip 113 that outputs a pixel signal corresponding to the incident light, a signal processing chip 111 that processes the pixel signal output from the image pickup chip 113, and the signal processing chip 111. It includes a chip 112. The image pickup chip 113, the signal processing chip 111, and the memory chip 112 are laminated, and the image pickup chip 113 and the signal processing chip 111 are electrically connected to each other by a conductive bump 109 such as Cu. Further, the signal processing chip 111 and the memory chip 112 are electrically connected to each other by a conductive bump 109 such as Cu.

As shown by the illustrated coordinate axes, the incident light is mainly incident in the positive direction of the Z axis. In the present embodiment, in the image pickup chip 113, the surface on the side where the incident light is incident is referred to as the back surface. Further, as shown by the coordinate axes, the left direction of the paper surface orthogonal to the Z axis is defined as the X-axis plus direction, and the Z-axis and the front direction of the paper surface orthogonal to the X-axis are defined as the Y-axis plus direction. In some subsequent figures, the coordinate axes are displayed so that the orientation of each figure can be understood with reference to the coordinate axes of FIG.

An example of the image pickup chip 113 is a back-illuminated MOS image sensor. The PD layer 106 is arranged on the back surface side of the wiring layer 108. The PD layer 106 has a plurality of photodiodes (Photodiode; hereinafter referred to as PD) 104 arranged two-dimensionally and accumulating charges according to incident light, and a transistor 105 provided corresponding to the PD 104. ..

A color filter 102 is provided on the incident side of the incident light in the PD layer 106 via the passivation film 103. The color filter 102 is a filter that allows visible light to pass through a specific wavelength region. The color filter 102 has a plurality of types that transmit different wavelength regions from each other, and has a specific arrangement corresponding to each of the PD 104. The arrangement of the color filters 102 will be described later. A set of a color filter 102, a PD 104, and a transistor 105 forms one pixel.

A microlens 101 is provided on the incident side of the incident light in the color filter 102 corresponding to each pixel. The microlens 101 collects incident light toward the corresponding PD 104.

The wiring layer 108 has a wiring 107 that transmits a pixel signal from the PD layer 106 to the signal processing chip 111. The wiring 107 may have multiple layers, and may be provided with passive elements and active elements. A plurality of bumps 109 are arranged on the surface of the wiring layer 108. These plurality of bumps 109 are aligned with the plurality of bumps 109 provided on the facing surfaces of the signal processing chip 111. Then, when the imaging chip 113 and the signal processing chip 111 are pressurized or the like, the aligned bumps 109 are joined to each other and electrically connected.

Similarly, a plurality of bumps 109 are arranged on the surfaces of the signal processing chip 111 and the memory chip 112 facing each other. These bumps 109 are aligned with each other. Then, when the signal processing chip 111 and the memory chip 112 are pressurized or the like, the aligned bumps 109 are joined to each other and electrically connected.

The bonding between the bumps 109 is not limited to Cu bump bonding by solid phase diffusion, and micro bump bonding by solder melting may be adopted. Further, for example, about one bump 109 may be provided for one unit group described later. Therefore, the size of the bump 109 may be larger than the pitch of the PD 104. Further, in the peripheral region other than the pixel region (pixel region 113A shown in FIG. 2) in which the pixels are arranged, a bump larger than the bump 109 corresponding to the pixel region may be provided together.

The signal processing chip 111 has a TSV (Through-Silicon Via; through silicon via) 110 that connects circuits provided on the front surface and the back surface to each other. The TSV 110 is provided in the peripheral area. Further, the TSV 110 may be provided in the peripheral area of the image pickup chip 113 or in the memory chip 112.

FIG. 2 is a diagram illustrating a pixel arrangement and a unit group of the imaging chip 113. FIG. 2 shows, in particular, a state in which the imaging chip 113 is observed from the back surface side. The region in which the pixels are arranged in the imaging chip 113 is referred to as a pixel region (imaging region) 113A. More than 20 million pixels are arranged in a matrix in the pixel area 113A. In the example shown in FIG. 2, 16 pixels of adjacent 4 pixels × 4 pixels form one unit group 131. The grid lines in FIG. 2 show the concept that adjacent pixels are grouped to form a unit group 131. The number of pixels forming the unit group 131 is not limited to this, and may be about 1000, for example, 32 pixels × 64 pixels, more or less.

As shown in the partially enlarged view of the pixel region 113A, the unit group 131 includes four so-called Bayer arrays including four pixels of green pixels Gb, Gr, blue pixels B, and red pixels R in the vertical and horizontal directions. The green pixel is a pixel having a green filter as the color filter 102, and receives light in the green wavelength band among the incident light. Similarly, the blue pixel is a pixel having a blue filter as the color filter 102 and receives light in the blue wavelength band. The red pixel is a pixel having a red filter as the color filter 102 and receives light in the red wavelength band.

FIG. 3 is a circuit diagram corresponding to a unit group of the imaging chip 113. In FIG. 3, a rectangle surrounded by a dotted line typically represents a circuit corresponding to one pixel. At least a part of each transistor described below corresponds to the transistor 105 of FIG.

As described above, the unit group 131 is formed from 16 pixels. The 16 PD 104s corresponding to each pixel are connected to the transfer transistor 302, respectively. The gate of each transfer transistor 302 is connected to the TX wiring 307 to which the transfer pulse is supplied. In the present embodiment, the TX wiring 307 is commonly connected to the 16 transfer transistors 302.

The drain of each transfer transistor 302 is connected to the source of each corresponding reset transistor 303, and the so-called floating diffusion FD (charge detection unit) between the drain of the transfer transistor 302 and the source of each reset transistor 303 is an amplification transistor 304. Connected to the gate. The drain of each reset transistor 303 is connected to the Vdd wiring 310 to which the power supply voltage is supplied. The gate of each reset transistor 303 is connected to the reset wiring 306 to which the reset pulse is supplied. In the present embodiment, the reset wiring 306 is commonly connected to the 16 reset transistors 303.

The drain of each amplification transistor 304 is connected to the Vdd wiring 310 to which the power supply voltage is supplied. Also, the source of each amplification transistor 304 is connected to the drain of each corresponding selection transistor 305. The gate of each selection transistor 305 is connected to the decoder wiring 308 to which the selection pulse is supplied. In the present embodiment, the decoder wiring 308 is provided independently for each of the 16 selection transistors 305. Then, the source of each selection transistor 305 is connected to the common output wiring 309. The load current source 311 supplies current to the output wiring 309. That is, the output wiring 309 for the selection transistor 305 is formed by the source follower. The load current source 311 may be provided on the imaging chip 113 side or the signal processing chip 111 side.

Here, the flow from the start of charge accumulation to the pixel output after the end of accumulation will be described. A reset pulse is applied to the reset transistor 303 through the reset wiring 306. At the same time, a transfer pulse is applied to the transfer transistor 302 through the TX wiring 307. As a result, the potentials of the PD 104 and the floating diffusion FD are reset.

When the application of the transfer pulse is released, the PD 104 converts the received incident light into an electric charge and accumulates it. After that, when the transfer pulse is applied again in the state where the reset pulse is not applied, the electric charge accumulated in the PD 104 is transferred to the floating diffusion FD. As a result, the potential of the floating diffusion FD changes from the reset potential to the signal potential after charge accumulation. Then, when the selection pulse is applied to the selection transistor 305 through the decoder wiring 308, the fluctuation of the signal potential of the floating diffusion FD is transmitted to the output wiring 309 via the amplification transistor 304 and the selection transistor 305. By the operation of such a circuit, the pixel signal corresponding to the reset potential and the signal potential is output from the unit pixel to the output wiring 309.

As shown in FIG. 3, in the present embodiment, the reset wiring 306 and the TX wiring 307 are common to the 16 pixels forming the unit group 131. That is, the reset pulse and the transfer pulse are applied to all 16 pixels at the same time. Therefore, all the pixels forming the unit group 131 start the charge accumulation at the same timing and end the charge accumulation at the same timing. However, the pixel signal corresponding to the accumulated charge is selectively output to the output wiring 309 by sequentially applying the selection pulse to each selection transistor 305. Further, the reset wiring 306, the TX wiring 307, and the output wiring 309 are separately provided for each unit group 131.

By configuring the circuit with the unit group 131 as a reference in this way, the charge accumulation time can be controlled for each unit group 131. In other words, pixel signals with different charge accumulation times can be output between the unit groups 131. Furthermore, while one unit group 131 is made to perform one charge accumulation, the other unit group 131 is made to repeat the charge accumulation many times to output a pixel signal each time. It is also possible to output each frame for moving images at different frame rates among the unit groups 131.

FIG. 4 is a block diagram showing a functional configuration of the image sensor 100. The analog multiplexer 411 sequentially selects 16 PD 104s forming a unit group 131. Then, the multiplexer 411 outputs the pixel signals of the 16 PD 104s to the output wiring 309 provided corresponding to the unit group 131. The multiplexer 411 is formed on the imaging chip 113 together with the PD 104.

The pixel signal of the analog signal output via the multiplexer 411 is amplified by the amplifier 412 formed on the signal processing chip 111. Then, the pixel signal amplified by the amplifier 412 is generated by a signal processing circuit 413 formed on the signal processing chip 111, which performs correlated double sampling (CDS) and analog / digital (Analog / Digital) conversion. Along with the signal processing of correlated double sampling, A / D conversion (conversion from analog signal to digital signal) is performed. The noise of the pixel signal is reduced by performing the signal processing of the correlation double sampling of the pixel signal in the signal processing circuit 413. The A / D converted pixel signal is passed to the demultiplexer 414 and stored in the pixel memory 415 corresponding to each pixel. The demultiplexer 414 and the pixel memory 415 are formed on the memory chip 112.

The arithmetic circuit 416 processes the pixel signal stored in the pixel memory 415 and hands it over to the image processing unit in the subsequent stage. The arithmetic circuit 416 may be provided on the signal processing chip 111 or the memory chip 112. Note that FIG. 4 shows the connections for one unit group 131, but in reality, these exist for each unit group 131 and operate in parallel. However, the arithmetic circuit 416 does not have to exist for each unit group 131. For example, one arithmetic circuit 416 may sequentially refer to the values of the pixel memory 415 corresponding to each unit group 131 for sequential processing.

As described above, the output wiring 309 is provided corresponding to each of the unit groups 131. The image pickup device 100 is a stack of an image pickup chip 113, a signal processing chip 111, and a memory chip 112. Therefore, by using the electrical connection between the chips using the bumps 109 for the output wiring 309, the wiring can be routed without enlarging each chip in the plane direction.

Next, a block set in the pixel region 113A (see FIG. 2) of the image sensor 100 will be described. In the present embodiment, the pixel region 113A of the image sensor 100 is divided into a plurality of blocks. The plurality of blocks are defined to include at least one unit group 131 per block. The pixels included in each block are controlled by different control parameters for each block. That is, pixel signals having different control parameters are acquired between the pixel group included in a certain block and the pixel group included in another block. The control parameters include, for example, charge accumulation time or number of accumulations, frame rate, gain, thinning rate (pixel thinning rate), number of additional rows or columns to add pixel signals (pixel addition number), and digitization bits. The number etc. can be given. Further, the control parameter may be a parameter in image processing after acquiring an image signal from a pixel.

Here, the charge accumulation time means the time from the start to the end of the charge accumulation of the PD 104. This charge accumulation time is also referred to as an exposure time or a shutter speed (shutter speed). The number of electric charges accumulated means the number of times the PD 104 accumulates electric charges per unit time. The frame rate is a value representing the number of frames processed (displayed or recorded) per unit time in a moving image. The unit of frame rate is fps (Frames Per Second). The higher the frame rate, the smoother the movement of the subject (that is, the object to be imaged) in the moving image.

Further, the gain means the gain rate (amplification rate) of the amplifier 412. By changing this gain, the ISO sensitivity can be changed. This ISO sensitivity is a standard for photographic film established by ISO, and indicates how weak a photographic film can record. However, in general, ISO sensitivity is also used when expressing the sensitivity of the image sensor 100. In this case, the ISO sensitivity is a value representing the ability of the image sensor 100 to capture light. Increasing the gain also improves the ISO sensitivity. For example, if the gain is doubled, the electric signal (pixel signal) is also doubled, and even if the amount of incident light is halved, the brightness becomes appropriate. However, when the gain is increased, the noise contained in the electric signal is also amplified, so that the noise increases.

The thinning rate refers to the ratio of the number of pixels in which the pixel signal is not read out to the total number of pixels in a predetermined area. For example, when the thinning rate of the predetermined area is 0, it means that the pixel signal is read out from all the pixels in the predetermined area. Further, when the thinning rate of the predetermined area is 0.5, it means that the pixel signal is read out from half the pixels in the predetermined area. Specifically, when the unit group 131 is a Bayer array, one unit of the Bayer array is placed in the vertical direction, that is, it is read as a pixel in which a pixel signal is alternately read out by two pixels (two rows each) in pixel units. Pixels that are not output are set. When the pixel signal is thinned out, the resolution of the image is lowered. However, since the image sensor 100 has 20 million or more pixels arranged, an image can be displayed with 10 million or more pixels even if thinning is performed at a thinning rate of 0.5, for example. Therefore, it is considered that the user (photographer) does not mind the decrease in resolution.

Further, the number of lines to be added means the number of pixels (number of lines) in the vertical direction to be added when the pixel signals of pixels adjacent to each other in the vertical direction are added. The number of columns to be added means the number of pixels in the horizontal direction (number of columns) to be added when the pixel signals of pixels adjacent to each other in the horizontal direction are added. Such addition processing is performed, for example, in the arithmetic circuit 416. By performing the process of adding the pixel signals of a predetermined number of pixels adjacent in the vertical direction or the horizontal direction by the arithmetic circuit 416, the same effect as the process of reading out the pixel signals by thinning out at a predetermined thinning rate is obtained. In the above-mentioned addition process, the average value may be calculated by dividing the addition value by the number of rows or columns added by the arithmetic circuit 416.

The number of bits for digitization refers to the number of bits when the signal processing circuit 413 converts an analog signal into a digital signal in A / D conversion. As the number of bits of the digital signal increases, the brightness and color change are expressed in more detail.

In the present embodiment, the accumulation condition means a condition relating to the accumulation of electric charge in the image sensor 100. Specifically, the storage condition refers to the charge storage time or the number of times of storage, the frame rate, and the gain among the above-mentioned control parameters. Since the frame rate can change depending on the charge accumulation time and the number of times of accumulation, the frame rate is included in the accumulation condition. In addition, the amount of light with proper exposure changes according to the gain, and the charge accumulation time or the number of times of accumulation may change according to the amount of light with proper exposure. Therefore, the gain is included in the accumulation condition.

Further, in the present embodiment, the imaging condition means a condition relating to imaging of a subject. Specifically, the imaging condition refers to a control parameter including the above-mentioned accumulation condition. The image pickup conditions include control parameters for controlling the image sensor 100 (for example, charge accumulation time or number of times, frame rate, gain), as well as control parameters for controlling reading of a signal from the image sensor 100 (for example,). For example, the thinning rate, the number of added rows or columns for adding pixel signals), control parameters for processing the signal from the image sensor 100 (for example, the number of digitized bits, the image processing unit 30 described later performs image processing. (Control parameters for executing) are also included.

FIG. 5 is a diagram showing an arrangement pattern in each block. The arrangement pattern shown in FIG. 5 is an arrangement pattern in which the pixel region 113A is divided into four imaging regions (first imaging region, second imaging region, third imaging region, and fourth imaging region). In this arrangement pattern, in the pixel area 113A, the block of the odd row (2n-1) in the column (4m-3) three columns before the column of the multiple of 4 and the column one column before the column of the multiple of 4 The first imaging region is composed of blocks of even rows (2n) in (4m-1). Further, in the pixel area 113A, the blocks of the odd row (2n-1) in the column (4m-2) two columns before the column of the multiple of 4 and the even rows (2n) in the column (4m) of the multiple of 4 ) Consists of a second imaging region. Further, in the pixel area 113A, the block of the odd row (2n-1) in the column (4m-1) one column before the column of the multiple of 4 and the column (4m-) three columns before the column of the multiple of 4 The third imaging region is composed of the blocks of the even number of rows (2n) in 3). Further, in the pixel area 113A, a block of odd rows (2n-1) in a column (4 m) that is a multiple of 4 and an even row (2n) in a column (4 m-2) that is two columns before the column that is a multiple of 4. ) Consists of a fourth imaging region. m and n are positive integers (m = 1,2,3, ..., n = 1,2,3, ...).

In FIG. 5, a small number of blocks are set in the pixel area 113A in order to make it easier to see the arrangement of blocks in each imaging region, but the number of blocks larger than the number of blocks shown in FIG. 5 is pixelated. It may be set in the area 113A.

In the case of such an arrangement pattern, the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region are evenly arranged in the pixel region (imaging region) 113A, respectively. Further, the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region each have the same area. However, the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region need only be arranged on the entire surface in the pixel region 113A, and are not evenly arranged in the pixel region 113A. May be good. Further, the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region do not have to have the same area.

In the case of the arrangement pattern as shown in FIG. 5, since the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region are arranged at different positions (that is, the positions of the respective imaging regions are displaced). Therefore, different subject images are incident on the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region. Therefore, the images shown by the image data generated in each of the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region are different subject images. However, the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region are all arranged in the pixel region 113A, respectively. Therefore, the images shown by the image data generated in each of the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region look like the same subject image to the user.

In the present embodiment, each image sensor (photoelectric conversion element and its associated circuit) provided in each pixel of the first image pickup region is referred to as a first image sensor, and each image sensor provided in each pixel of the second image pickup region is referred to as a first image sensor. It is called a second image sensor, each image sensor provided in each pixel of the third image sensor is referred to as a third image sensor, and each image sensor provided in each pixel of the fourth image sensor is referred to as a fourth image sensor. That is, the image pickup element 100 is divided into a plurality of first image pickup elements, a plurality of second image pickup elements, a plurality of third image pickup elements, and a plurality of fourth image pickup elements.

Further, in the present embodiment, the first image sensor, the second image sensor, the third image sensor, and the fourth image sensor are imaged under different imaging conditions. The image pickup condition of the first image sensor is referred to as a first image pickup condition, the image pickup condition of the second image sensor is referred to as a second image pickup condition, and the image pickup condition of the third image sensor is referred to as a third image pickup condition of the fourth image sensor. The imaging condition is referred to as a fourth imaging condition.

FIG. 6 is a cross-sectional view showing a schematic configuration of a digital camera 1 which is an example of an electronic device. The digital camera 1 of the present embodiment includes a lens unit 10 and a camera body 2. The lens unit 10 is an interchangeable lens. The camera body 2 is provided with a body-side mount portion 80A for mounting the lens portion 10. Further, the lens portion 10 is provided with a lens side mount portion 80B corresponding to the body side mount portion 80A. When the user joins the body-side mount portion 80A and the lens-side mount portion 80B, the lens portion 10 is attached to the camera body 2. When the lens portion 10 is attached to the camera body 2, the electrical contact 81A provided on the body-side mount portion 80A and the electrical contact 81B provided on the lens-side mount portion 80B are electrically connected.

The lens unit 10 includes a photographing optical system 11, an aperture 14, and a lens drive control device 15. The imaging optical system 11 includes a lens 11a, a zooming lens 11b, and a focusing lens 11c. The lens drive control device 15 includes a lens-side CPU (Central Processing Unit), a memory, and a drive control circuit. The lens drive control device 15 is electrically connected to the system control unit 70 on the camera body 2 side via the electrical contacts 81A and 81B, and transmits lens information regarding the optical characteristics of the photographing optical system 11 provided in the lens unit 10. And the reception of control information for driving the zooming lens 11b, the focusing lens 11c, and the aperture 14.

The lens-side CPU of the lens drive control device 15 causes the drive control circuit to execute drive control of the focusing lens 11c based on the control information transmitted from the system control unit 70 in order to adjust the focus of the photographing optical system 11. The lens-side CPU of the lens drive control device 15 causes the drive control circuit to execute drive control of the zooming lens 11b based on the control information transmitted from the system control unit 70 in order to perform the zooming adjustment. The diaphragm 14 is arranged along the optical axis of the photographing optical system 11. The diaphragm 14 forms an aperture having a variable aperture diameter at the center of the optical axis for adjusting the amount of light and the amount of blur. The lens-side CPU of the lens drive control device 15 causes the drive control circuit to execute drive control of the diaphragm 14 based on control information transmitted from the system control unit 70 in order to adjust the aperture diameter of the diaphragm 14.

The camera body 2 includes an image pickup unit 20, an image processing unit 30, a display unit 50, a storage unit 60, and a system control unit 70. The image pickup unit 20 has an image pickup element 100. The light beam emitted from the photographing optical system 11 of the lens unit 10 is incident on the image sensor 100. The image pickup device 100 photoelectrically converts the incident luminous flux to generate a pixel signal (pixel signal is included in the image data) of each pixel of the image pickup device. RAW data (RAW data is also included in the image data) composed of pixel signals of each pixel is sent from the imaging unit 20 to the image processing unit 30. The image processing unit 30 performs various image processing on the RAW data composed of the pixel signals of each pixel to generate image data in a predetermined file format (for example, JPEG format). The display unit 50 displays the image data generated by the image processing unit 30. The storage unit 60 stores the image data generated by the image processing unit 30.

The "image data" may be referred to as an "image signal". In addition, the image includes a still image, a moving image, and a live view image. The live view image is an image in which the image data generated by the image processing unit 30 is sequentially output to the display unit 50 and displayed on the display unit 50. The live view image is used for the user to confirm the image of the subject captured by the imaging unit 20. The live view image is also called a through image or a preview image.

The system control unit 70 controls the overall processing and operation of the digital camera 1. The details of the processing and operation of the system control unit 70 and the details of the configuration inside the camera body 2 will be described with reference to FIG. 7 below.

FIG. 7 is a block diagram showing the configuration of the digital camera 1 according to the first embodiment. As shown in FIG. 7, the digital camera 1 includes a camera body 2 and a lens unit 10. As described above, the lens unit 10 is an interchangeable lens that can be attached to and detached from the camera body 2. Therefore, the digital camera 1 does not have to include the lens unit 10. However, the lens unit 10 may be integrated with the digital camera 1. The lens unit 10 guides the luminous flux from the subject to the imaging unit 20 in a state of being connected to the camera body 2.

As described above, the lens unit 10 has a lens drive control device 15 (see FIG. 6). Further, the lens unit 10 has a plurality of lens groups as the photographing optical system 11, that is, a lens 11a, a zooming lens 11b, and a focusing lens 11c. When the lens unit 10 is connected to the camera body 2, the lens drive control device 15 transmits the lens information stored in the memory to the system control unit 70 of the camera body 2. Further, the lens drive control device 15 receives control information transmitted from the system control unit 70 when the lens unit 10 is connected to the camera body 2. The lens drive control device 15 controls the drive of the zooming lens 11b, the focusing lens 11c, and the aperture 14 based on the control information.

As shown in FIG. 7, the camera body 2 includes an image pickup unit 20, an image processing unit 30, a work memory 40, a display unit 50, an operation unit 55, a recording unit 60, a system control unit 70, and a strobe 90.

The image pickup unit 20 includes an image pickup element 100 and a drive unit 21. The drive unit 21 is a control circuit that controls the drive of the image sensor 100 according to an instruction from the system control unit 70. Here, the drive unit 21 controls the timing (or timing cycle) of applying the reset pulse and the transfer pulse to the reset transistor 303 and the transfer transistor 302, respectively, to set the charge accumulation time or the number of times of accumulation, which is a control parameter. Control. Further, the drive unit 21 controls the frame rate by controlling the timing (or timing cycle) of applying the reset pulse, the transfer pulse, and the selection pulse to the reset transistor 303, the transfer transistor 302, and the selection transistor 305, respectively. To do. Further, the drive unit 21 controls the thinning rate by setting the pixels to which the reset pulse, the transfer pulse, and the selection pulse are applied.

Further, the drive unit 21 controls the ISO sensitivity of the image sensor 100 by controlling the gain (also referred to as a gain rate or amplification factor) of the amplifier 412. Further, the drive unit 21 sets the number of addition rows or the number of addition columns to which the pixel signals are added by sending an instruction to the arithmetic circuit 416. Further, the drive unit 21 sets the number of digitization bits by sending an instruction to the signal processing circuit 413. Further, the drive unit 21 sets an area in the pixel area (imaging area) 113A of the image sensor 100 in block units. In this way, the drive unit 21 has a function of an image sensor control unit that causes the image sensor 100 to take an image for each of a plurality of blocks under different imaging conditions and output a pixel signal. The system control unit 70 gives instructions such as the position, shape, and range of the block to the drive unit 21.

The image sensor 100 delivers the pixel signal from the image sensor 100 to the image processing unit 30. The image processing unit 30 uses the work memory 40 as a workspace to perform various image processing on RAW data composed of pixel signals of each pixel to generate image data in a predetermined file format (for example, JPEG format). .. The image processing unit 30 executes the following image processing. For example, the image processing unit 30 generates an RGB image signal by performing color signal processing (color tone correction) on the signal obtained in the Bayer array. Further, the image processing unit 30 performs image processing such as white balance adjustment, sharpness adjustment, gamma correction, and gradation adjustment on the RGB image signal. Further, the image processing unit 30 performs a process of compressing in a predetermined compression format (JPEG format, MPEG format, etc.) as necessary. The image processing unit 30 outputs the generated image data to the recording unit 60. Further, the image processing unit 30 outputs the generated image data to the display unit 50.

The parameters referred to when the image processing unit 30 performs image processing are also included in the control parameters (imaging conditions). For example, parameters such as color signal processing (color tone correction), white balance adjustment, gradation adjustment, and compression rate are included in the control parameters. The signal read from the image sensor 100 changes according to the charge accumulation time and the like, and the parameters referred to when performing image processing also change according to the change in the signal. The image processing unit 30 sets different control parameters for each block, and executes image processing such as color signal processing based on these control parameters.

The image processing unit 30 extracts frames at predetermined timings from a plurality of frames obtained from the imaging unit 20 in time series. Alternatively, the image processing unit 30 discards the frames for each predetermined timing among the plurality of frames obtained from the imaging unit 20 in time series. As a result, the amount of data can be reduced, so that the load of post-stage processing can be reduced. Further, the image processing unit 30 calculates one or a plurality of frames to be interpolated between the frames based on the plurality of frames obtained from the imaging unit 20 in time series. Then, the image processing unit 30 adds the calculated one or a plurality of frames between the frames. As a result, it is possible to play a moving image with smoother movement during moving image playback. Further, the drive unit 21 is configured to control the thinning rate, but the configuration is not limited to this. For example, the drive unit 21 reads pixel signals from all the pixels, but the image processing unit 30 or the arithmetic circuit 416 may control the thinning rate by discarding a predetermined pixel signal among the read pixel signals. Good.

In the present embodiment, the image processing unit 30 includes an image generation unit 31 as shown in FIG. 7. The image generation unit 31 generates image data by performing various image processing on the RAW data composed of the pixel signals of each pixel output from the image pickup unit 20. The image generation unit 31 generates the first image data based on the RAW data composed of the pixel signals of the first imaging region, and generates the second image data based on the RAW data composed of the pixel signals of the second imaging region. The third image data is generated based on the RAW data composed of the pixel signals of the third imaging region, and the fourth image data is generated based on the RAW data composed of the pixel signals of the fourth imaging region.

The work memory 40 temporarily stores image data and the like when image processing is performed by the image processing unit 30. The display unit 50 displays images (still images, moving images, live view images) captured by the imaging unit 20 and various types of information. The display unit 50 has a display surface (display panel) 51 such as a liquid crystal display panel. A touch panel (selection unit) 52 is formed on the display surface 51 of the display unit 50. The touch panel 52 outputs a signal indicating the position touched by the user to the system control unit 70 when the user performs an operation such as selecting a menu.

The operation unit 55 is a release switch (a switch pressed when shooting a still image), a moving image switch (a switch pressed when shooting an operation), various operation switches, and the like operated by the user. The operation unit 55 outputs a signal corresponding to the operation by the user to the system control unit 70. The recording unit 60 has a card slot into which a storage medium such as a memory card can be mounted. The recording unit 60 stores the image data and various data generated by the image processing unit 30 in the recording medium installed in the card slot. Further, the recording unit 60 has an internal memory. The recording unit 60 can also record the image data and various data generated by the image processing unit 30 in the internal memory.

The system control unit 70 controls the overall processing and operation of the digital camera 1. The system control unit 70 has a body-side CPU (Central Processing Unit). In the present embodiment, the system control unit 70 divides the imaging surface (pixel region 113A) of the image sensor 100 (imaging chip 113) into a plurality of blocks, and the charge accumulation time (or the number of charge accumulations) and the frame rate differ between the blocks. , Get the image with the gain. Therefore, the system control unit 70 instructs the drive unit 21 of the position, shape, range, and storage conditions for each block.

Further, the system control unit 70 causes the system control unit 70 to acquire an image with different thinning rates between blocks, the number of added rows or columns for adding pixel signals, and the number of digitized bits. Therefore, the system control unit 70 instructs the drive unit 21 of the imaging conditions (thinning rate, the number of additional rows or columns for adding the pixel signals, and the number of digitization bits) for each block. Further, the image processing unit 30 executes image processing under different imaging conditions (control parameters such as color signal processing, white balance adjustment, gradation adjustment, compression rate, etc.) between blocks. Therefore, the system control unit 70 instructs the image processing unit 30 of imaging conditions (control parameters such as color signal processing, white balance adjustment, gradation adjustment, and compression rate) for each block.

Further, the system control unit 70 causes the recording unit 60 to record the image data generated by the image processing unit 30. Further, the system control unit 70 causes the display unit 50 to display an image by outputting the image data generated by the image processing unit 30 to the display unit 50. Further, the system control unit 70 reads the image data recorded in the recording unit 60 and outputs the image data to the display unit 50 so that the display unit 50 displays the image. The image displayed on the display unit 50 includes a still image, a moving image, and a live view image.

Further, the system control unit 70 causes the lens drive control device 15 to execute the drive control of the focusing lens 11c and the drive control of the aperture 14 by outputting the control information to the lens drive control device 15. The system control unit 70 is realized by the body-side CPU executing processing based on the control program.

In the present embodiment, as shown in FIG. 7, the system control unit 70 includes a control unit 71, a selection unit 72, a setting unit 73, and a division unit 74. The control unit 71 controls the display unit 50 to output the image data generated by the image generation unit 31 and display the image on the display surface 51 of the display unit 50. Further, the control unit 71 controls to display a preset menu image (see FIG. 8) on the display surface 51 of the display unit 50.

The selection unit 72 selects any one of the four display areas (first display area 511, second display area 512, third display area 513, and fourth display area 514) in response to a touch operation of the touch panel 52 by the user. Control the selection. Further, the setting unit 73 controls to set the imaging conditions (including the accumulation conditions) in response to the touch operation of the touch panel 52 by the user or automatically. Here, the setting unit 73 can set the same imaging conditions in all the pixel regions 113A of the image sensor 100. In addition, the setting unit 73 can set different imaging conditions in each imaging region (first imaging region, second imaging region, third imaging region, and fourth imaging region) shown in FIG. Further, the setting unit 73 controls the image pickup device 100 to perform imaging under predetermined imaging conditions or imaging conditions changed according to the operation of the user. Further, the dividing unit 74 performs a process of dividing the pixel region 113A of the image sensor 100 into a first imaging region, a second imaging region, a third imaging region, and a fourth imaging region as shown in FIG.

The strobe 90 is a light emitting device that emits (flashes) light when taking a picture. The strobe 90 emits light with a predetermined amount of light based on an instruction signal from the system control unit 70.

FIG. 8 is a diagram showing a display unit 50 according to the digital camera 1 of the present embodiment. As shown in FIG. 8, the display unit 50 has a display surface 51. The display surface 51 is provided with an image display area 510 and an operation button display area 520. The image display area 510 is an area for displaying an image indicated by image data generated by the imaging unit 20. For example, a still image, a moving image, and a live view image are displayed in the image display area 510. The operation button display area 520 is an area for displaying the menu image 520M for the user to set the imaging conditions and the like. The image display area 510 and the operation button display area 520 are provided in one display surface 51.

The image display area 510 is divided into a plurality of display areas so that a plurality of images can be displayed. For example, it is divided into four display areas so as to display each image indicated by the four image data generated by the imaging unit 20. Of the four display areas, the upper left display area is referred to as the first display area 511. Of the four display areas, the upper right display area is referred to as a second display area 512. Of the four display areas, the lower left display area is referred to as a third display area 513. Of the four display areas, the lower right display area is referred to as the fourth display area 514.

In the example shown in FIG. 8, the first display area 511, the second display area 512, the third display area 513, and the fourth display area 514 are display areas having the same display area, respectively. Further, the first display area 511, the second display area 512, the third display area 513, and the fourth display area 514 may be display areas having different display areas. For example, the display area of the first display area may be larger than the display area of the second display area. The display area of the first display area may be larger than the display area of the third display area. The display area of the first display area may be larger than the display area of the fourth display area. The display area of the second display area may be larger than the display area of the first display area. The display area of the second display area may be larger than the display area of the third display area. The display area of the second display area may be larger than the display area of the fourth display area. The display area of the third display area may be larger than the display area of the first display area. The display area of the third display area may be larger than the display area of the second display area. The display area of the third display area may be larger than the display area of the fourth display area. The display area of the fourth display area may be larger than the display area of the first display area. The display area of the fourth display area may be larger than the display area of the second display area. The display area of the fourth display area may be larger than the display area of the third display area.

The first display area 511 is an area for displaying an image (this image is referred to as a first image) represented by the image data generated in the first imaging region shown in FIG. The second display area 512 is an area for displaying an image (this image is referred to as a second image) represented by the image data generated in the second imaging region shown in FIG. The third display area 513 is an area for displaying an image (this image is referred to as a third image) represented by the image data generated in the third imaging region shown in FIG. The fourth display area 514 is an area for displaying an image (this image is referred to as a fourth image) represented by the image data generated in the fourth imaging region shown in FIG. As described above, since the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region shown in FIG. 5 are arranged evenly over the entire pixel region 113A, the first image, The second image, the third image, and the fourth image appear to be images of the same subject. However, as described above, the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region shown in FIG. 5 are imaged under different imaging conditions. Therefore, the brightness of the subject, the blurring of the subject, the smoothness of the movement of the subject in the moving image, and the like change depending on the imaging conditions.

The first image includes a first live view image, a first still image, and a first moving image. In addition, the second image includes a second live view image, a second still image, and a second moving image. Further, the third image includes a third live view image, a third still image, and a third moving image. Further, the fourth image includes a fourth live view image, a fourth still image, and a fourth moving image.

The display unit 50 includes a touch panel 52. The touch panel 52 is provided on the display surface 51. In the touch panel 52, the first touch area 511a is formed so as to overlap the first display area 511. Further, the second touch area 512a is formed so as to overlap the second display area 512. Further, the third touch area 513a is formed so as to overlap the third display area 513. Further, the fourth touch region 514a is formed so as to overlap the fourth display region 514. When the user detects that the first touch area 511a, the second touch area 512a, the third touch area 513a, and the fourth touch area 514a have been pressed (touched), the pressed positions (any touch area). Is it?) Is output to the system control unit 70.

The operation button display area 520 is provided in the vicinity of the image display area 510. In the operation button display area 520, a menu image 520M for the user to select a display area and set an imaging condition, a shooting mode, and the like is displayed. The menu image 520M includes a selection button image 521, an ISO sensitivity button image 522, a shutter speed button image 523, a picture control button image 524, and an imaging mode button image 525. The selection button image 521 is one of the first image, the second image, the third image, and the fourth image displayed by the user in each of the first display area, the second display area, the third display area, and the fourth display area. Used when selecting either. The ISO sensitivity button image 522 is used when the user sets the ISO sensitivity (that is, gain). The shutter speed button image 523 is used when the user sets the shutter speed (that is, the exposure time). The shutter speed corresponds to the charge accumulation time. The picture control button image 524 is used when the user sets (adjusts) image characteristics such as image tone, hue, and contrast. The imaging mode button image 525 is used when the user selects whether to manually set the imaging conditions or to automatically set the imaging conditions.

In the touch panel 52, the touch area 521a is formed so as to overlap the selection button image 521. The touch region 522a is formed so as to overlap the ISO sensitivity button image 522. The touch area 523a is formed so as to overlap the shutter speed button image 523. The touch area 524a is formed so as to overlap the picture control button image 524. The touch region 525a is formed so as to overlap the image pickup mode button image 525. When the touch area 521a, the touch area 521a, the touch area 521a, and the touch area 525a are detected to be pressed (touched) by the user, a detection signal indicating the pressed position (which touch area) is indicated. Is output to the system control unit 70.

Next, the still image shooting operation of the digital camera 1 according to the first embodiment will be described. FIG. 9 is a flowchart for explaining a shooting operation executed by the system control unit 70 of the first embodiment. In addition, FIGS. 10, 11, 12, and 13 are views showing a display example of the display surface 51 in the first embodiment.

In the process shown in FIG. 9, after the power is turned on to the digital camera 1, when the user operates the operation unit 55 or the like to start shooting, the division unit 74 in the pixel region 113A of the image sensor 100. , The setting is divided into a plurality of imaging regions (first imaging region, second imaging region, third imaging region, fourth imaging region) as shown in FIG. Further, the setting unit 73 sets predetermined standard imaging conditions for the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region set by the dividing unit 74 (step S1). ). For example, the setting unit 73 sets ISO sensitivity (“100”), shutter speed (“1/2 second”), and the like as standard imaging conditions for the first imaging region. In addition, the setting unit 73 sets ISO sensitivity (“200”), shutter speed (“1/100 second”), and the like as standard imaging conditions for the second imaging region. Further, the setting unit 73 sets ISO sensitivity (“400”), shutter speed (“1/500 second”), and the like as standard imaging conditions for the third imaging region. Further, the setting unit 73 sets ISO sensitivity (“800”), shutter speed (“1/1000 second”), and the like as standard imaging conditions for the fourth imaging region.

Next, the system control unit 70 starts the shooting operation (step S2). When shooting is started, the control unit 71 causes the first live view image indicated by the first image data generated in the first image pickup region of the image pickup element 100 to be displayed in the first display area 511 of the display surface 51. The control unit 71 displays the second live view image indicated by the second image data generated in the second image pickup region of the image pickup device 100 on the second display region 512 of the display surface 51. The control unit 71 displays the third live view image indicated by the third image data generated in the third image pickup region of the image pickup device 100 on the third display region 513 of the display surface 51. The control unit 71 displays the fourth live view image indicated by the fourth image data generated in the fourth image pickup region of the image pickup device 100 on the fourth display region 514 of the display surface 51 (step S3). In the example shown in FIG. 10, the first live view image and the second live view image showing the live view image of the waterfall in the first display area 511, the second display area 512, the third display area 513, and the fourth display area 514, respectively. , The third live view image and the fourth live view image are displayed. The first imaging region, the second imaging region, the third imaging region, and the fourth imaging region are imaged under different imaging conditions. Therefore, the first display area 511, the second display area 512, the third display area 513, and the fourth display area 514 have different live performances such as subject brightness, subject (moving moving subject) blur, and contrast. The view image is displayed.

The user can use the first live view image, the second live view image, and the second live view image displayed in the first display area 511, the second display area 512, the third display area 513, and the fourth display area 514 of the image display area 510, respectively. By comparing the 3 live view images and the 4th live view image, it is possible to confirm the difference in the images due to the difference in the imaging conditions. Then, when the user selects any one of the first live view image, the second live view image, the third live view image, and the fourth live view image, the user selects the selection button image 521 (that is, the touch area 521a). Touch with your finger. As a result, the display area can be selected, that is, the four touch areas (touch area 511a, touch area 512a, touch area 513a, and touch area 514a) of the touch panel 52 can detect the touch operation. After that, the user touches any of the four display areas (first display area 511, second display area 512, third display area 513, and fourth display area 514) with a finger to obtain one display area. Select. The touch panel 52 outputs a detection signal corresponding to the touch area touched by the user to the system control unit 70.

The selection unit 72 recognizes the display area selected by the user based on the detection signal from the touch panel 52. In the examples shown in FIGS. 11, 12, and 13, the first display area 511 is selected by the user. The selection unit 72 determines whether or not any of the first display area 511, the second display area 512, the third display area 513, and the fourth display area 514 has been selected by the user (step S4). When it is determined by the user that any one of the first display area 511, the second display area 512, the third display area 513, and the fourth display area 514 is selected, the selection unit 72 displays the display selected by the user. An area (first display area 511 in FIG. 11) is set (step S5). Specifically, the selection unit 72 outputs an instruction signal indicating to the drive unit 21 the position of the block corresponding to the display area selected by the user.

The user can change the imaging conditions in the selected display region (that is, any one of the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region). The setting unit 72 determines whether or not the imaging conditions have been changed by the user (step S6). When the selection unit 72 determines that the imaging conditions have been changed by the user, the selection unit 72 sets the changed imaging conditions (step S7).

For example, when setting the ISO sensitivity as the imaging condition of the first display area 511, the user touches the ISO sensitivity button image 522 (that is, the touch area 522a). The touch panel 52 outputs a detection signal corresponding to the touch area 522a touched by the user to the system control unit 70. As shown in FIG. 11, the control unit 71 displays a plurality of ISO sensitivity values next to the ISO sensitivity button image 522. In the example shown in FIG. 11, "100", "200", "400", "800", and "1600" are displayed as the ISO sensitivity. The setting unit 73 newly sets the touch area on the touch panel 52 so as to overlap the area of each value of the ISO sensitivity. The user touches any of the ISO sensitivity values. The touch panel 52 outputs a detection signal corresponding to the touch area touched by the user to the system control unit 70. The setting unit 73 sets the value of the ISO sensitivity touched by the user. Specifically, the setting unit 73 outputs an instruction signal indicating a gain according to the ISO sensitivity selected by the user to the drive unit 21.

Further, when the shutter speed (charge accumulation time) is set as the imaging condition of the first display area 511, the user performs the same operation as the setting of the ISO sensitivity. That is, when setting the shutter speed as an imaging condition, the user touches the shutter speed button image 523 (that is, the touch area 523a). The touch panel 52 outputs a detection signal corresponding to the touch area 523a touched by the user to the system control unit 70. The control unit 71 displays a plurality of shutter speed values next to the shutter speed button image 523. The user touches one of the shutter speed values. The setting unit 73 sets the value of the shutter speed touched by the user. Specifically, the setting unit 73 outputs an instruction signal indicating the shutter speed selected by the user to the drive unit 21.

Further, when setting the picture control as the imaging condition of the first display area 511, the user touches the picture control button image 524 (that is, the touch area 524a). The touch panel 52 outputs a detection signal corresponding to the touch area 524a touched by the user to the system control unit 70. As shown in FIG. 12, the control unit 71 displays a plurality of types of picture control next to the picture control button image 524. In the example shown in FIG. 12, "standard", "neutral", "landscape", and "vivid" are displayed as the types of picture control. The "standard" is adjusted by the image processing unit 30 to a standard image having no bias in the strength, contrast, brightness, color depth, etc. of the outline of the subject. In "neutral", the image processing unit 30 faithfully reproduces the gradation and hue peculiar to the subject, and adjusts the image to be the closest to the actual subject. In the "landscape", the image processing unit 30 adjusts a natural landscape, a cityscape, etc. into an image having a three-dimensional effect with high gradation. “Vivid” is adjusted by the image processing unit 30 to a colorful image in which the outline and contrast of the subject are emphasized.

The setting unit 73 newly sets a touch area on the touch panel 52 so as to overlap with the area of the type of picture control. The user touches one of the picture control types. The touch panel 52 outputs a detection signal corresponding to the touch area touched by the user to the system control unit 70. The setting unit 73 sets the type of picture control touched by the user. Specifically, the setting unit 73 outputs an instruction signal indicating the type of the picture control selected by the user to the image processing unit 30.

When setting the shooting mode as the imaging condition of the first display area 511, the user touches the imaging mode button image 525 (that is, the touch region 525a). The touch panel 52 outputs a detection signal corresponding to the touch area 525a touched by the user to the system control unit 70. As shown in FIG. 13, the control unit 71 displays “P”, “S”, “A”, and “M” next to the image pickup mode button image 525. Note that "P" means P mode (program auto), which is a mode in which the aperture value and the shutter speed are automatically determined so as to obtain an appropriate exposure. “S” means an S mode (shutter priority mode), and is a mode for determining an aperture value such that an appropriate exposure is obtained with respect to a shutter speed selected by the user. “A” means A mode (aperture priority mode), and is a mode for automatically determining a shutter speed that gives an appropriate exposure to an aperture value selected by the user. "M" means M mode (manual mode), and is a mode in which the user selects both the aperture value and the shutter speed. As described above, the system control unit 70 (setting unit 73) can set different imaging conditions for each block of the imaging region 113A, but the aperture value can be set for each block. It is set for the entire surface of the imaging region 113A.

The setting unit 73 newly sets a touch area on the touch panel 52 so as to overlap the area of the type of shooting mode. The user touches one of the shooting mode types. The touch panel 52 outputs a detection signal corresponding to the touch area touched by the user to the system control unit 70. The setting unit 73 sets the type of shooting mode touched by the user. Then, when any one of "P", "S", and "A" is selected, the setting unit 73 automatically determines at least one of the aperture value and the shutter speed so as to obtain an appropriate exposure. .. When the shutter speed is determined, the setting unit 73 outputs an instruction signal instructing the shutter speed to the drive unit 21. When the aperture value is determined, the setting unit 73 outputs control information corresponding to the aperture value to the lens drive control device 15.

The drive unit 21 receives an instruction signal instructing the first imaging region corresponding to the first display region 511 selected by the user in block units. In addition, the drive unit 21 receives an instruction signal instructing the imaging conditions selected by the user. In response to this, the drive unit 21 drives the image pickup unit 20 so as to take an image under the instructed image pickup conditions (shutter speed, ISO sensitivity) in the block corresponding to the first display area 511. In addition, the image processing unit 30 receives an instruction signal instructing the imaging conditions selected by the user. In response to this, the image processing unit 30 executes image processing on the RAW data in the first imaging region based on the instructed imaging conditions (control parameters such as white balance, gradation, and color tone correction). Further, the lens drive control device 15 adjusts the aperture diameter of the aperture 14 based on the control information from the system control unit 70.

When the imaging conditions of the first imaging region are changed in this way, the first live view image displayed in the first display region 511 changes. For example, when the ISO sensitivity is increased, the subject is imaged brightly even with a small amount of light. In addition, the dark portion of the first live view image becomes brighter. Also, increasing the shutter speed reduces blurring of moving subjects.

In this way, the user selects one of the first display area 511, the second display area 512, the third display area 513, and the fourth display area 514, and sets the imaging conditions in the selected display area. , You can check the live view image that changes according to the change in the imaging conditions. In this case, the imaging conditions selected by the user may not be suitable for the proper exposure. However, the user can also recognize that overexposure or underexposure occurs due to changes in imaging conditions. In addition, the user can recognize what kind of imaging conditions are changed and how the live view image changes. Therefore, the user can perform shooting after confirming a plurality of live view images by changing the imaging conditions before shooting.

The processes from steps S1 to S7 as described above are repeatedly executed until the user half-presses the release switch of the operation unit 55 (step S8). Although the case where the user selects the first display area 511 out of the four display areas has been described in FIGS. 10, 11, 12, and 13, the user has selected the second display area 512 and the second display area 512. The same process is performed when the 3 display area 513 and the 4th display area 514 are selected.

Although not shown in FIGS. 10, 11, 12, and 13, the imaging conditions for each region that can be set by the user are not limited to ISO sensitivity, shutter speed, and picture control. For example, the above-mentioned frame rate, thinning rate, number of added rows or columns for adding pixel signals, number of digitized bits, and the like may be set as imaging conditions for each display area. Further, parameters such as color signal processing, white balance adjustment, gradation adjustment, and compression rate may be configured to be set as imaging conditions for each display area.

The system control unit 70 determines whether or not the release switch half-press operation (SW1 operation) has been performed (step S8). The half-press operation is used as an instruction to start preparation for shooting. Although not shown in FIG. 8, the system control unit 70 executes autofocus (AF) control or the like that automatically adjusts the focus.

Next, the system control unit 70 determines whether or not the release switch is fully pressed (SW2 is operated) (step S9). When it is determined that the full pressing operation has been performed, the setting unit 73 performs an imaging process for causing the image sensor 100 to perform imaging (step S10). The imaging based on the full pressing operation in step S10 is referred to as the main imaging. In the present embodiment, the image pickup unit 20 relates to the pixel region (imaging area) 113A of the image pickup device 100 based on the imaging conditions in the display area (live view image) finally set by the selection unit 72 in step S5. This imaging is performed. Further, the control unit 71 controls the pixel region (imaging region) 113A so that the captured image (still image) is displayed in all the regions of the image display region 510. As a result, the user can confirm what kind of image has been captured in a large display area.

Although the still image shooting operation has been described with reference to FIGS. 9, 10, 11, 12, and 13, the moving image shooting operation is also realized by the same processing. In this case, each display area (first display area 511, second display area 512, third display area 513, and fourth display area 514) includes each imaging area (first imaging region, second imaging region, third image region). Moving images captured under different imaging conditions (for example, frame rate) in the imaging region and the fourth imaging region are displayed. Further, in this case, it is preferable that a button for setting the frame rate is displayed in the operation button display area 520. Further, also in this case, the control unit 71 displays the moving image actually captured with respect to the pixel region (imaging region) 113A in all the regions of the image display region 510.

As described above, in the first embodiment, the first image sensor (a part of the image sensor 100) that performs image pickup under the first image pickup condition and the second image pickup condition different from the first image pickup condition are used for image pickup. A plurality of second image sensors (image sensors different from some image sensors of the image sensor 100) are arranged, and the first image data and the second image data generated according to the subject image incident on the first image sensor are arranged. An image pickup unit 20 that outputs the second image data generated according to the subject image incident on the image sensor, and a first image (for example, an image displayed in the first display area 511) indicated by the first image data. A second image (for example, an image displayed in the second display area 512) indicated by the second image data is displayed on the display unit 50 so that the recording mode of the first image data and the second image data can be selected. It includes a control unit 71 to be presented. With such a configuration, it is possible to confirm changes in a plurality of images corresponding to changes in imaging conditions.

Further, in the first embodiment, the first image and the second image are both live view images, and the imaging unit 20 includes a selection unit 72 for selecting the recording mode of the first image data and the second image data. , The main imaging is performed under the imaging conditions corresponding to the recording mode selected by the selection unit 72. According to such a configuration, before starting the main imaging of a still image or a moving image, it is possible to perform the main imaging after confirming a plurality of live view images captured under different imaging conditions. Further, in the first embodiment, since the selection unit 72 has the touch panel 52 formed on the display unit 50, the live view image can be selected by a simple operation.

Further, in the first embodiment, a division unit 74 that divides a plurality of image pickup elements of the image pickup unit 20 into at least a first image pickup element and a second image pickup element is provided. According to such a configuration, the control unit 71 can display at least two or more live view images on the display unit 50. Further, in the first embodiment, the division unit 74 arranges a plurality of first image pickup elements and second image pickup elements on the entire surface in the image pickup region 113A of the image pickup unit 20. With such a configuration, the imaging unit 20 can capture a plurality of live view images of subject images that look the same to the user. Therefore, the user can easily confirm the difference in the live view image of the subject image due to the difference in the imaging conditions.

Further, in the first embodiment, a setting unit 73 for setting the first imaging condition and the second imaging condition is provided. According to such a configuration, it is possible to perform imaging not only under predetermined imaging conditions but also under imaging conditions selected by the user. Further, in the first embodiment, the setting unit 73 makes at least one of the frame rate, the gain, and the exposure time different as the imaging conditions. According to such a configuration, the user changes and changes the live view image by changing the frame rate, gain, and exposure time (shutter speed) for each of a plurality of imaging regions (plurality of live view images). It is possible to take an image after confirming the live view image.

Further, in the first embodiment, the setting unit 73 makes at least one of white balance, gradation, and color tone correction different as an imaging condition. According to such a configuration, the user changes the live view image by changing the white balance, gradation, and color tone correction for each of a plurality of imaging regions (plurality of live view images), and the live view is changed. Imaging can be performed after confirming the image.

In the first embodiment described above, the setting unit 73 changes either the exposure time (shutter speed) or the gain (ISO sensitivity) so that the brightness of the first image and the second image are the same. Depending on the situation, either the exposure time or the gain may be changed. Specifically, the setting unit 73 lowers the gain when the exposure time is lengthened in the first imaging region or the second imaging region so that the first image and the second image have the same appropriate brightness, and the exposure is performed. The shorter the time, the higher the gain. According to such a configuration, the user can confirm in advance the difference in the image due to the combination of different exposure times and gains having the same brightness.

As shown in FIG. 7, in the first embodiment, the digital camera 1 has been described as an example of the electronic device. However, the electronic device is not limited to the digital camera 1, and may be composed of a device such as a smartphone, a mobile phone, or a personal computer having an imaging function. Further, in the digital camera 1 according to the first embodiment shown in FIG. 7, the display unit 50 may be provided outside the electronic device. In this case, each of the system control unit 70 and the display unit 50 is provided with a communication unit for transmitting and receiving signals (image data, control signals, etc.) by wire or wirelessly. Further, the image processing unit 30 and the system control unit 70 may be integrally configured. In this case, the system control unit having one body-side CPU takes on the functions of the image processing unit 30 and the system control unit 70 by executing the processing based on the control program.

<Second Embodiment>
In the above-described first embodiment, imaging conditions (including accumulation conditions) of each display area (first display area 511, second display area 512, third display area 513, and fourth display area 514) in the image display area 510 are included. However, in the second embodiment, each display area is divided into a plurality of areas, and different imaging conditions (including storage conditions) are set for each divided area.

FIG. 14 is a diagram showing a display unit 50A according to the digital camera 1 of the second embodiment. As shown in FIG. 14, the display surface 51A of the display unit 50A is provided with an image display area 510A and an operation button display area 520, similarly to the display surface 51 shown in FIG. The image display area 510A is an area for displaying an image captured by the imaging unit 20, that is, a still image, a moving image, and a live view image. The operation button display area 520 is an area for displaying a menu for the user to set imaging conditions and the like.

The image display area 510A is divided into four display areas (first display area 516, second display area 517, third display area 518, and fourth display area 519). The first display area 516, the second display area 517, the third display area 518, and the fourth display area 518 are the first display area 511, the second display area 512, the third display area 513, and the third display area 513 shown in FIG. Each corresponds to the fourth display area 514. A plurality of blocks B (i, j) are set in each display area 516, 517, 518, 519. In the example shown in FIG. 14, the blocks B (i, j) have eight blocks (i = 1, 2, 3) in the horizontal direction (horizontal direction in FIG. 14) in each display area 516, 517, 518, 519. , 4, 5, 6, 7, 8) are set, and six blocks (j = 1, 2, 3, 4, 5, 6) are set in the vertical direction (vertical direction in FIG. 14). That is, each display area 516, 517, 518, 519 is divided into 8 × 6 (= 48) blocks.

A touch panel 52 is provided on the display surface 51A. Although not shown in FIG. 14, the touch panel 52 is formed so that the first touch area 516a overlaps the first display area 516, as in the case shown in FIG. Further, the second touch area 517a is formed so as to overlap the second display area 517. Further, the third touch region 518a is formed so as to overlap the third display region 518. Further, the fourth touch region 519a is formed so as to overlap the fourth display region 519. When each touch area 516a, 517a, 518a, 519a detects that it has been pressed (touched) by the user, the system control unit 70 outputs a detection signal indicating the pressed position (which touch area it is). Output to.

The first touch area 516a is divided into a plurality of touch areas P (i, j) corresponding to the plurality of blocks B (i, j). Similarly, the second touch area 517a, the second touch area 518a, and the fourth touch area 519a are also divided into a plurality of touch areas P (i, j) corresponding to the plurality of blocks B (i, j), respectively. There is. When each touch area P (i, j) detects that it has been pressed (touched) by the user, a detection signal indicating the pressed position (which touch area it is) is sent to the system control unit 70. Output. In the display surface 51A shown in FIG. 14, the same reference numerals are given to the same configurations as those of the display surface 51 shown in FIG. 8, and duplicate description will be omitted.

Next, the shooting operation of the digital camera 1 according to the second embodiment will be described. FIG. 15 is a flowchart for explaining a shooting operation executed by the system control unit 70 of the second embodiment. 16 and 17 are views showing a display example of the display surface 51A in the second embodiment. The digital camera 1 can shoot still images and moving images, but a case of shooting still images will be described.

Since the processes of steps S1 to S5 shown in FIG. 15 are the same as the processes of steps S1 to S5 shown in FIG. 9, duplicate description will be omitted. After selecting any of the first display area 516, the second display area 517, the third display area 518, and the fourth display area 519 (see steps S4 and S5), the user is in the selected display area. It is possible to select the area. When the user selects an area in one display area, the block B (i, j) set in the display area can be touched (or traced) with a finger to the block B (i, j) in the display area. Select the area in block units. The touch panel 52 outputs a detection signal corresponding to the touch area P (i, j) touched by the user to the system control unit 70.

The selection unit 72 recognizes the area selected by the user based on the detection signal from the touch panel 52. In the example shown in FIG. 16, the first display area 516 is selected by the user. Further, the area 516A in the first display area 516 is selected by the user. This area 516A is a background area behind the waterfall (the area drawn by the white line in FIG. 16). Specifically, the region 516A includes blocks B (3,1), B (4,1), B (5,1), B (6,1), B (7,1), B (8,1). ), B (4,2), B (5,2), B (6,2), B (7,2), B (8,2), B (5,3), B (6,3) , B (7,3), B (8,3), B (6,4), B (7,4), B (8,4).

The selection unit 72 determines whether or not the area has been selected by the user (step S11). When it is determined that the area is selected by the user, the selection unit 72 sets the area 516A selected by the user (step S12). Specifically, the selection unit 72 outputs an instruction signal instructing the drive unit 21 of the position of the block selected by the user.

The user can change the imaging conditions in the selected display region (that is, any one of the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region). The user can also change the imaging conditions in the area within the selected display area. The setting unit 72 determines whether or not the imaging conditions have been changed by the user (step S14). When the selection unit 72 determines that the imaging conditions have been changed by the user, the selection unit 72 sets the changed imaging conditions (step S15).

For example, when the user sets the ISO sensitivity as the imaging condition of the area 516A of the first display area 516, the user touches the ISO sensitivity button image 522 (that is, the touch area 522a). The touch panel 52 outputs a detection signal corresponding to the touch area 522a touched by the user to the system control unit 70. As shown in FIG. 16, the control unit 71 displays a plurality of ISO sensitivity values next to the ISO sensitivity button image 522. The setting unit 73 newly sets the touch area on the touch panel 52 so as to overlap the area of each value of the ISO sensitivity. The user touches any of the ISO sensitivity values. The touch panel 52 outputs a detection signal corresponding to the touch area touched by the user to the system control unit 70. The setting unit 73 sets the value of the ISO sensitivity touched by the user. Specifically, the setting unit 73 outputs an instruction signal indicating a gain according to the ISO sensitivity selected by the user to the drive unit 21.

The drive unit 21 receives an instruction signal indicating the first imaging region corresponding to the first display region 516 selected by the user in block units. Further, the drive unit 21 receives an instruction signal instructing the area 516A in the first display area 516 selected by the user in block units. In addition, the drive unit 21 receives an instruction signal instructing the imaging conditions selected by the user. In response to this, the drive unit 21 drives the image pickup unit 20 so as to take an image under the instructed image pickup conditions (shutter speed, ISO sensitivity) in the block corresponding to the area 516A of the first display area 516. When the image processing unit 30 receives an instruction signal instructing the imaging conditions selected by the user, the image processing unit 30 is based on the instructed imaging conditions (control parameters such as white balance, gradation, and color tone correction). Image processing is executed on the RAW data of the region corresponding to the region 516A. Further, the lens drive control device 15 adjusts the aperture diameter of the aperture 14 based on the control information from the system control unit 70.

When the imaging conditions of the region corresponding to the region 516A in the pixel region 113A are changed in this way, the image of the region 516A in the first live view image changes. For example, when the ISO sensitivity is increased, the subject is imaged brightly even with a small amount of light. In addition, the dark portion of the region 516A becomes bright. Also, increasing the shutter speed reduces blurring of moving subjects.

In this way, the user selects one of the first display area 516, the second display area 517, the third display area 518, and the fourth display area 519, and further selects an area within the selected display area. Then, the user sets the imaging conditions in the selected area. This makes it possible to confirm the image of a predetermined region in the live view image that changes according to the change in the imaging conditions.

The processes S1 to S5 and the processes S11 to S14 as described above are repeatedly executed until the user half-presses the release switch of the operation unit 55 (step S8). In addition, in FIG. 16, the case where the user selects the area 516A of the first display area 516 has been described, but the same processing is performed when the user selects another area of the first display area 516. Be told. In the example shown in FIG. 17, the area 516B other than the area 516A is selected from the first display area 516. Then, the image displayed in the area 516B in the first display area 516 changes according to the user's selection of the ISO sensitivity button image 522, the shutter speed button image 523, the picture control button image 524, and the like.

After that, the processes from steps S8 to S10 are executed. Since these processes are the same as the processes described with reference to FIG. 9, duplicate description will be omitted.

Although the still image shooting operation has been described with reference to FIGS. 14, 15, 16 and 17, the moving image shooting operation is also realized by the same processing. In this case, each display area (first display area 516, second display area 517, third display area 518, and fourth display area 519) includes each imaging area (first imaging region, second imaging region, third image region). Moving images captured under different imaging conditions (for example, frame rate) in the imaging region and the fourth imaging region are displayed. Further, in this case, it is preferable that a button for setting the frame rate is displayed in the operation button display area 520. Further, also in this case, the control unit 71 displays the moving image actually captured with respect to the pixel region (imaging region) 113A in all the regions of the image display region 510.

As described above, in the second embodiment, the setting unit 73 makes the imaging conditions of a part of the first imaging element or the second imaging element different from the first imaging condition or the second imaging condition. Set to. According to such a configuration, in addition to the effect of the first embodiment, the imaging conditions are changed for each area in the first display area 516, the second display area 517, the third display area 518, and the fourth display area 519. It becomes possible to do. Therefore, the user can create an image by changing the imaging conditions for each region before starting the imaging of the still image or the moving image. It can be said that such processing performs pre-imaging editing of the image.

Also in the second embodiment, the imaging conditions for each region that can be set by the user are not limited to ISO sensitivity, shutter speed, picture, and the like. For example, the above-mentioned frame rate, thinning rate, number of additional rows or columns for adding pixel signals, number of digitization bits, and the like may be set as imaging conditions for each region. Further, parameters such as color signal processing, white balance adjustment, gradation adjustment, and compression rate may be configured to be set as imaging conditions for each region.

<Third Embodiment>
In the first embodiment and the second embodiment described above, the live view image is configured to be displayed in the four display areas of one display unit 50. On the other hand, in the third embodiment, two display units are provided, and two live view images or still images are displayed on one of the two display units. In addition, a live view image obtained by synthesizing two live view images or still images is displayed on the other display unit.

FIG. 18 is a functional block diagram of the image processing unit 30A and the system control unit 70 according to the digital camera 1 of the third embodiment. Note that FIG. 18 shows only the configuration corresponding to the image processing unit 30 and the system control unit 70 among the configurations shown in FIG. 7. As shown in FIG. 18, the image processing unit 30A includes a compositing unit 32 in addition to the image generating unit 31. The compositing unit 32 synthesizes the image data of the first imaging region and the image data of the second imaging region imaged under different imaging conditions. In the third embodiment, unlike the case described in the first embodiment and the second embodiment (arrangement pattern shown in FIG. 5), only the first imaging region and the second imaging region are set in the pixel region 113A. ing. In this case, in this arrangement pattern, in the pixel area 113A, the blocks of the odd row (2n-1) in the odd column (2m-1) and the blocks of the even row (2n) in the even column (2m). The first imaging region is configured by. Further, the second imaging region is composed of the blocks of the odd row (2n-1) in the even column (2m) and the blocks of the even row (2n) in the odd column (2m-1). That is, the dividing unit 74 divides each block in the pixel region 113A so as to form a checkerboard pattern. m and n are positive integers (m = 1,2,3, ..., n = 1,2,3, ...).

FIG. 19 is a diagram showing a display example when an image is displayed on the first display unit 50B and the second display unit 53 in the third embodiment. In the first and second embodiments described above, only one display unit 50 is provided, but in the third embodiment, two display units (first display unit 50B and second display unit 53) are provided. It is provided. Note that FIG. 19 shows the appearance of the electronic device (digital camera) 1 when viewed from the back. As shown in FIG. 19, the first display unit 50B is a display panel having a rectangular display surface. The first display unit 50B is provided on the back surface of the digital camera 1. Although not shown, the first touch panel is formed on the display surface of the first display unit 50B.

The second display unit 53 is a display panel having a rectangular display surface. The ends of the second display unit 53 are rotatably connected by hinges (not shown) provided on the back surface of the digital camera 1 and below the first display unit 50B. When the second display unit 53 rotates with the hinge as a fulcrum, the first display unit 50B is opened and closed by the second display unit 53.

A release switch 55a, a mode dial 55b, and a moving image switch 55c are provided on the upper surface of the digital camera 1. The release switch 55a is a switch pressed by the user when capturing a still image. By half-pressing the release switch 55a, preparations for shooting such as AF (Automatic Focusing) and AE (Automatic Exposure) are performed. The mode dial 55b is a dial rotated by the user when setting various scene modes such as portrait, landscape, and night view. The moving image switch 55c is a switch pressed by the user when capturing a moving image. Further, a multi-selector 55d is provided on the back surface of the digital camera 1 and on the side of the first display unit 50B. The multi-selector 55d is a key for the user to select a menu (menu for setting the shooting mode) displayed on the first display unit 50B or the second display unit 53 by using the up / down / left / right arrow keys and the OK switch. And switches. The operation unit 55 has a release switch 55a, a mode dial 55b, a moving image switch 55c, and a multi-selector 55d. The operation unit 55 may have a switch or the like other than these.

As shown in FIG. 19, the control unit 71 displays a live view image or a still image (an image of a person captured at night) in the first imaging region in the left region 53L of the display surface of the second display unit 53. Further, the control unit 71 displays a live view image or a still image of the second imaging region in the right region 53R of the display surface of the second display unit 53. Further, the control unit 71 combines a live view image or still image of the first imaging region with a live view image or still image of the second imaging region in the central region 51G of the first display unit 51 to obtain a live view image or still image. Display the image.

In general, HDR (High Dynamic Range) imaging is widely known as an image composition technique for recording and displaying an image having a wide dynamic range. In HDR imaging, a plurality of images are imaged while changing the imaging conditions (for example, exposure), and the images are combined to generate an image with less overexposure and underexposure. However, in the conventional HDR, for example, since the imaging time for capturing two images with different imaging conditions is different, the subject may move or the user (photographer) may move the digital camera 1. There is. In this case, since the plurality of images are not the images of the same subject, it is difficult to combine the images. On the other hand, in the third embodiment, the imaging time of two images (live view image or still image) having different imaging conditions can be set to the same time (or substantially the same time). Therefore, the problem of the conventional HDR imaging can be solved by the configuration of the third embodiment. The HDR mode is configured to be selectable according to the operation of the multi-selector 55d by the user.

According to such a configuration, the user can use the first live view image or the first still image in the first imaging region and the second live view image or the second still image in the second imaging region captured under different imaging conditions. Can be confirmed before imaging, and a live view image or still image having a wide dynamic range, which is a combination of the first live view image or still image and the second live view image or still image, is also confirmed before imaging. be able to.

In the third embodiment described above, the compositing unit 32 synthesizes the image data in the first imaging region and the image data in the second imaging region to generate image data having a wide dynamic range. However, not limited to such a configuration, the compositing unit 32 synthesizes the image data of the first imaging region and the image data of the second imaging region to generate image data in which the edge (contour) of the subject is emphasized. May be good. Specifically, the setting unit 73 sets the shutter speed of the first imaging region to 1/30 second and the shutter speed of the second imaging region to 1/200 second. In this case, when the image sensor 100 images a fast-moving subject, the image data of the first image generated by the first image pickup region of the image sensor 100 becomes image data with a large blur of the subject. On the other hand, the image data generated by the second imaging region is image data with less blurring of the subject. The synthesizing unit 32 adds the image data of the edge portion of the subject in the image data of the second image to the image data of the first image and synthesizes the image data. As a result, image data in which the edge portion of the moving subject is emphasized is generated.

The control unit 71 displays a live view image or a still image of the first imaging region in the left region 53L of the display surface of the second display unit 53. Further, the control unit 71 displays a live view image or a still image of the second imaging region in the right region 53R of the display surface of the second display unit 53. Further, the control unit 71 combines a live view image or still image of the first imaging region with a live view image or still image of the second imaging region in the central region 51G of the first display unit 51 to obtain a live view image or still image. Display an image (composite image with emphasized edges of the subject). According to such a configuration, the user can confirm the images captured at different shutter speeds and can confirm the composite image obtained by synthesizing the images.

<Fourth Embodiment>
In the first embodiment, the second embodiment and the third embodiment described above, the control unit 71 has the first display area 511, the second display area 512, the third display area 513 and the fourth display area 514 (or the first display). The first live view image, the second live view image, the third live view image, and the fourth live view image are displayed in the area 516, the second display area 517, the third display area 518, and the fourth display area 519), respectively. It was controlled to do. On the other hand, in the fourth embodiment, the control unit 71 in the first display area, the second display area, the third display area, and the fourth display area, respectively, in the first moving image, the second moving image, the third moving image, and the fourth display area. 4 Control to display a moving image. In addition, the display unit displays each video at a refresh rate (a value indicating how much it refreshes per unit time) according to the frame rate of the first video, the second video, the third video, and the fourth video. ..

FIG. 20 is a diagram showing a display example of the display surface 51C in the fourth embodiment. As shown in FIG. 20, a frame rate button image 545 for setting a frame rate is displayed in the operation button display area 540. This frame rate button image 545 is also included in the menu image 540M. The selection button image 541, the ISO sensitivity button image 542, the shutter speed button image 543, and the picture control button image 544 are the selection button image 521, the ISO sensitivity button image 522, and the shutter speed button image 523 shown in FIG. And the picture control button image 524. In the display example shown in FIG. 20, a frame rate button image 545 is provided in place of the image pickup mode button image 525 shown in FIG. 8 and the like. Further, in the display example shown in FIG. 20, the first display area 531 and the second display area 532, the third display area 533, and the fourth display area 534 are the first display area 511 and the first display area 511 shown in FIG. 8 and the like, respectively. 2 Corresponds to the display area 512, the third display area 513, and the fourth display area 514.

The setting unit 73 automatically or according to the operation of the frame rate button image 545 by the user, has different frames in the first image pickup area, the second image pickup area, the third image pickup area, and the fourth image pickup area of the image pickup element 100. Set the rate. For example, the setting unit 73 sets the frame rate of the first imaging region to 30 fps, sets the frame rate of the second imaging region to 60 fps, sets the frame rate of the third imaging region to 90 fps, and sets the fourth imaging region. Set the frame rate of to 120 fps. Then, the setting unit 73 captures moving images at different frame rates in the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region of the image sensor 100 according to the operation of the moving image switch by the user. Let it run.

The control unit 71 sets the first display area 531 and the second display area 532, the third display area 533, and the fourth display area 534 of the image display area 530 into the first image pickup area, the second image pickup area, and the third image pickup area, respectively. The moving images captured at different frame rates in the region and the fourth imaging region are displayed. In general, a display unit composed of a liquid crystal display refreshes (updates) an image at the same refresh rate on the display surface. On the other hand, in the fourth embodiment, the display unit 50C is configured to be refreshable at different refresh rates in the first display area 531, the second display area 532, the third display area 533, and the fourth display area 534 of the display surface 51C. ing. That is, on the display surface 51C of the display unit 50C, each of the drive circuit that drives the refresh of each pixel in the first display area 531, the drive circuit that drives the refresh of each pixel in the second display area 532, and the third display area 533. A drive circuit for driving the refresh of the pixels and a drive circuit for driving the refresh of each pixel in the fourth display area 534 are separately provided. With such a configuration, the user can easily recognize the difference between a plurality of moving images captured at different frame rates.

In addition, the control unit 71 includes a first moving image, a second moving image, a third moving image, and images taken at different frame rates in the first imaging region, the second imaging region, the third imaging region, and the fourth imaging region of the image sensor 100. The image data of the fourth moving image is controlled to be recorded separately in the recording unit 60. According to such a configuration, the recording unit 60 can simultaneously record image data of a plurality of moving images captured at different frame rates.

In the first embodiment, the second embodiment, and the third embodiment described above, the control unit 71 is different in the first display area, the second display area, the third display area, and the fourth display area of the display surface. It was configured to display live view images and moving images captured under imaging conditions (shutter speed, frame rate, etc.), but in the first display area, second display area, third display area, and fourth display area of the display surface. , A configuration may be used in which still images captured under different imaging conditions are displayed. In this case, the control unit 71 sets the first still image, the second still image, the third still image, and the fourth still image captured by one imaging operation of the release switch by the user in the first display area and the fourth still image, respectively. It is controlled to display in the 2 display area, the 3rd display area and the 4th display area. With such a configuration, the user can easily recognize the difference between a plurality of still images captured under different imaging conditions.

<Fifth Embodiment>
In the fifth embodiment, the system control unit 70 uses an electronic zoom (also referred to as a digital zoom) image in any of the first display area, the second display area, the third display area, and the fourth display area. When the enlarged display of the image is performed, the enlarged display of the image is also performed in other display areas in accordance with the enlarged display of such an image.

When enlarging the image by the electronic zoom, the user performs, for example, a touch operation of the touch panel on the display surface. The control unit 71 outputs an instruction signal indicating an area for cutting out an image to the image processing unit 30 in response to a touch operation of the touch panel by the user. The image processing unit 30 performs a process (trimming process) of cutting out image data in a region designated by the system control unit 70. The control unit 71 controls the display unit to output the image data of the region cut out by the image processing unit 30, and enlarges and displays the image based on the image data of the region on the display surface of the display unit.

FIG. 21 is a diagram showing a display example of the display surface 51D when the electronic zoom is performed in the fifth embodiment. In the display example of the display unit 50D shown in FIG. 21, the first display area 511D, the second display area 512D, the third display area 513D, and the fourth display area 514D are the first display area 511 shown in FIG. , The second display area 512, the third display area 513, and the fourth display area 514. Since the operation button display area 520 is the same as the operation button display area shown in FIG. 8 and the like, duplicate description will be omitted.

For example, as shown in FIG. 21, the user is formed on the first display area 511D in order to enlarge the image O1 of the person displayed in the area 516D in the first display area 511D by the electronic zoom. The area 516D is selected by performing a touch operation on the touch panel. In response to such an operation, the control unit 71 enlarges and displays the image O1 of the person displayed in the area 516D in the first display area 511D in the entire area of the first display area 511D. Further, the control unit 71 displays the image O1 of the person in the second display area 512D, the third display area 513D, and the fourth display area 514D at the same display magnification as the enlarged display of the image O1 of the person in the first display area 511D. Enlarge the display. That is, the control unit 71 enlarges and displays the image O1 of the person displayed in the area 517D in the second display area 512D in the entire area of the second display area 512D. Further, the control unit 71 enlarges and displays the image O1 of the person displayed in the area 518D in the third display area 513D in the entire area of the third display area 513D. Further, the control unit 71 enlarges and displays the image O1 of the person displayed in the area 519D in the fourth display area 514D in the entire area of the fourth display area 514D.

When the control unit 71 performs reduced display of the image by electronic zoom in any of the display areas of the first display area 511D, the second display area 512D, the third display area 513D, and the fourth display area 514D. In addition, it is also possible to perform the reduced display of the image in other display areas in accordance with the reduced display of such an image. For example, as shown in FIG. 21, the user is formed on the first display area 511D in order to reduce the image O1 of the person displayed in the entire area of the first display area 511D by the electronic zoom. The entire area of the first display area 511D is selected by performing a touch operation on the touch panel. In response to such an operation, the control unit 71 reduces the image O1 of the person displayed in the entire area of the first display area 511D to the area 516D of the first display area 511D. Further, the control unit 71 displays the image O1 of the person in the second display area 512D, the third display area 513D, and the fourth display area 514D at the same display magnification as the reduced display of the image O1 of the person in the first display area 511D. Reduce the display.

As described above, in the fifth embodiment, the control unit 71 has the first image (for example, the image O1 of the person displayed in the first display area 511D) and the second image (for example, the second image) on the display unit 50D. One of the first image and the second image is enlarged or reduced in accordance with the enlargement or reduction of one of the images O1) of the person displayed in the display area 512D. According to such a configuration, when the image is enlarged or reduced by the electronic zoom, the user can adjust the size of the image displayed in each display area, and each of them is caused by the difference in the imaging conditions. The difference between the images can be easily recognized. In addition, the user does not need to perform an enlargement or reduction operation for each image, and the operation effort of the user does not increase.

The configuration is not limited to the configuration in which the user executes the electronic zoom by performing a touch operation on the touch panel, and the user operates an electronic zoom switch (for example, a switch operated when executing the electronic zoom) of the operation unit 55. It may be configured to execute electronic zoom by.

<Sixth Embodiment>
FIG. 22 is a diagram showing a display example of the display surface 51E in the sixth embodiment. In the display example of the display unit 50E shown in FIG. 22, the first display area 511E, the second display area 512E, the third display area 513E, and the fourth display area 514E are the first display area 511 shown in FIG. , The second display area 512, the third display area 513, and the fourth display area 514. Since the operation button display area 520 is the same as the operation button display area shown in FIG. 8 and the like, duplicate description will be omitted.

As shown in FIG. 22, the control unit 71 has a first image, a second image, a third image, and a third image in the first display area 511E, the second display area 512E, the third display area 513E, and the fourth display area 514E. The imaging conditions of these images are displayed by superimposing them on the four images. In the example shown in FIG. 22, “100” is set as the ISO sensitivity, “1/2 second” is set as the shutter speed, “standard” is set as the picture control, and the shooting mode is set as the imaging condition of the first image. Indicates a state in which "P" is set as. Further, as the imaging condition of the second image, "200" is set as the ISO sensitivity, "1/100 second" is set as the shutter speed, "standard" is set as the picture control, and "P" is set as the shooting mode. Indicates the set state. Further, as the imaging condition of the third image, "400" is set as the ISO sensitivity, "1/500 second" is set as the shutter speed, "standard" is set as the picture control, and "P" is set as the shooting mode. Indicates the set status. Further, as the imaging condition of the fourth image, "800" is set as the ISO sensitivity, "1/1000 second" is set as the shutter speed, "standard" is set as the picture control, and "P" is set as the shooting mode. Indicates the set status. With such a configuration, the user can easily confirm the imaging conditions currently set in each display area.

In addition, an imaging condition display area for displaying the imaging conditions currently set in the display area selected by the user (for example, the first display area) may be provided below the display surface of the display unit. Further, the control unit 71 may be configured to display the imaging conditions for a predetermined time. Further, a switch (switch of the operation unit 55 or a switch on the touch panel) for selecting whether or not to display the imaging condition is provided, and the control unit 71 captures the imaging condition display area 550 in response to the operation of the switch. It may be configured to control the display or non-display of the condition.

<7th Embodiment>
In the operation button display area 520 shown in FIG. 10 and the like, each button 521, 522, 523, 524, 525 was arranged in a predetermined order. That is, the selection button image 521 is placed at the top, the ISO sensitivity button image 522 is placed second from the top (ie below the selection button image 521), and the shutter speed button image 523 is placed third from the top (ie ISO). The picture control button image 524 was placed at the fourth position from the top (that is, below the shutter speed button image 523), and the image control button image 525 was placed at the bottom. On the other hand, in the seventh embodiment, the control unit 71 changes the arrangement of the buttons 521, 522, 523, 524, 525 according to the subject in the display area and displays them. Further, in the seventh embodiment, the control unit 71 displays the high-priority button in a display mode different from that of the other buttons.

FIG. 23 is a diagram showing a display example of the display surface 51F in the seventh embodiment. In the display example of the display unit 50F shown in FIG. 23, the selection button image 521 is arranged at the top, the shutter speed button image 523 is arranged at the second from the top (that is, below the selection button image 521), and the picture control button. The image 524 is placed third from the top (ie below the shutter speed button image 523), the ISO sensitivity button image 522 is placed fourth from the top (ie below the picture control button image 524), and the imaging mode button image 525. Is located at the bottom. Further, as shown in FIG. 23, the shutter speed button image 523 includes a button having a larger area than the other buttons (selection button image 521, ISO sensitivity button image 522, picture control button image 524, and imaging mode button image 525). It has become.

Further, in the touch panel 52, the touch area 521a is formed so as to overlap the selection button image 521. Further, the touch region 523a is formed so as to overlap the shutter speed button image 523. Further, the touch area 524a is formed so as to overlap the picture control button image 524. Further, the touch region 522a is formed so as to overlap the ISO sensitivity button image 522. Further, the touch region 525a is formed so as to overlap the image pickup mode button image 525. The touch area 523a is larger than the area of the other buttons according to the size of the area of the shutter speed button image 523.

Next, the process of changing the arrangement of the buttons 521, 522, 523, 524, 525 by the image processing unit 30 and the system control unit 70 will be described. When the user changes the imaging conditions, the system control unit 70 instructs the image processing unit 30 to detect the moving subject. The image processing unit 30 compares a plurality of image data obtained from the live view image in time series to detect a moving subject and a non-moving subject. Then, the image processing unit 30 outputs the detection result to the system control unit 70 together with the image data.

Based on the detection result of the image processing unit 30, the control unit 71 determines whether or not the moving subject is included in the display area selected by the selection unit 72. When the control unit 71 determines that the moving subject is included in the display area selected by the selection unit 72, the shutter speed button image, which is a button for setting the shutter speed, is as shown in FIG. Display 523 at the second position from the top. Further, the control unit 71 displays the shutter speed button image 523 larger than the other buttons.

By changing the shutter speed, the appearance of moving subjects changes. For example, when the moving subject is a waterfall, increasing (fastening) the shutter speed produces an image in which the flow of water in the waterfall stops momentarily. On the other hand, by lowering (slowering) the shutter speed, the image shows the flow of water in the waterfall as if it were a thread. As described above, for a moving subject, the shutter speed has a greater influence on how the subject is captured than other imaging conditions. Therefore, when the moving subject is included in the area, the control unit 71 determines that the priority of the shutter speed is higher than other imaging conditions. Then, the control unit 71 moves the position of the shutter speed button image 523 upward and displays the shutter speed button image 523 as a button in a large area. As a result, the high-priority buttons are arranged at positions that are easy for the user to operate, and the operability of the user is improved. In addition, the high-priority button (that is, the imaging condition) becomes more prominent than the other buttons (that is, the imaging condition), and the user can be prompted to operate the high-priority button.

In the above-described example, the control unit 71 is designed to change the arrangement and display mode (size) of the buttons depending on whether or not the subject in the area is a moving subject, but the configuration is not limited to this. For example, the system control unit 70 instructs the image processing unit 30 to detect the brightness of the image. The image processing unit 30 detects the brightness of the image in the region based on the live view image. Then, the image processing unit 30 outputs the detection result to the system control unit 70 together with the image data.

The control unit 71 determines whether or not the brightness of the image in the region selected by the selection unit 72 is within a predetermined range based on the detection result of the brightness by the image processing unit 30. When the control unit 71 determines that the brightness of the image in the area is not within the predetermined range, the control unit 71 displays the ISO sensitivity button image 522, which is a button for setting the ISO sensitivity, at the second position from the top. Further, the control unit 71 displays the ISO sensitivity button image 522 larger than the other buttons.

By changing the ISO sensitivity, the dark part of the live view image becomes brighter and the bright part becomes darker. When the brightness in the region is not within the predetermined range, that is, when the image in the region is too bright or too dark, the optimum exposure can be approached by changing the ISO sensitivity. Therefore, the control unit 71 determines that the priority of the ISO sensitivity is higher than other imaging conditions when the image in the region is not within the predetermined range. Then, the control unit 71 moves the position of the ISO sensitivity button image 522 upward and displays the ISO sensitivity button image 522 as a button in a large area. As a result, the high-priority buttons are arranged at positions that are easy for the user to operate, and the operability of the user is improved. In addition, the high-priority button (that is, the imaging condition) becomes more prominent than the other buttons (that is, the imaging condition), and the user can be prompted to operate the high-priority button.

As a display mode that makes the high-priority button stand out, in addition to enlarging the button, a display mode such as changing the color of the button or blinking the button may be used. Further, before the high-priority button is pressed by the user, a plurality of imaging condition values may be displayed next to the button to make the high-priority button stand out. Further, only the arrangement of the buttons may be changed, or only the display mode of the buttons may be changed.

Further, the arrangement of the buttons may be changed and the display mode of the buttons may be changed according to the order in which the user operates the buttons. For example, the user selects a display area after pressing the selection button image 521. Next, the user presses the image pickup mode button image 525 to select the manual mode as the shooting mode. After that, the user changes the imaging conditions for each display area. In such a case, the control unit 71 arranges the selection button image 521 at the top and enlarges the selection button image 521. Next, the control unit 71 arranges the image pickup mode button image 525 at the top and enlarges the image pickup mode button image 525. After that, the control unit 71 arranges any one of the ISO sensitivity button image 522, the shutter speed button image 523, and the picture control button image 524 at the top according to the subject (image) for each display area. Make the top button bigger. In this way, by changing the arrangement and display mode of the buttons in the order according to the operation procedure of the user, the convenience of the operation by the user is improved.

<8th Embodiment>
Generally, flashing the strobe at the same time as the shutter curtain is fully opened is called first curtain synchronization. On the other hand, firing the strobe just before the shutter curtain starts to close is called rear curtain synchronization. In the eighth embodiment, the setting unit 73 sets a slow shutter speed (for example, 1/2 second) with respect to the first imaging region and the second imaging region. In addition, the system control unit 70 causes the strobe 90 to emit light immediately before the charge accumulation is completed in the first imaging region. That is, in the first imaging region, imaging is performed by the rear curtain synchronization. Further, the system control unit 70 starts the charge accumulation in the second imaging region and at the same time causes the strobe 90 to emit light. That is, in the second imaging region, imaging is performed with the front curtain synchro.

FIG. 24 is a timing chart showing the light emission timing and the charge accumulation timing of the strobe 90 in the eighth embodiment. As shown in FIG. 24, the setting unit 73 accumulates electric charge in the first imaging region from the timing t1 before the timing t2 when the strobe 90 starts emitting light to the timing t3 when the amount of light emitted by the strobe 90 disappears. Let's get started. Further, the setting unit 73 starts charge accumulation in the second imaging region from the timing t2 when the strobe 90 starts emitting light to the timing t4 after the timing t3 when the amount of light from the strobe 90 disappears. Then, the control unit 71 displays the first image indicated by the image data generated in the first imaging region in the first display region 511, and displays the second image indicated by the image data generated in the second imaging region. It is displayed in the second display area 512.

As a result, the user can confirm in advance how the first image taken by the rear curtain synchro and the second image taken by the front curtain synchro are different. For example, in the case of front curtain synchronization, the light and afterimage of the car light and car that are the subject remain in front of the car. Therefore, the image looks like the car is backing even though the car is actually moving forward. On the other hand, in the case of the rear curtain synchro, the light trail and afterimage of the car light and the car are images that naturally appear behind the car.

<9th embodiment>
In the ninth embodiment, the digital camera 1 in the first embodiment described above is separated into an image pickup device 1A and an electronic device 1B.

FIG. 25 is a block diagram showing the configurations of the image pickup apparatus 1A and the electronic device 1B according to the ninth embodiment. In the configuration shown in FIG. 25, the image pickup apparatus 1A is an apparatus for imaging a subject. The image pickup device 1A includes a lens unit 10, an image pickup unit 20, an image processing unit 30, a work memory 40, an operation unit 55, a recording unit 60, and a first system control unit 70A. In the image pickup apparatus 1A, the configuration of the lens unit 10, the image pickup unit 20, the image processing unit 30, the work memory 40, the operation unit 55, and the recording unit 60 is the same as the configuration shown in FIG. Therefore, the same reference numerals are given to the same configurations, and duplicate description will be omitted.

Further, the electronic device 1B is a device that displays an image (still image, moving image, live view image). The electronic device 1B includes a display unit 50 and a second system control unit (control unit) 70B. The configuration of the display unit 50 in the electronic device 1B is the same as the configuration shown in FIG. 7. Therefore, the same reference numerals are given to the same configurations, and duplicate description will be omitted.

The first system control unit 70A has a first communication unit 75A. Further, the second system control unit 70B has a second communication unit 75B. The first communication unit 75A and the second communication unit 75B transmit and receive signals by wire or wirelessly to each other. In such a configuration, the first system control unit 70A secondly receives image data (image data image-processed by the image processing unit 30 and image data recorded in the recording unit 60) via the first communication unit 75A. It transmits to the communication unit 75B. The second system control unit 70B causes the display unit 50 to display the image data received by the second communication unit 75B. In addition, the second system control unit 70B causes the second display unit 53 to display a preset menu image.

Further, the second system control unit 70B controls to change the imaging condition (including the accumulation condition) according to the touch operation of the touch panel 52 by the user or automatically. In addition, the second system control unit 70B controls to select each display area in the image display area 510 in response to a touch operation of the touch panel 52 by the user or automatically. Further, the first system control unit 70A executes imaging control in response to an operation of the operation unit (operation unit provided on the electronic device 1B side for instructing the start of imaging of a still image or moving image) 55 by the user.

The configuration shown in FIG. 7 (control unit 71, selection unit 72, setting unit 73, and division unit 74) may be provided in either the first system control unit 70A or the second system control unit 70B. All the configurations shown in FIG. 7 may be provided in the first system control unit 70A or the second system control unit 70B, and a part of the configurations shown in FIG. 7 is provided in the first system control unit 70A. A configuration other than a part of the configuration shown in 7 may be provided in the second system control unit 70B.

The imaging device 1A is composed of, for example, a digital camera, a smartphone, a mobile phone, a personal computer or the like having an imaging function and a communication function, and the electronic device 1B is, for example, a smartphone, a mobile phone or a portable personal having a communication function. It consists of mobile terminals such as computers.

The first system control unit 70A shown in FIG. 25 is realized by the body-side CPU executing processing based on the control program. Further, the second system control unit 70B shown in FIG. 25 is realized by the body-side CPU executing processing based on the control program.

As described above, in the ninth embodiment, in addition to the effects described in the first embodiment, after confirming a plurality of live view images captured by the image pickup device 1A using a mobile terminal such as a smartphone. Imaging can be performed.

In the configuration shown in FIG. 25, the image processing unit 30 and the first system control unit 70A may be integrally configured. In this case, the system control unit having one body-side CPU takes charge of the function of the image processing unit 30 and the function of the first system control unit 70A by performing processing based on the control program.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. Various changes or improvements can be made to the above-described embodiment without departing from the spirit of the present invention. In addition, one or more of the requirements described in the above embodiments may be omitted. Such modifications, improvements, or omitted forms are also included in the technical scope of the present invention. Further, it is also possible to appropriately combine and apply the configurations of the above-described embodiments and modifications.

For example, in each of the above-described embodiments, the array of the color filter 102 is a Bayer array, but an array other than this array may be used. Further, the number of pixels forming the unit group 131 may include at least one pixel. Further, the block may also include at least one pixel. Therefore, it is possible to perform imaging under different imaging conditions for each pixel.

Further, in each of the above-described embodiments, a part or all of the drive unit 21 may be mounted on the imaging chip 113, or a part or all of the configurations may be mounted on the signal processing chip 111. Further, a part of the configuration of the image processing unit 30 may be mounted on the image pickup chip 113 or the signal processing chip 111. Further, a part of the configuration of the system control unit 70 may be mounted on the image pickup chip 113 or the signal processing chip 111.

Further, in each of the above-described embodiments, the imaging conditions (including the accumulation conditions) are changed after the user selects the display area, but the changes are made after the user changes the imaging conditions. It may be configured to select a display area that reflects the imaging conditions. Further, in the first embodiment and the second embodiment described above, the control unit 71 erases the display area (live view image) selected by the user from the display panel 51 among the four display areas on the display panel 51. You may try to do it. According to such a configuration, the live view image under the imaging condition that the user does not want to be imaged can be erased, and the live view image desired by the user can be easily compared. Further, when the display area (live view image) selected by the user is erased from the display panel 51, the control unit 71 displays the live view image synthesized by the compositing unit 32 in the space of the erased display area. May be good.

Further, in each of the above-described embodiments, in response to one full-press operation, the imaging unit 20 images all the regions (all pixels) of the pixel region 113A under the imaging conditions of the display region selected by the user. It was configured to do. However, the present invention is not limited to such a configuration, and the imaging unit 20 selects one divided imaging region (for example, the first imaging region) of the pixel region 113A by the user in response to one full-press operation. It may be configured to perform imaging under the imaging conditions of the displayed display area. Further, the user may be able to select two or more display areas. In this case, in response to one full-press operation, the imaging unit 20 selects two or more divided imaging regions (for example, a first imaging region and a second imaging region) in the pixel region 113A by the user. It is also possible to perform imaging at the same time under the imaging conditions of the two or more display regions.

Further, as shown in FIG. 5, each imaging region in the pixel region 113A is composed of a plurality of different blocks. Therefore, the image generation unit 31 can also superimpose the live view images captured in each imaging region to generate one live view image for all the pixels in the pixel region 113A. Then, the control unit 71 may display the live view image thus generated by the image generation unit 31 on the display panel 51 (image display area 510). Further, each display area 511, 521, 513, 514 (or each display area 516, 517, 518, 519) in the image display area 510 is a display area having the same area, but is a display area having a different area. May be good.

Further, in each of the above-described embodiments, the operation button display area 520 is provided in the vicinity of the image display area 510, but may be provided in a position other than the vicinity of the image display area 510. Further, the operation button display area 520 may be arranged at a position superimposed on the image display area 510. Further, instead of the user touching the touch panel 52, the operation unit 55 may be operated.

Further, in each of the above-described embodiments, it is assumed that the imaging conditions of the live view image selected by the user and the imaging conditions when imaging in response to the full pressing operation of the release switch or the like are the same conditions. .. This is so that the image actually captured in the live view image can be confirmed. However, the imaging conditions of the live view image and the imaging conditions of the actually captured image may be different. In this case, the imaging conditions are changed to the extent that the user can recognize the image actually captured based on the live view image.

Further, in each of the above-described embodiments, as shown in FIG. 5, the division unit 74 sets the image pickup region 113A of the image pickup device 100 as the first image pickup area, the second image pickup area, the third image pickup area, and the fourth image pickup area. It was divided into. However, the division unit 74 may be divided into two regions, a first imaging region and a second imaging region, and is divided into three regions, a first imaging region, a second imaging region, and a third imaging region. It may be divided into 5 or more imaging regions. In this case, a display area is provided in the image display area of the display unit according to the number of image pickup regions divided by the division unit 74. That is, when the dividing portion 74 is divided into two imaging regions, two display regions (first display region and second display region) are provided in the image display region, and the dividing portion 74 is divided into five or more imaging regions. If so, 5 or more display areas are provided in the image display area.

Further, in each of the above-described embodiments, the sizes of the first display area, the second display area, the third display area, and the fourth display area in the image display area are fixed, but in the fifth embodiment, the image display The sizes (areas) of the first display area, the second display area, the third display area, and the fourth display area in the area may be changed. For example, the user performs an operation (pinch-out operation) of moving the finger away after pinching the first display area with the finger. In response to such an operation, the control unit 71 controls so that the first display area is enlarged and displayed. Further, the control unit 71 controls so that the second display area, the third display area, and the fourth display area are automatically reduced and displayed according to the enlarged display of the first display area. With such a configuration, it is possible to enlarge the area that the user wants to see most (the display area displaying the image of interest).

On the contrary, the user performs an operation (pinch-in operation) of bringing the fingers closer after pinching the first display area with the fingers, for example. In response to such an operation, the control unit 71 controls so that the first display area is reduced and displayed. Further, the control unit 71 controls so that the second display area, the third display area, and the fourth display area are automatically enlarged and displayed according to the reduced display of the first display area. According to such a configuration, it is possible to reduce the display area displaying an image that the user is not paying attention to.

Although the control unit 71 is configured to enlarge or reduce the display area according to the operation of the user, the control unit 71 automatically expands the display area for displaying the image captured under the recommended imaging conditions. The other display area may be configured to be automatically reduced according to the size of the enlarged display area.

The display units 50, 50A, 50B, 50C, 50D, 50E, and 50F are not limited to the case where the display unit is composed of a liquid crystal display that controls the transmission of the backlight by applying a voltage to control the display of each pixel. It may be composed of an organic electroluminescence type liquid crystal display that controls the spontaneous light emission by applying a voltage to control the display of each pixel.

1,1B ... Digital camera 1A ... Image sensor, 20 ... Imaging unit, 30, 30A ... Image processing unit, 31 ... Image generation unit, 32 ... Synthesis unit, 50, 50A, 50C, 50D, 50E, 50F ... Display unit, 50B ... 1st display unit, 51, 51A, 51C, 51D, 51E, 51F ... Display surface, 52 ... Touch panel (selection unit), 53 ... 2nd display unit, 70 ... System control unit, 70A ... 1st system control unit , 70B ... 2nd system control unit, 71 ... control unit, 72 ... selection unit, 72 ... setting unit, 73 ... setting unit, 74 ... division unit, 100 ... image sensor

Claims (20)

A region for imaging a subject, which is connected to a plurality of pixels that generate a signal by photoelectrically converted charges, a signal line that is connected to the plurality of pixels and outputs the signal, and is connected to the plurality of pixels. A plurality of image pickup elements arranged in a first direction and a second direction in which an imaging region including the control line for reading the signal into the signal line intersects the first direction.
A setting unit that sets the imaging conditions of the imaging region, and
Among the plurality of the imaging regions, the first image of the subject imaged in the plurality of first imaging regions arranged in the first direction and the second direction, respectively, and the first imaging condition is set by the setting unit. When, among the plurality of imaging regions, wherein the first direction is arranged in a second direction, a plurality of second imaging different second imaging condition is set to the first imaging condition by the setting unit An electronic device including a second image of a subject imaged in a region and a control unit for displaying on a display unit so that the setting unit selects imaging conditions set in the plurality of imaging regions. The image pickup device has a first semiconductor chip and a second semiconductor chip connected to the first semiconductor chip.
The first semiconductor chip has a plurality of the imaging regions arranged therein.
The electronic device according to claim 1, wherein the second semiconductor chip has a plurality of conversion units for converting the signal output to the signal line into a digital signal arranged in the first direction and the second direction. The electronic device according to claim 2, wherein the first semiconductor chip and the second semiconductor chip are arranged side by side in the optical axis direction of an optical system that emits light into the imaging region. The image sensor has a third semiconductor chip connected to the second semiconductor chip, and has a third semiconductor chip.
The electronic device according to claim 2 or 3, wherein the third semiconductor chip is provided with a plurality of storage units for storing the signal converted into a digital signal by the conversion unit. The electronic device according to any one of claims 1 to 4, wherein the control unit controls the setting unit so that the selected imaging conditions are set in the imaging region. The control unit controls the setting unit so that the imaging condition is set in the imaging region by an image selected from the first image and the second image, according to claims 1 to 5. The electronic device according to any one item. The electronic device according to any one of claims 1 to 6, wherein a plurality of the first imaging regions are arranged apart from each other in the first direction. The electronic device according to any one of claims 1 to 7, wherein a plurality of the first imaging regions are arranged apart from each other in the second direction. The electronic device according to any one of claims 1 to 8, wherein the second imaging region is arranged between a plurality of the first imaging regions arranged in the first direction. The electronic device according to any one of claims 1 to 9, wherein the second imaging region is arranged in the second direction and is arranged between the plurality of first imaging regions. The electronic device according to any one of claims 1 to 10, wherein the first imaging region and the second imaging region are alternately arranged in the first direction. The electronic device according to any one of claims 1 to 11, wherein the first imaging region and the second imaging region are alternately arranged in the second direction. The electronic device according to any one of claims 1 to 12, wherein the control unit uses an operation unit that receives an operation input from the outside to select an imaging condition to be set in the imaging region. The electronic device according to claim 13, wherein the control unit uses a touch panel as the operation unit to select imaging conditions to be set in the imaging region. The electronic device according to claim 13 or 14, wherein the control unit uses an operation member as the operation unit to select an imaging condition to be set in the imaging region. The pixel includes a photoelectric conversion unit that converts light into electric charge.
The electronic device according to any one of claims 1 to 15, wherein the setting unit sets the charge accumulation time of the photoelectric conversion unit as the imaging condition in the imaging region. The electronic device according to any one of claims 1 to 16, wherein the control unit displays the first image and the second image side by side on the display unit. The electronic device according to any one of claims 1 to 16, wherein the control unit switches between the first image and the second image and displays them on the display unit. The electronic device according to any one of claims 1 to 16, wherein the control unit displays an image obtained by combining the first image and the second image on the display unit. The control unit has the other of the first image and the second image due to the enlargement or reduction of one of the first image and the second image displayed on the display unit. The electronic device according to any one of claims 1 to 19, which enlarges or reduces the image of the above.