JP6409883B2 - Electronic equipment and control program - Google Patents

Description

  The present invention relates to an electronic device and a control program.

  There has been proposed an electronic apparatus provided with an imaging element in which a back-illuminated imaging chip and a signal processing chip are laminated (hereinafter, this imaging element is referred to as a laminated imaging element) (for example, see Patent Document 1). The multilayer imaging element is laminated so that the back-illuminated imaging chip and the signal processing chip are connected via a micro bump for each block unit including a plurality of pixels.

JP 2006-49361 A

  However, there are not many proposals for acquiring an image by capturing an image for each of a plurality of block units in an electronic device including a conventional multilayer image sensor, and the usability of the electronic device including the multilayer image sensor is not sufficient.

  In the aspect of the present invention, the change in the image corresponding to the change in the accumulation condition for each area is confirmed in the live view image by making the accumulation condition for the first area and the accumulation condition for the second area different in the live view image. For the purpose.

According to the aspect of the present invention, an imaging element having a first imaging area for imaging a subject and a second imaging area for imaging the subject, and an imaging condition set in the first imaging area in the second imaging area. A setting unit that sets an imaging condition different from that of the subject, and the setting unit includes the first image of the subject imaged under the imaging condition set in the first imaging region and the imaging condition set in the second imaging region. An electronic device that sets at least one of the imaging condition of the first imaging area and the imaging condition of the second imaging area when the second image of the captured subject is displayed on the display unit Is provided.
According to an aspect of the present invention, there is provided an electronic apparatus capable of displaying an image of a subject imaged by an imaging device having a first imaging area for imaging a subject and a second imaging area for imaging the subject. A first image of a subject imaged with a first imaging condition set in the imaging region; a second image of a subject imaged with a second imaging condition different from the first imaging condition set in the second imaging region; Control for displaying on the display unit a menu for setting the imaging conditions of the first imaging region and the second imaging region when the display unit capable of displaying the image, the first image, and the second image are displayed on the display unit. And an electronic device including the unit.
According to the aspect of the present invention, an imaging element having a first imaging area for imaging a subject and a second imaging area for imaging the subject, and an imaging condition set in the first imaging area in the second imaging area. An imaging device set in the second imaging area together with the first image of the subject imaged under the imaging condition set in the first imaging area in the control device of the electronic device including a setting unit that sets imaging conditions different from When the second image of the subject imaged under the condition is displayed on the display unit, the setting unit sets at least one of the imaging condition of the first imaging region and the imaging condition of the second imaging region There is provided a control program for executing the setting.
According to an aspect of the present invention, a control device for an electronic device capable of displaying an image of a subject captured by an imaging device having a first imaging region for capturing a subject and a second imaging region for capturing a subject A first image of a subject imaged with a first imaging condition set in one imaging region, and a second image of a subject imaged with a second imaging condition different from the first imaging condition set in a second imaging region , And when the first image and the second image are displayed on the display unit, a menu for setting the imaging conditions of the first imaging region and the second imaging region is displayed on the display unit. And a control program for executing the program is provided.
According to the first aspect of the present invention, the imaging unit has an imaging device and can capture the first region and the second region, and the live corresponding to the first region and the second region captured by the imaging unit. There is provided an electronic apparatus including a control unit that displays a view image on a display unit, and a changing unit that changes a storage condition for a first region of a live view image and a storage condition for a second region.

  According to the second aspect of the present invention, the display unit that has the imaging element and can display the live view image captured by the imaging unit that captures the first region and the second region, and the first image captured by the imaging unit. Provided is an electronic device including a control unit that displays a menu for setting imaging conditions of a live view image on the display unit when a live view image corresponding to the first region and the second region is displayed on the display unit Is done.

  According to the third aspect of the present invention, the first region captured by the image capturing unit and the first region captured by the control unit of the electronic device including the image capturing unit that includes the image capturing element and is capable of capturing the first region and the second region are provided. A control program for executing a display process for displaying a live view image corresponding to two areas on the display unit, and a changing process for making the accumulation condition for the first area of the live view image different from the accumulation condition for the second area Is provided.

  According to the fourth aspect of the present invention, the electronic apparatus control device includes a display unit that includes the imaging element and can display the live view image captured by the imaging unit that captures the first region and the second region. First display processing for displaying live view images corresponding to the first region and the second region captured by the imaging unit on the display unit, and imaging conditions for the live view image when the first display processing is performed And a control program for executing a second display process for displaying a menu for setting the display on the display unit.

  According to the aspect of the present invention, by changing the storage condition of the first region and the storage region of the second region of the live view image, the change in the image corresponding to the change of the storage condition for each region is changed in the live view image. Can be confirmed.

It is sectional drawing of a multilayer type image pick-up element. It is a figure explaining the pixel arrangement | sequence and unit group of an imaging chip. It is a circuit diagram corresponding to the unit group of an imaging chip. It is a block diagram which shows the functional structure of an image pick-up element. It is a block diagram which shows the structure of the electronic device which concerns on 1st Embodiment. It is a figure which shows an example of the display screen in a display part. 2 is a functional block diagram of an image processing unit and a system control unit in the first embodiment. FIG. It is a flowchart for demonstrating the imaging | photography operation | movement which the system control part which concerns on 1st Embodiment performs. It is a figure which shows the example of a display screen when a small number of blocks are set to an image display area. It is a figure which shows the example of a display screen when a small number of blocks are set to an image display area. It is a figure which shows the example of a display screen when a small number of blocks are set to an image display area. It is a figure which shows the example of a display screen when a small number of blocks are set to an image display area. It is a flowchart which shows an example of the imaging process which concerns on 1st Embodiment. It is a figure which shows the example of a display screen when many blocks are set to an image display area. It is a figure which shows the example of a display screen when many blocks are set to an image display area. It is a figure which shows the example of a display screen when many blocks are set to an image display area. It is a functional block diagram of the image processing part and system control part in 2nd Embodiment. It is a flowchart for demonstrating the imaging | photography operation | movement which the system control part which concerns on 2nd Embodiment performs. It is a flowchart which shows an example of the automatic setting process of an area | region and an imaging condition. It is a flowchart which shows an example of the imaging process which concerns on 2nd Embodiment. It is a figure which shows the example of a display of a display screen in case only the selected area | region is imaged. It is a block diagram which shows the structure of the imaging device and electronic device which concern on 3rd Embodiment. It is a figure which shows the example of a display of the display screen in 4th Embodiment.

  Embodiments of the present invention will be described below with reference to the drawings. However, the present invention is not limited to this. Further, in the drawings, in order to describe the embodiment, the scale is appropriately changed and expressed, for example, partly enlarged or emphasized.

<First Embodiment>
FIG. 1 is a cross-sectional view of a multilayer image sensor. The multilayer image sensor 100 is described in Japanese Patent Application No. 2012-139026 filed earlier by the applicant of the present application. The imaging device 100 includes an imaging chip 113 that outputs a pixel signal corresponding to incident light, a signal processing chip 111 that processes the pixel signal, and a memory chip 112 that stores the pixel signal. The imaging chip 113, the signal processing chip 111, and the memory chip 112 are stacked, and are electrically connected to each other by a conductive bump 109 such as Cu.

  As shown in the figure, incident light is incident mainly in the positive direction of the Z-axis indicated by a white arrow. In the present embodiment, in the imaging chip 113, the surface on the side where incident light is incident is referred to as a back surface. Further, as shown in the coordinate axes, the left direction of the paper orthogonal to the Z axis is the X axis plus direction, and the front side of the paper orthogonal to the Z axis and the X axis is the Y axis plus direction. In the following several figures, the coordinate axes are displayed so that the orientation of each figure can be understood with reference to the coordinate axes of FIG.

  An example of the imaging chip 113 is a back-illuminated MOS image sensor. The PD layer 106 is disposed on the back side of the wiring layer 108. The PD layer 106 includes a plurality of photodiodes (Photodiode; hereinafter referred to as PD) 104 that are two-dimensionally arranged and accumulate electric charges according to incident light, and a transistor 105 provided corresponding to the PD 104. .

  A color filter 102 is provided on the incident side of incident light in the PD layer 106 via a passivation film 103. The color filter 102 is a filter that passes a specific wavelength region of visible light. The color filter 102 has a plurality of types that transmit different wavelength regions, and has a specific arrangement corresponding to each of the PDs 104. The arrangement of the color filter 102 will be described later. A set of the color filter 102, the PD 104, and the transistor 105 forms one pixel.

  On the incident light incident side of the color filter 102, a microlens 101 is provided corresponding to each pixel. The microlens 101 condenses incident light toward the corresponding PD 104.

  The wiring layer 108 includes a wiring 107 that transmits the pixel signal from the PD layer 106 to the signal processing chip 111. The wiring 107 may be multilayer, and a passive element and an active element may be provided. A plurality of bumps 109 are disposed on the surface of the wiring layer 108. The plurality of bumps 109 are aligned with the plurality of bumps 109 provided on the opposing surface of the signal processing chip 111. Then, by pressing the imaging chip 113 and the signal processing chip 111, the aligned bumps 109 are joined and electrically connected.

  Similarly, a plurality of bumps 109 are disposed on the mutually facing surfaces of the signal processing chip 111 and the memory chip 112. These bumps 109 are aligned with each other. Then, when the signal processing chip 111 and the memory chip 112 are pressurized or the like, the aligned bumps 109 are joined and electrically connected.

  The bonding between the bumps 109 is not limited to Cu bump bonding by solid phase diffusion, and micro bump bonding by solder melting may be employed. Further, for example, about one bump 109 may be provided for one unit group described later. Therefore, the size of the bump 109 may be larger than the pitch of the PD 104. In addition, a bump larger than the bump 109 corresponding to the pixel region may be provided in a peripheral region other than the pixel region where the pixels are arranged (the pixel region 113A shown in FIG. 2).

  The signal processing chip 111 includes a TSV (Through-Silicon Via) 110 that connects circuits provided on the front surface and the back surface to each other. The TSV 110 is provided in the peripheral area. The TSV 110 may be provided in the peripheral area of the imaging chip 113 or the memory chip 112.

  FIG. 2 is a diagram for explaining a pixel array and a unit group of the imaging chip. FIG. 2 particularly shows a state where the imaging chip 113 is observed from the back side. An area where pixels are arranged in the imaging chip 113 is referred to as a pixel area 113A. In the pixel region 113A, 20 million or more pixels are arranged in a matrix. In the example shown in FIG. 2, 16 pixels of 4 pixels × 4 pixels adjacent to each other form one unit group 131. The grid lines in FIG. 2 indicate a concept in which adjacent pixels are grouped to form a unit group 131. The number of pixels forming the unit group 131 is not limited to this, and may be about 1000, for example, 32 pixels × 64 pixels, or more or less.

  As shown in the partially enlarged view of the pixel region 113A, the unit group 131 includes four so-called Bayer arrays including four pixels of green pixels Gb and Gr, a blue pixel B, and a red pixel R in the vertical and horizontal directions. The green pixel is a pixel having a green filter as the color filter 102, and receives light in the green wavelength band of incident light. Similarly, the blue pixel is a pixel having a blue filter as the color filter 102 and receives light in the blue wavelength band. The red pixel is a pixel having a red filter as the color filter 102 and receives light in the red wavelength band.

  FIG. 3 is a circuit diagram corresponding to the unit group of the imaging chip. In FIG. 3, a rectangle surrounded by a dotted line typically represents a circuit corresponding to one pixel. Note that at least some of the transistors described below correspond to the transistor 105 in FIG.

  As described above, the unit group 131 is formed of 16 pixels. The 16 PDs 104 corresponding to the respective pixels are each connected to the transfer transistor 302. The gate of each transfer transistor 302 is connected to a TX wiring 307 to which a transfer pulse is supplied. In the present embodiment, the TX wiring 307 is commonly connected to the 16 transfer transistors 302.

  The drain of each transfer transistor 302 is connected to the source of the corresponding reset transistor 303, and a so-called floating diffusion FD (charge detection unit) between the drain of the transfer transistor 302 and the source of each reset transistor 303 is connected to the amplifier transistor 304. Connected to the gate. The drain of each reset transistor 303 is connected to a Vdd wiring 310 to which a power supply voltage is supplied. The gate of each reset transistor 303 is connected to a reset wiring 306 to which a reset pulse is supplied. In the present embodiment, the reset wiring 306 is commonly connected to the 16 reset transistors 303.

  The drain of each amplification transistor 304 is connected to a Vdd wiring 310 to which a power supply voltage is supplied. The source of each amplification transistor 304 is connected to the drain of each corresponding selection transistor 305. The gate of each selection transistor 305 is connected to a decoder wiring 308 to which a selection pulse is supplied. In the present embodiment, the decoder wiring 308 is provided independently for each of the 16 selection transistors 305. The source of each selection transistor 305 is connected to a common output wiring 309. The load current source 311 supplies current to the output wiring 309. That is, the output wiring 309 for the selection transistor 305 is formed by a source follower. Note that the load current source 311 may be provided on the imaging chip 113 side or may be provided on the signal processing chip 111 side.

  Here, the flow from the start of charge accumulation to pixel output after the end of accumulation will be described. A reset pulse is applied to the reset transistor 303 through the reset wiring 306. At the same time, a transfer pulse is applied to the transfer transistor 302 through the TX wiring 307. As a result, the potentials of the PD 104 and the floating diffusion FD are reset.

  When the application of the transfer pulse is canceled, the PD 104 converts the incident light to be received into electric charge and accumulates it. Thereafter, when the transfer pulse is applied again without the reset pulse being applied, the charge accumulated in the PD 104 is transferred to the floating diffusion FD. As a result, the potential of the floating diffusion FD changes from the reset potential to the signal potential after charge accumulation. When a selection pulse is applied to the selection transistor 305 through the decoder wiring 308, the change in the signal potential of the floating diffusion FD is transmitted to the output wiring 309 through the amplification transistor 304 and the selection transistor 305. By such an operation of the circuit, a pixel signal corresponding to the reset potential and the signal potential is output from the unit pixel to the output wiring 309.

  As shown in FIG. 3, in the present embodiment, the reset wiring 306 and the TX wiring 307 are common to the 16 pixels forming the unit group 131. That is, the reset pulse and the transfer pulse are simultaneously applied to all 16 pixels. Therefore, all the pixels forming the unit group 131 start charge accumulation at the same timing and end charge accumulation at the same timing. However, the pixel signal corresponding to the accumulated charge is selectively output to the output wiring 309 by sequentially applying the selection pulse to each selection transistor 305. In addition, the reset wiring 306, the TX wiring 307, and the output wiring 309 are provided separately for each unit group 131.

  By configuring the circuit with the unit group 131 as a reference in this way, the charge accumulation time can be controlled for each unit group 131. In other words, pixel signals with different charge accumulation times can be output between the unit groups 131. More specifically, while one unit group 131 performs charge accumulation once, the other unit group 131 repeats charge accumulation several times and outputs a pixel signal each time, so that Each frame for moving images can be output at a different frame rate between the unit groups 131.

  FIG. 4 is a block diagram illustrating a functional configuration of the image sensor. The analog multiplexer 411 sequentially selects the 16 PDs 104 that form the unit group 131. Then, the multiplexer 411 outputs each pixel signal of the 16 PDs 104 to the output wiring 309 provided corresponding to the unit group 131. The multiplexer 411 is formed on the imaging chip 113 together with the PD 104.

  The analog pixel signal output through the multiplexer 411 is amplified by an amplifier 412 formed in the signal processing chip 111. Then, the pixel signal amplified by the amplifier 412 is formed in the signal processing chip 111 by a signal processing circuit 413 that performs correlated double sampling (CDS) / analog / digital (Analog / Digital) conversion. Correlated double sampling signal processing is performed, and A / D conversion (conversion from an analog signal to a digital signal) is performed. The pixel signal is subjected to correlated double sampling signal processing in the signal processing circuit 413, whereby noise of the pixel signal is reduced. The A / D converted pixel signal is transferred to the demultiplexer 414 and stored in the pixel memory 415 corresponding to each pixel. The demultiplexer 414 and the pixel memory 415 are formed in the memory chip 112.

  The arithmetic circuit 416 processes the pixel signal stored in the pixel memory 415 and passes it to the subsequent image processing unit. The arithmetic circuit 416 may be provided in the signal processing chip 111 or may be provided in the memory chip 112. Note that FIG. 4 shows connections for one unit group 131, but actually these exist for each unit group 131 and operate in parallel. However, the arithmetic circuit 416 may not exist for each unit group 131. For example, one arithmetic circuit 416 may perform sequential processing while sequentially referring to the values in the pixel memory 415 corresponding to each unit group 131.

  As described above, the output wiring 309 is provided corresponding to each of the unit groups 131. The image sensor 100 is formed by stacking an image pickup chip 113, a signal processing chip 111, and a memory chip 112. For this reason, by using the electrical connection between the chips using the bumps 109 for the output wirings 309, the wirings can be routed without enlarging each chip in the surface direction.

  Next, blocks set in the pixel region 113A (see FIG. 2) of the image sensor 100 will be described. In the present embodiment, the pixel region 113A of the image sensor 100 is divided into a plurality of blocks. The plurality of blocks are defined to include at least one unit group 131 per block. In each block, pixels included in each block are controlled by different control parameters. That is, pixel signals having different control parameters are acquired for a pixel group included in a block and a pixel group included in another block. Examples of the control parameter include a charge accumulation time or accumulation count, a frame rate, a gain, a thinning rate, the number of addition rows or addition columns to which pixel signals are added, the number of digitization bits, and the like. Furthermore, the control parameter may be a parameter in image processing after obtaining an image signal from a pixel.

  Here, the charge accumulation time refers to the time from when PD 104 starts to accumulate charge until it ends. The number of times of charge accumulation refers to the number of times the PD 104 accumulates charges per unit time. The frame rate is a value representing the number of frames processed (displayed or recorded) per unit time in a moving image. The unit of the frame rate is represented by fps (Frames Per Second). The higher the frame rate, the smoother the movement of the subject in the video.

  The gain means a gain factor (amplification factor) of the amplifier 412. By changing this gain, the ISO sensitivity can be changed. This ISO sensitivity is a photographic film standard established by ISO and represents how much light the photographic film can record. However, generally, ISO sensitivity is also used when expressing the sensitivity of the image sensor 100. In this case, the ISO sensitivity is a value representing the ability of the image sensor 100 to capture light. Increasing the gain improves the ISO sensitivity. For example, when the gain is doubled, the electrical signal (pixel signal) is also doubled, and the brightness is appropriate even when the amount of incident light is half. However, when the gain is increased, noise included in the electric signal is also amplified, so that noise increases.

  The thinning-out rate is the ratio of the number of pixels that do not read out pixel signals with respect to the total number of pixels in a predetermined area. For example, when the thinning rate of a predetermined area is 0, it means that pixel signals are read from all pixels in the predetermined area. Further, when the thinning rate of the predetermined area is 0.5, it means that the pixel signal is read from half of the pixels in the predetermined area. Specifically, when the unit group 131 is a Bayer array, it is read as a pixel from which pixel signals are alternately read out every other unit of the Bayer array in the vertical direction, that is, every two pixels (two rows) of the pixel unit. Pixels that are not output are set. It should be noted that the resolution of the image is reduced when the pixel signal readout is thinned out. However, since 20 million or more pixels are arranged in the image sensor 100, for example, even if thinning is performed at a thinning rate of 0.5, an image can be displayed with 10 million or more pixels. For this reason, it is considered that the reduction in resolution is not a concern for the user.

  Further, the number of added rows refers to the number of vertical pixels (number of rows) to be added when pixel signals of pixels adjacent in the vertical direction are added. Further, the number of added columns refers to the number of horizontal pixels (number of columns) to be added when pixel signals of pixels adjacent in the horizontal direction are added. Such addition processing is performed in the arithmetic circuit 416, for example. The arithmetic circuit 416 performs the process of adding the pixel signals of a predetermined number of pixels adjacent in the vertical direction or the horizontal direction, thereby obtaining the same effect as the process of reading out the pixel signals by thinning out at a predetermined thinning rate. In the addition process described above, the average value may be calculated by dividing the added value by the number of rows or columns added by the arithmetic circuit 416.

  The number of bits for digitization refers to the number of bits when the signal processing circuit 413 converts an analog signal into a digital signal in A / D conversion. As the number of bits of the digital signal increases, brightness, color change, and the like are expressed in more detail.

  In the present embodiment, the accumulation condition refers to a condition related to charge accumulation in the image sensor 100. Specifically, the accumulation condition refers to the charge accumulation time or number of accumulations, the frame rate, and the gain among the control parameters described above. Since the frame rate can change according to the charge accumulation time and the number of times of accumulation, the frame rate is included in the accumulation condition. Further, the amount of light for proper exposure changes according to the gain, and the charge accumulation time or number of times of accumulation can also change according to the amount of light for proper exposure. For this reason, the gain is included in the accumulation condition.

  The imaging condition is a condition related to imaging of a subject. Specifically, the imaging condition refers to a control parameter including the above accumulation condition. The imaging conditions include control parameters (for example, charge accumulation time or accumulation count, frame rate, gain) for controlling the image sensor 100, as well as control parameters (for controlling reading of signals from the image sensor 100). For example, a thinning rate), a control parameter for processing a signal from the image sensor 100 (for example, the number of addition rows or addition columns for adding pixel signals, the number of digitization bits, the image processing unit 30 described later performs image processing) Is also included.

  FIG. 5 is a block diagram illustrating a configuration of the electronic device according to the first embodiment. As shown in FIG. 5, the electronic device 1 includes a lens unit 10, an imaging unit 20, an image processing unit 30, a work memory 40, a display unit 50, an operation unit 55, a recording unit 60, and a system control unit 70. The lens unit 10 is an imaging optical system composed of a plurality of lens groups. The lens unit 10 guides the light flux from the subject to the imaging unit 20. The lens unit 10 may be integrated with the electronic device 1 or may be an interchangeable lens that can be attached to and detached from the electronic device 1. Further, the lens unit 10 may have a built-in focus lens or a zoom lens.

  The imaging unit 20 includes an imaging element 100 and a drive unit 21. The drive unit 21 is a control circuit that controls driving of the image sensor 100 in accordance with an instruction from the system control unit 70. Here, the drive unit 21 controls the timing (or timing cycle) at which the reset pulse and the transfer pulse are applied to the reset transistor 303 and the transfer transistor 302, respectively, thereby reducing the charge accumulation time or accumulation count as a control parameter. Control. In addition, the drive unit 21 controls the frame rate by controlling the timing (or timing cycle) at which the reset pulse, the transfer pulse, and the selection pulse are applied to the reset transistor 303, the transfer transistor 302, and the selection transistor 305, respectively. To do. The drive unit 21 controls the thinning rate by setting pixels to which the reset pulse, the transfer pulse, and the selection pulse are applied.

  In addition, the drive unit 21 controls the ISO sensitivity of the image sensor 100 by controlling the gain (also referred to as gain factor or amplification factor) of the amplifier 412. In addition, the driving unit 21 sends an instruction to the arithmetic circuit 416 to set the number of added rows or the number of added columns to which the pixel signals are added. Further, the drive unit 21 sets the number of bits for digitization by sending an instruction to the signal processing circuit 413. Furthermore, the drive unit 21 performs block setting in the pixel area (imaging area) 113 </ b> A of the image sensor 100. In this way, the drive unit 21 functions as an image sensor control unit that causes the image sensor 100 to capture an image under different image capturing conditions for each of a plurality of blocks and output a pixel signal. The system control unit 70 instructs the drive unit 21 on the block position, shape, range, and the like.

  The image sensor 100 delivers the pixel signal from the image sensor 100 to the image processing unit 30. The image processing unit 30 uses the work memory 40 as a work space, performs various image processing on the raw image data composed of pixel signals of each pixel, and generates image data. The image processing unit 30 has a CPU, and the CPU executes various image processes. For example, the image processing unit 30 generates an RGB image signal by performing color signal processing on a signal obtained by the Bayer array. The image processing unit 30 performs image processing such as white balance adjustment, sharpness adjustment, gamma correction, and gradation adjustment on the RGB image signal. Further, the image processing unit 30 performs a process of compressing in a predetermined compression format (JPEG format, MPEG format, etc.) as necessary. The image data generated in the image processing unit 30 is recorded in the recording unit 60 via the system control unit 70. Further, the image data generated by the image processing unit 30 is output to the display unit 50 via the system control unit 70 and displayed on the display unit 50.

  In the present embodiment, the image processing unit 30 performs a process of synthesizing image data based on an image captured continuously a plurality of times, in addition to the process described above. By such processing, noise is removed.

  Parameters that are referred to when the image processing unit 30 performs image processing are also included in the control parameters (imaging conditions). For example, parameters such as color signal processing, white balance adjustment, gradation adjustment, and compression rate are included in the control parameters. The signal read from the image sensor 100 changes according to the charge accumulation time, and the parameters referred to when performing image processing also change according to the change in the signal. The image processing unit 30 sets different control parameters for each block, and executes image processing such as color signal processing based on these control parameters.

  The image processing unit 30 extracts frames at predetermined timings from a plurality of frames obtained in time series from the imaging unit 20. Alternatively, the image processing unit 30 discards frames at a predetermined timing among a plurality of frames obtained in time series from the imaging unit 20. Thereby, since the amount of data can be reduced, it is possible to reduce the load of subsequent processing. Further, the image processing unit 30 calculates one or a plurality of frames to be interpolated between the frames based on a plurality of frames obtained in time series from the imaging unit 20. Then, the image processing unit 30 adds the calculated one or more frames between the frames. As a result, a moving image with smoother motion can be reproduced during moving image reproduction. Moreover, although the drive part 21 is comprised so that the thinning-out rate may be controlled, it is not restricted to such a structure. For example, the drive unit 21 reads pixel signals from all pixels, but the image processing unit 30 or the arithmetic circuit 416 controls the thinning rate by discarding predetermined pixel signals out of the read pixel signals. Good.

  The work memory 40 temporarily stores image data and the like when image processing by the image processing unit 30 is performed. The display unit 50 is configured by a liquid crystal display panel, for example. As shown in FIG. 5, the display unit 50 includes a first display unit 51, a first touch panel (selection unit, first operation unit) 52, a second display unit 53, and a second touch panel (first touch panel). 2 operation part) 54.

  The first display unit 51 displays images (still images, moving images, live view images) captured by the imaging unit 20 and various types of information. The first touch panel 52 is formed on the display screen of the first display unit 51. The first touch panel 52 outputs a signal indicating a position touched by the user to the system control unit 70 when the user designates an area. The second display unit 53 displays a menu for the user to set imaging conditions (control parameters). The second touch panel 54 is formed on the display screen of the second display unit 53. The second touch panel 54 outputs a signal indicating the position touched by the user to the system control unit 70 when the user sets the imaging condition.

  The operation unit 55 includes a shutter button, a recording start button, and various operation switches that are operated by the user. The operation unit 55 outputs a signal corresponding to the operation by the user to the system control unit 70. The recording unit 60 has a card slot into which a storage medium such as a memory card can be mounted. The recording unit 60 stores the image data and various data generated by the image processing unit 30 in a recording medium mounted in the card slot. The recording unit 60 has an internal memory. The recording unit 60 may be configured to record the image data and various data generated by the image processing unit 30 in an internal memory.

  The system control unit 70 controls the overall processing and operation of the electronic device 1. The system control unit 70 has a CPU (Central Processing Unit). In the present embodiment, the system control unit 70 divides the imaging surface (pixel area 113A) of the imaging device 100 (imaging chip 113) into a plurality of blocks, and different charge accumulation times (or charge accumulation times) and frame rates among the blocks. Get an image with a gain. Therefore, the system control unit 70 instructs the drive unit 21 about the block position, shape, range, and accumulation condition for each block. In addition, the system control unit 70 causes an image to be acquired with a different thinning rate between blocks, the number of addition rows or addition columns to which pixel signals are added, and the number of digitization bits. For this reason, the system control unit 70 instructs the drive unit 21 on the imaging conditions for each block (the thinning rate, the number of added rows or columns to which pixel signals are added, and the number of digitization bits). Further, the image processing unit 30 executes image processing under imaging conditions (control parameters such as color signal processing, white balance adjustment, gradation adjustment, and compression rate) that are different between blocks. For this reason, the system control unit 70 instructs the image processing unit 30 on the imaging conditions for each block (control parameters such as color signal processing, white balance adjustment, gradation adjustment, and compression rate).

  Further, the system control unit 70 causes the recording unit 60 to record the image data generated by the image processing unit 30. Further, the system control unit 70 causes the first display unit 51 of the display unit 50 to display an image by outputting the image data generated in the image processing unit 30 to the display unit 50. Alternatively, the system control unit 70 reads out the image data recorded in the recording unit 60 and outputs the image data to the display unit 50, thereby causing the first display unit 51 of the display unit 50 to display an image. The images displayed on the first display unit 51 include still images, moving images, and live view images. Here, the live view image is an image displayed on the first display unit 51 by sequentially outputting the image data generated by the image processing unit 30 to the display unit 50. The live view image is used for the user to confirm the image of the subject imaged by the imaging unit 20. The live view image is also called a through image or a preview image.

  The image processing unit 30 is realized by the CPU executing processing based on the control program. The system control unit 70 is realized by the CPU executing processing based on the control program.

  FIG. 6 is a diagram illustrating an example of a display screen in the display unit. As shown in FIG. 6, the display screen 500 of the display unit 50 is provided with an image display area 510 and an operation button display area 520. The image display area 510 is an area for displaying an image captured by the imaging unit 20, that is, a still image, a moving image, and a live view image. The operation button display area 520 is an area for displaying a menu for the user to set imaging conditions and the like. In the present embodiment, the image display area 510 and the operation button display area 520 are provided in one display screen 500. The image display area 510 corresponds to the first display unit 51, and the operation button display area 520 corresponds to the second display unit 53.

  In the image display area 510, a plurality of blocks B (i, j) are set. In the example shown in FIG. 6, in the block B (i, j), eight blocks (i = 1 to 8) are set in the horizontal direction (lateral direction in FIG. 6) in the image display area 510, and the vertical direction ( Six blocks (j = 1 to 6) are set in the vertical direction of FIG. That is, the image display area 510 is divided into 8 × 6 (= 48) blocks. A first touch panel 52 is provided on the image display area 510. In the first touch panel 52, a plurality of touch areas P (i, j) are formed so as to overlap each of the plurality of blocks B (i, j). When it is detected that each touch area P (i, j) is pressed (touched) by the user, a detection signal indicating the pressed position (which touch area) is sent to the system control unit 70. Output.

  The operation button display area 520 is provided in the vicinity of the image display area 510. In the operation button display area 520, a menu (menu image) for the user to set the area, imaging conditions, and imaging mode is displayed. A menu for setting a region by the user is a setting button 521. The menu for the user to set imaging conditions includes an ISO sensitivity button 522 (also referred to as a menu related to gain), a shutter speed button 523 (also referred to as a menu related to charge accumulation time), and a frame. A rate button 524 (which is also referred to as a frame rate menu). The menu for the user to set the shooting mode is a shooting mode button 525. Hereinafter, the setting button 521, the ISO sensitivity button 522, the shutter speed button 523, the frame rate button 524, and the shooting mode button 525 are simply referred to as “setting 521”, “ISO sensitivity 522”, respectively. “Shutter 523”, “Frame rate 524”, and “Shooting mode 525” are described.

  A setting 521 is a button to be pressed when the user sets (selects) an area in the image display area 510 in units of blocks. The ISO sensitivity 522 is a button that is pressed when the user sets the ISO sensitivity (that is, gain). The shutter 523 is a button that is pressed when the user sets the shutter speed (that is, the exposure time). The shutter speed corresponds to the charge accumulation time. The frame rate 524 is a button that is pressed when the user sets the frame rate of a moving image or a live view image. The shooting mode 525 is a button that is pressed when the user selects whether to manually set the imaging condition or to automatically set the imaging condition.

  A second touch panel 54 is provided on the operation button display area 520. In the second touch panel 54, the touch area 521 a is formed so as to overlap the setting 521. Further, the touch area 522 a is formed so as to overlap the ISO sensitivity 522. Further, the touch area 523 a is formed so as to overlap the shutter 523. Further, the touch area 524a is formed to overlap the frame rate 524. Further, the touch area 525a is formed so as to overlap the shooting mode 525. When it is detected that the touch areas 521a to 525a are pressed (touched) by the user, each touch area 521a to 525a outputs a detection signal indicating the pressed position (which touch area) to the system control unit 70. In the present embodiment, the first touch panel 52 and the second touch panel 54 may be configured with separate touch panels or may be configured with one touch panel. In the case of a single touch panel, the touch area P (i, j) of the touch panel corresponds to the first touch panel 52, and the touch areas 521 a to 525 a correspond to the second touch panel 54.

  FIG. 7 is a functional block diagram of the image processing unit and the system control unit in the first embodiment. As shown in FIG. 7, the image processing unit 30 includes a synthesis processing unit 31. The synthesis processing unit 31 performs a process of synthesizing images picked up multiple times at high speed. By such processing, noise included in the image is reduced. That is, this process functions as a noise reduction.

  The system control unit 70 includes a display control unit (control unit) 71, a change unit 72, a selection unit 73, and an imaging control unit (image composition unit) 74. The display control unit 71 performs control to display an image (still image, moving image, live view image) on the first display unit 51 by outputting the image data to the display unit 50. In addition, the display control unit 71 performs control for displaying a preset menu image on the second display unit 53. The changing unit 72 performs control to change the imaging condition (including the accumulation condition) according to the touch operation of the second touch panel 54 by the user or automatically. In addition, the selection unit 73 performs control to select an area in the image display area 510 in units of blocks in response to a touch operation on the first touch panel 52 by the user. In addition, the imaging control unit (image composition unit) 74 executes imaging control according to the operation of the shutter button (operation unit 55) by the user.

  In the embodiment (the first embodiment, the second and third embodiments described later), the “first area” is a selection unit in the image display area 510 of the display screen 500 according to a user operation or automatically. A region in the pixel region 113 </ b> A of the image sensor 100 corresponding to the region selected by 73. Further, the “second area” refers to an area in the pixel area 113 </ b> A of the image sensor 100 corresponding to an area selected by the selection unit 73 in response to a user operation in the image display area 510 of the display screen 500. Refers to an area. The first region and the second region may be one and the other of the two divided regions, or may be one of the regions divided into three or more and the other.

  Next, the photographing operation according to the first embodiment will be described. FIG. 8 is a flowchart for explaining a photographing operation executed by the system control unit according to the first embodiment. 9 to 12 are diagrams showing display examples of the display screen when a small number of blocks are set in the image display area.

  In the process shown in FIG. 8, when the user operates the operation unit 55 or the like to start shooting after the electronic device 1 is turned on, the system control unit 70 starts the shooting operation (step S1). ). The user performs an operation of selecting whether to shoot a still image or a moving image in advance.

  When shooting is started, the display control unit 71 displays the live view image captured by the imaging unit 20 on the first display unit 51 (image display area 510) (step S2). In the example shown in FIG. 9, a waterfall live view image is displayed in the image display area 510. When the user selects an area in the image display area 510, the user touches the setting 521 (that is, the touch area 521a) with a finger. As a result, an area in the image display area 510 can be selected, that is, the first touch panel 52 can detect a touch operation. Thereafter, the user touches the block B (i, j) set in the image display area 510 with a finger (or traces with the finger) to select an area in the image display area 510 in units of blocks. . The first touch panel 52 outputs a detection signal corresponding to the touch area P (i, j) touched by the user to the system control unit 70.

  The selection unit 73 recognizes the region selected by the user based on the detection signal from the first touch panel 52. In the example shown in FIG. 10, the area 511 is selected by the user. This region 511 is a background region behind the waterfall (a region with a white line in FIG. 10). Specifically, the area 511 includes blocks B (3, 1) to B (8, 1), B (4, 2) to B (8, 2), B (5, 3) to B (8, 3). ), B (6, 4) to B (8, 4).

  The selection unit 73 determines whether or not an area has been selected by the user (step S3). If it is determined that the area is selected by the user, the selection unit 73 sets the area 511 selected by the user (step S4). Specifically, the selection unit 73 outputs an instruction signal that instructs the drive unit 21 of the position of the block selected by the user.

  The changing unit 72 determines whether or not the auto mode (automatic mode) is selected as the shooting mode by the user (step S5). Here, when setting the shooting mode, the user touches the shooting mode 525 (that is, the touch area 525a). Then, the user selects a manual mode (manual mode) or an auto mode (automatic mode) among the photographing modes. When the changing unit 72 determines that the auto mode is not selected as the shooting mode, that is, when it is determined that the manual mode is selected as the shooting mode, the imaging condition is determined according to the operation of the second touch panel 54 by the user. (Including storage conditions) is set (step S6).

  For example, when the ISO sensitivity is set as the imaging condition, the user touches the ISO sensitivity 522 (that is, the touch area 522a). The second touch panel 54 outputs a detection signal corresponding to the touch area 522 a touched by the user to the system control unit 70. As shown in FIG. 11, the display control unit 71 displays a plurality of ISO sensitivity values next to the ISO sensitivity 522. In the example illustrated in FIG. 11, “100”, “200”, “400”, “800”, and “1600” are displayed as the ISO sensitivity. The changing unit 71 sets a new touch area on the second touch panel 54 so as to overlap the area of each value of ISO sensitivity. The user touches one of the ISO sensitivity values. The second touch panel 54 outputs a detection signal corresponding to the touch area touched by the user to the system control unit 70. The changing unit 72 sets the ISO sensitivity value touched by the user. Specifically, the changing unit 72 outputs an instruction signal for instructing a gain corresponding to the ISO sensitivity selected by the user to the driving unit 21.

  The user performs the same operation as setting the ISO sensitivity when setting the shutter speed (charge accumulation time) and the frame rate. That is, the user touches the shutter 523 (that is, the touch area 523a) or the frame rate 524 (that is, the touch area 524a) when setting the shutter speed or the frame rate as the imaging condition. The second touch panel 54 outputs a detection signal corresponding to the touch area 523a or 524a touched by the user to the system control unit 70. The display control unit 71 displays a plurality of shutter speed or frame rate values next to the shutter 523 or the frame rate 524. The user touches either the shutter speed or the frame rate value. The change unit 72 sets the shutter speed or frame rate value touched by the user. Specifically, the changing unit 72 outputs an instruction signal for instructing the shutter speed or frame rate selected by the user to the driving unit 21.

  The drive unit 21 receives an instruction signal that instructs the area of the pixel area 113A corresponding to the area 511 selected by the user in units of blocks. Further, the drive unit 21 receives an instruction signal for instructing an imaging condition selected by the user. In response to this, the drive unit 21 drives the imaging unit 20 so as to perform imaging in the designated imaging condition (shutter speed, ISO sensitivity, frame rate) in the region of the pixel region 113A corresponding to the region 511. In general, the shutter speed is set when capturing a still image, and the frame rate is set when capturing a moving image.

  As described above, when the imaging condition of the region of the pixel region 113 </ b> A corresponding to the region 511 is changed by the drive unit 21, the image (live view image in the region 511) displayed in the region 511 in the image display region 510 changes. . For example, when the ISO sensitivity is increased, the subject is brightly imaged even with a small amount of light. Also, the dark part of the live view image becomes brighter. In addition, when the shutter speed is increased, blurring of a moving subject is reduced. Further, when the frame rate is increased, the movement of the subject in the moving image becomes smooth.

  As described above, the user can confirm the image of the selected region that changes in accordance with the change in the imaging condition in the live view image by selecting the region and setting the imaging condition in the selected region. . In this case, the imaging condition selected by the user may not be a condition suitable for proper exposure. However, the user can also recognize that the exposure condition is overexposed or underexposed by changing the imaging condition. Further, the user can recognize how the image changes when the imaging condition is changed. Therefore, the user can take an image after creating an image by changing the imaging conditions before taking the image.

  The processes in steps S1 to S6 as described above are repeated until the user performs a half-pressing operation (step S8) of the shutter (recording start button when shooting a moving image) of the operation unit 55. In the example illustrated in FIG. 12, an area 512 other than the area 511 is selected from the image display area 510. The live view image displayed in the area 512 in the image display area 510 changes according to the selection of the ISO sensitivity 522, the shutter 523, and the frame rate 524 by the user.

  A region 512 shown in FIG. 12 is a waterfall region (a region where a white line in FIG. 12 is drawn). Specifically, the area 512 includes blocks B (1,1) to B (2,1), B (1,2) to B (3,2), B (1,3) to B (4,3 ), B (1, 4) to B (5, 4), B (1, 5) to B (8, 5), and B (1, 6) to B (8, 6).

  When it is determined that the auto mode is selected as the shooting mode (YES in step S5), the changing unit 72 automatically sets the imaging condition of the area 511 selected by the user (step S7). At this time, the changing unit 72 changes the imaging condition based on at least one of the contrast and the color change of the image in the region 511 in the live view image. For example, the changing unit 72 changes the imaging conditions (ISO sensitivity, shutter speed, frame rate) so that the contrast between the bright part and the dark part of the image in the region 511 is maximized. The changing unit 72 changes the imaging conditions (ISO sensitivity, shutter speed, frame rate) so that the color change of the image in the region 511 becomes the most vivid. In addition, the changing unit 72 changes the imaging condition so that the contrast of the image in the region 511 is maximized and the color change of the image in the region 511 is the most vivid.

  Processing (steps S1 to S5, S7) when the auto mode is selected as the shooting mode is repeatedly executed until the user performs a half-pressing operation (step S8) of the shutter of the operation unit 55. For example, also in the region 512, the changing unit 72 automatically sets the imaging condition based on at least one of the contrast and the color change of the image in the region 512 (step S7). The live view images displayed in the areas 511 and 512 in the image display area 510 change according to the ISO sensitivity, shutter speed, or frame rate value changed by the changing unit 72.

  Although not illustrated in FIGS. 9 to 12, the imaging conditions for each region that can be set by the user are not limited to ISO sensitivity, shutter speed, and frame rate. For example, the above-described thinning rate, the number of addition rows or addition columns to which pixel signals are added, the number of digitization bits, and the like may be set as imaging conditions for each region. Further, parameters such as color signal processing, white balance adjustment, gradation adjustment, and compression rate may be set as imaging conditions for each region.

  The system control unit 70 determines whether a half-press operation (SW1 operation) of the shutter or the recording start button has been performed (step S8). The half-press operation is used as an instruction to start shooting preparation. Although not shown in FIG. 8, the system control unit 70 performs auto focus (AF) control and the like for automatically performing focus adjustment.

  Next, the system control unit 70 determines whether or not a full press operation (SW2 operation) of the shutter or the recording start button has been performed (step S9). If it is determined that the full-press operation has been performed, the imaging control unit 74 performs an imaging process that causes the imaging element 100 to perform imaging (step S10). FIG. 13 is a flowchart illustrating an example of an imaging process according to the first embodiment. First, the imaging control unit 74 determines whether or not the ISO sensitivity is set to a predetermined value or higher by the user or automatically (step S11). If the imaging control unit 74 determines that the ISO sensitivity is not set to a predetermined value or higher, the imaging control unit 74 causes the imaging unit 20 to perform normal imaging (step S12). That is, a still image is acquired by one imaging as usual. At this time, imaging is performed according to the imaging conditions for each region selected as described above.

  On the other hand, if the imaging control unit 74 determines that the ISO sensitivity is set to a predetermined value or more, the imaging control unit 74 causes the imaging unit 20 to perform continuous imaging multiple times (step S13). For example, the imaging control unit 74 causes the imaging unit 20 to perform imaging five times at high speed by outputting an instruction signal to the driving unit 21. Also in this case, imaging is performed according to the imaging condition for each area selected as described above. For example, imaging is executed a plurality of times during the shutter speed that has already been set.

  Further, the imaging control unit 74 instructs the image processing unit 30 to synthesize a plurality of images that are continuously captured a plurality of times (step S14). In the image processing unit 30, the composition processing unit 31 composes a plurality of images based on an instruction from the imaging control unit 74 and generates a still image. When the ISO sensitivity is increased, noise is likely to occur. However, as described above, noise is reduced by combining a plurality of images captured at high speed.

  In addition, in the imaging process of step S10, when imaging a moving image, the imaging control unit 74 executes normal imaging without performing the process shown in step S11 of FIG. 13 (step S12). That is, in the case of capturing a moving image, a plurality of continuous images and a plurality of images are not combined as shown in step S13.

  In the display examples of the display screen 500 shown in FIGS. 9 to 12, each block set in the image display area 510 is a large area block. However, blocks in an area smaller than the blocks shown in FIGS. 9 to 12 may be set in the image display area 510. 14 to 16 are diagrams illustrating display examples of the display screen when a large number of blocks are set in the image display area. In the example shown in FIGS. 14 to 16, the block is the same area as the unit group or an area including several unit groups.

  When the user selects an area, after touching the setting 521, the user traces his / her finger along the boundary of the area to be selected as shown in FIG. By such a selection method, a region can be selected more finely. The operation for changing the imaging condition is the same as that described with reference to FIGS. That is, as shown in FIG. 14, the user selects a region 513. This region 513 is the background region behind the waterfall (the region where the white line in FIG. 14 is drawn). When the user touches the ISO sensitivity 522, a plurality of ISO sensitivity values appear next to the ISO sensitivity 522 as shown in FIG. The user touches one of the ISO sensitivity values to set the ISO sensitivity. The user touches the shutter 523 or the frame rate 524 to set the shutter speed or the frame rate.

  Further, after the user touches the setting 521, the user selects the region 514 by tracing his / her finger along the boundary of the region to be selected as shown in FIG. Then, as described above, the user touches the ISO sensitivity 522, the shutter 523, and the frame rate 524 to set the ISO sensitivity, shutter speed, and frame rate in the area 514. Similarly to the case described with reference to FIGS. 9 to 12, it is possible to automatically change the imaging condition for each region by touching the imaging mode 525 and changing the imaging mode. .

  As described above, in the first embodiment, the imaging unit 20 that includes the imaging device 100 and can capture the first region and the second region, and the first region and the second region captured by the imaging unit 20 are used. A control unit 71 that displays a live view image corresponding to the area on the display unit 50, and a changing unit 72 that makes the accumulation condition of the first area of the live view image different from the accumulation condition of the second area are included. According to such a configuration, a change in the image corresponding to the change in the accumulation condition for each region can be confirmed in the live view image. Therefore, the user can create an image by changing the imaging conditions for each region before starting to capture a still image or a moving image. It can be said that such processing performs editing before imaging of an image.

  The changing unit 72 is configured to make the accumulation time of the first area different from the accumulation time of the second area. Accordingly, the user can edit an image with different accumulation times (shutter speeds) for each region, and can take an image after confirming the edited image. The changing unit 72 is configured to make the frame rate of the first area different from the frame rate of the second area. Therefore, the user can edit the image by changing the frame rate for each region, and can take an image after confirming the edited image. The changing unit 72 is configured to make the gain of the first region different from the gain of the second region. Therefore, the user can edit the image with different gains (ISO sensitivity) for each region, and can take an image after confirming the edited image.

  The changing unit 72 is configured to make the accumulation condition for the first area different from the accumulation condition for the second area based on at least one of the contrast and color change of the live view image. Therefore, an optimum accumulation condition can be automatically set for each region based on at least one of contrast and color change.

  Moreover, the selection part 73 which can select the 1st area | region and 2nd area | region of a live view image is provided. Therefore, the user can select an arbitrary area. Or the selection part 73 can select the area | region according to the to-be-photographed object of a live view image automatically, and can provide the selected area | region to a user. In addition, since the image composition unit 74 that captures and composes at least a part of the region selected by the selection unit 73 a plurality of times is provided, noise can be reduced. This configuration is effective particularly when the gain is increased.

  Moreover, since the selection part 73 has the 1st operation part 52 which selects a part of live view image, the user can select an area | region, visually recognizing a live view image. Moreover, since the 1st operation part 52 has the touchscreen formed in the display part 50, the user can select an area | region by touch operation of a touchscreen. For this reason, a region can be easily selected by a simple operation.

  In addition, since the second operation unit 54 for selecting a menu (setting 521 in the operation button display area 520, ISO sensitivity 522, shutter 523, frame rate 524, shooting mode 525) is provided, the user can perform imaging conditions by touching the touch panel. Etc. can be selected. For this reason, an imaging condition etc. can be selected easily by simple operation. In addition, since the control unit 71 displays at least one of a menu related to gain (ISO sensitivity 522), a menu related to accumulation time (shutter 523), and a menu related to frame rate (frame rate 524), the gain and accumulation time are displayed. And at least one of the frame rates can be selected by a touch operation on the touch panel. Further, since the control unit 71 displays the menu in the vicinity of the live view image, it is possible to change the imaging condition while confirming the change of the live view image corresponding to the change of the imaging condition. Therefore, the operability by the user is improved.

  Note that the electronic device 1 according to the first embodiment shown in FIG. 5 includes devices such as a digital camera, a smartphone, a mobile phone, and a personal computer having an imaging function. Further, in the electronic device 1 according to the first embodiment shown in FIG. 5, the display unit 50 may be provided outside the electronic device. In this case, each of the system control unit 70 and the display unit 50 is provided with a communication unit that transmits and receives signals (image data, control signals, and the like) by wire or wirelessly. Further, the image processing unit 30 and the system control unit 70 may be configured integrally. In this case, the system control unit having one CPU executes the processing based on the control program, thereby taking on the functions of the image processing unit 30 and the system control unit 70.

Second Embodiment
In the first embodiment described above, the selection of the area in the image display area 510 is performed manually. In the second embodiment, the selection of the area can also be performed automatically (automatically). In the second embodiment, the region and the imaging condition (including the accumulation condition) are set according to the movement of the moving subject. The second embodiment also has a function of imaging only an area selected by the user or an area automatically selected.

  FIG. 17 is a functional block diagram of an image processing unit and a system control unit in the second embodiment. As illustrated in FIG. 17, the image processing unit 30 </ b> A includes a synthesis processing unit 31 and a detection unit 32. Since the composition processing unit 31 has the same configuration as that described with reference to FIG. The detection unit 32 performs a process of detecting a moving subject (for example, a waterfall shown in FIG. 9 or the like). Also, the configuration of the system control unit 70 is the same as the configuration described with reference to FIG. The configuration (lens unit 10, imaging unit 20, work memory 40, display unit 50, recording unit 60) other than the image processing unit 30 and the system control unit 70 is the same as the configuration shown in FIG.

  Next, a photographing operation according to the second embodiment will be described. FIG. 18 is a flowchart for explaining a photographing operation executed by the system control unit according to the second embodiment. In the process shown in FIG. 18, when the user operates the operation unit 55 or the like to start shooting after the electronic device 1 is turned on, the system control unit 70 starts shooting (step S1). ).

  When shooting is started, the display control unit 71 displays the live view image captured by the imaging unit 20 on the first display unit 51 (image display area 510) (step S2). The user sets the shooting mode. In this case, the shooting mode 525 (that is, the touch area 525a) is touched. Then, a manual mode (manual mode) or an auto mode (automatic mode) is selected from the photographing modes.

  The system control unit 70 determines whether or not auto is selected as the shooting mode 525 (step S21). When it is determined that the auto mode is not selected as the shooting mode, that is, when it is determined that the manual mode is selected as the shooting mode, the selection unit 73 performs the same processing as steps S3 and S4 illustrated in FIG. . Subsequently, the changing unit 72 performs the same process as step S6 shown in FIG.

  On the other hand, when it is determined that the auto mode is selected as the shooting mode, the selection unit 73 automatically sets the area and the imaging condition based on the live view image displayed in the image display area 510 (step S22). .

  FIG. 19 is a flowchart illustrating an example of the automatic setting process (step S22) of the area and the imaging condition. As shown in FIG. 19, the system control unit 70 instructs the image processing unit 30 to detect a moving subject (step S22a). The detection unit 32 compares a plurality of image data obtained in a time series from the live view image, and detects a moving subject and a non-moving subject (subject that has not moved). Then, the detection unit 32 outputs the detection result to the system control unit 70 together with the image data. The selection unit 73 sets a moving subject region and a non-moving subject region based on the detection result of the detection unit 32 (step S22b).

  Further, the changing unit 72 sets the imaging condition of the moving subject region and the non-moving subject region based on the detection result of the detecting unit 32 (step S22c). For example, for the moving subject area, the ISO sensitivity is increased and the shutter speed is increased. When a moving image is being captured, the frame rate of the moving subject area is set higher than the frame rate of the non-moving subject area. For the non-moving subject area, the ISO sensitivity is made lower than the ISO sensitivity of the moving subject area, and the shutter speed is made slower than the shutter speed of the moving subject area. When a moving image is being captured, the frame rate of the non-moving subject area is set lower than the frame rate of the moving subject area.

  Note that the area and imaging condition automatic setting processing shown in FIG. 19 is an example, and the area and imaging condition may be set by other methods. For example, when the moving subject is not detected by the detection unit 32, the selection unit 73 sets the region by specifying the boundary of the region based on the contrast and color change between the bright part and the dark part in the live view image. May be. Further, as described in the first embodiment, the changing unit 72 may change the imaging condition based on at least one of the contrast and the color change of the image in the region 511 in the live view image. You may apply combining the process which sets such an area | region and an imaging condition, and the process shown in FIG.

  As in the first embodiment, the system control unit 70 determines whether or not a half-pressing operation (SW1 operation) of the shutter or the recording start button has been performed (step S8). When the half-press operation is performed, the system control unit 70 determines whether or not the shutter or the recording start button is fully pressed (the operation of SW2) (step S9). If it is determined that the full-press operation has been performed, the imaging control unit 74 performs an imaging process that causes the imaging element 100 to perform imaging (step S23).

  FIG. 20 is a flowchart illustrating an example of an imaging process according to the second embodiment. The imaging control unit 74 determines whether or not the area imaging mode is set by the user (step S31). Here, the area imaging mode is a mode in which imaging is performed only for an area selected by the user or an automatically set area. The user sets the area imaging mode by operating the operation unit 55, the second touch panel 54 (for example, a touch operation in the shooting mode 525), or the like before executing the imaging process.

  If the imaging control unit 74 determines that the area imaging mode is not set, the imaging control unit 74 executes imaging for all the areas of the image display area 510 (step S32). In this case, for example, processing similar to steps S11 to S14 in FIG. 13 is performed. On the other hand, when it is determined that the area imaging mode is set, the imaging control unit 74 executes imaging only for the area selected in the image display area 510 (step S33). At this time, imaging is performed under imaging conditions set in the selected area.

  FIG. 21 is a diagram illustrating a display example of the display screen when only the selected region is imaged. As shown in FIG. 21, when the waterfall region 513 is selected, only the region 513 is imaged, and the other regions are not imaged.

  As described above, in the second embodiment, the detection unit 32 that detects the moving subject is provided, and the changing unit 72 determines the accumulation condition of the first region and the second region according to the detection result of the detection unit 32. The storage conditions are different from each other. Accordingly, it is possible to set an imaging condition suitable for the movement of the moving subject. The selection unit 73 is configured to set the first region and the second region according to the detection result of the detection unit 32. Therefore, the area of the moving subject can be reliably extracted. Also in the second embodiment, the same effects as those described in the first embodiment can be obtained.

  Further, in the second embodiment, a function of imaging only an area selected by the user or an area automatically selected is provided. Therefore, it is possible to perform imaging only for an area that the user wants to image. According to such a configuration, the user can acquire various material images having high utility value, for example.

  Also in the second embodiment, the imaging conditions for each region that can be set by the user are not limited to ISO sensitivity, shutter speed, and frame rate. For example, the above-described thinning rate, the number of addition rows or addition columns to which pixel signals are added, the number of digitization bits, and the like may be set as imaging conditions for each region. Further, parameters such as color signal processing, white balance adjustment, gradation adjustment, and compression rate may be set as imaging conditions for each region.

  In the second embodiment, the image processing unit 30A is realized by the CPU executing processing based on the control program.

<Third Embodiment>
In 3rd Embodiment, it is set as the structure which isolate | separated the electronic device 1 in above-described 1st Embodiment into the imaging device 1A and the electronic device 1B.

  FIG. 22 is a block diagram illustrating configurations of an imaging apparatus and an electronic apparatus according to the third embodiment. In the configuration shown in FIG. 22, the imaging apparatus 1A is an apparatus that captures an image of a subject. The imaging apparatus 1A includes a lens unit 10, an imaging unit 20, an image processing unit 30, a work memory 40, an operation unit 55, a recording unit 60, and a first system control unit 70A. In the imaging apparatus 1A, the configurations of 10, the imaging unit 20, the image processing unit 30, the work memory 40, the operation unit 55, and the recording unit 60 are the same as those illustrated in FIG. Accordingly, the same components are denoted by the same reference numerals, and redundant description is omitted.

  The electronic device 1B is a device that displays images (still images, moving images, live view images). The electronic apparatus 1B includes a display unit 50 and a second system control unit (control unit) 70B. The configuration of the display unit 50 in the electronic device 1B is the same as the configuration illustrated in FIG. Accordingly, the same components are denoted by the same reference numerals, and redundant description is omitted.

  The first system control unit 70A includes a first communication unit 75A. The second system control unit 70B has a second communication unit 75B. The first communication unit 75A and the second communication unit 75B transmit and receive signals to each other in a wired or wireless manner. The first system control unit 70A has only a configuration corresponding to, for example, the imaging control unit 74 in the configuration illustrated in FIG. The second system control unit 70B has a configuration corresponding to, for example, the display control unit 71, the change unit 72, and the selection unit 73 in the configuration illustrated in FIG.

  In such a configuration, the first system control unit 70A receives the second image data (the image data image-processed by the image processing unit 30 and the image data recorded in the recording unit 60) via the first communication unit 75A. It transmits to the communication part 75B. The second system control unit 70B causes the display unit 50 to display the image data received by the second communication unit 75B. Further, the second system control unit 70B causes the second display unit 53 to display a preset menu image.

  In addition, the second system control unit 70B performs control to change the imaging condition (including the accumulation condition) according to the touch operation of the second touch panel 54 by the user or automatically. Further, the second system control unit 70B performs control for selecting an area in the image display area 510 in block units in response to a touch operation of the first touch panel 52 by the user or automatically. In addition, the first system control unit 70A executes imaging control in accordance with an operation of a shutter button (an operation unit that instructs to start capturing a still image or a moving image provided on the electronic device 1B side) by the user.

  The configuration (the display control unit 71, the change unit 72, the selection unit 73, and the imaging control unit 74) illustrated in FIG. 7 may be provided in any of the first system control unit 70A and the second system control unit 70B. 7 may be provided in the first system control unit 70A or the second system control unit 70B, and a part of the configuration shown in FIG. 7 is provided in the first system control unit 70A. 7 may be provided in the second system control unit 70B.

  Note that the imaging device 1A includes, for example, a digital camera, a smartphone, a mobile phone, and a personal computer that have an imaging function and a communication function, and the electronic device 1B includes, for example, a smartphone, a mobile phone, and a portable personal computer that have a communication function. Consists of a portable terminal such as a computer.

  The image processing unit 30 illustrated in FIG. 22 is realized by the CPU executing processing based on the control program. Further, the first system control unit 70A illustrated in FIG. 22 is realized by the CPU executing processing based on the control program. Further, the second system control unit 70B shown in FIG. 22 is realized by the CPU executing processing based on the control program.

  As described above, in the third embodiment, the display unit 50 that includes the imaging device 100 and can display the live view image captured by the imaging unit 20 that captures the first region and the second region, and the imaging Control that causes the display unit 50 to display a menu for setting imaging conditions for the live view image when live view images corresponding to the first area and the second area captured by the unit 20 are displayed on the display unit 50. Part 75B. According to such a configuration, in addition to the effects described in the first embodiment, the live view image captured by the imaging device 1A is edited using a mobile terminal such as a smartphone, and the edited live view image is confirmed. Imaging can be performed above.

  In the configuration shown in FIG. 22, the image processing unit 30 and the first system control unit 70A may be configured integrally. In this case, the system control unit having one CPU performs the processing based on the control program, thereby performing the function of the image processing unit 30 and the function of the first system control unit 70A.

<Fourth embodiment>
In the operation button display area 520 shown in FIGS. 6, 9 to 12, 14 to 16, and 21, the buttons 521 to 525 are arranged in a predetermined order. That is, the setting 521 is arranged at the top, the ISO sensitivity 522 is arranged second from the top (ie, below the setting 521), and the shutter 523 is arranged third from the top (ie, below the ISO sensitivity 522), The frame rate 524 is arranged fourth from the top (ie, below the shutter 523), and the shooting mode 525 is arranged at the bottom. On the other hand, in 4th Embodiment, the display control part 71 changes and arranges the arrangement | positioning of each button 521-525 according to the to-be-photographed object in an area | region. Moreover, in 4th Embodiment, the display control part 71 displays a button with a high priority by the display mode different from the display mode of another button.

  FIG. 23 is a diagram illustrating a display example of the display screen in the fourth embodiment. In the example shown in FIG. 23, the setting 521 is arranged at the top, the shutter 523 is arranged second from the top (ie, below the setting 521), and the frame rate 524 is third from the top (ie, below the shutter 523). The ISO sensitivity 522 is arranged fourth from the top (that is, below the frame rate 524), and the shooting mode 525 is arranged at the bottom. Also, as shown in FIG. 23, the shutter 523 is a button in a larger area than the other buttons (setting 521, ISO sensitivity 522, frame rate 524, shooting mode 525).

  In the second touch panel 54, the touch area 521 a is formed so as to overlap the setting 521. Further, the touch area 523 a is formed so as to overlap the shutter 523. Further, the touch area 524a is formed to overlap the frame rate 524. Further, the touch area 522 a is formed so as to overlap the ISO sensitivity 522. Further, the touch area 525a is formed so as to overlap the shooting mode 525. Note that the touch area 523a is larger than the other button areas in accordance with the size of the shutter 523 area.

  Next, a process for changing the arrangement of the buttons 512 to 525 by the image processing unit 30 and the system control unit 70 will be described. When executing step S6 of FIGS. 8 and 18, the system control unit 70 instructs the image processing unit 30 to detect a moving subject. The detection unit 32 detects a moving subject and a non-moving subject by comparing a plurality of image data obtained in time series from the live view image. Then, the detection unit 32 outputs the detection result to the system control unit 70 together with the image data.

  The display control unit 71 determines whether or not the moving subject is included in the area selected by the selection unit 73 based on the detection result of the detection unit 32. If the display control unit 71 determines that the moving subject is included in the area selected by the selection unit 73, the display control unit 71 raises the shutter 523, which is a button for setting the shutter speed, as shown in FIG. Is displayed at the second position. In addition, the display control unit 71 displays the shutter 523 larger than the other buttons.

  Changing the shutter speed changes the way the moving subject appears. For example, when the moving subject is a waterfall, by increasing (fastening) the shutter speed, the image of the waterfall waterfall stops instantaneously. On the other hand, by lowering (slowing) the shutter speed, an image in which the waterfall water flow looks like a thread is obtained. Thus, for a moving subject, the shutter speed has a greater effect on how the subject is photographed than in other imaging conditions. Therefore, the display control unit 71 determines that the priority of the shutter speed is higher than other imaging conditions when a moving subject is included in the area. Then, the display control unit 71 moves the position of the shutter 523 upward and displays the shutter 523 as a button in a large area. Thereby, a button with a high priority is arrange | positioned in the position where it is easy to operate for a user, and a user's operativity improves. In addition, a button with a higher priority (that is, an imaging condition) becomes more conspicuous than other buttons (that is, an imaging condition), and the user can be prompted to operate a button with a higher priority.

  In the case of a moving image, the frame rate greatly affects the smoothness of movement of the moving subject. Therefore, when capturing a moving subject moving image, the display control unit 71 determines that the priority of the frame rate is higher than other imaging conditions. Then, the display control unit 71 moves the position of the frame rate 524 upward and displays the frame rate 524 as a button in a large area.

  In the above-described example, the display control unit 71 changes the button arrangement and the display mode (size) depending on whether or not the subject in the area is a moving subject. However, the configuration is not limited to this. . For example, when executing step S6 of FIGS. 8 and 18, the system control unit 70 instructs the image processing unit 30 to detect the brightness of the image. The image processing unit 30 detects the brightness of the image in the region based on the live view image. Then, the image processing unit 30 outputs the detection result to the system control unit 70 together with the image data.

  The display control unit 71 determines whether the brightness of the image in the area selected by the selection unit 73 is a value within a predetermined range based on the brightness detection result by the image processing unit 30. When the display control unit 71 determines that the brightness of the image in the region is not a value within the predetermined range, the display control unit 71 displays the ISO sensitivity 522 that is a button for setting the ISO sensitivity at the second position from the top. In addition, the display control unit 71 displays the ISO sensitivity 522 larger than other buttons.

  By changing the ISO sensitivity, the dark part of the live view image becomes bright and the bright part becomes dark. If the brightness in the area is not a value within the predetermined range, that is, if the image in the area is too bright or too dark, it is possible to approach the optimum exposure by changing the ISO sensitivity. Therefore, the display control unit 71 determines that the priority of ISO sensitivity is higher than other imaging conditions when the image in the region is not a value within the predetermined range. Then, the display control unit 71 moves the position of the ISO sensitivity 522 upward and displays the ISO sensitivity 522 as a button in a large area. Thereby, a button with a high priority is arrange | positioned in the position where it is easy to operate for a user, and a user's operativity improves. In addition, a button with a higher priority (that is, an imaging condition) becomes more conspicuous than other buttons (that is, an imaging condition), and the user can be prompted to operate a button with a higher priority.

  As a display mode for conspicuously displaying a high priority button, a display mode such as changing the color of the button or blinking the button may be used in addition to increasing the button size. In addition, before a button with a high priority is pressed by the user, a plurality of imaging condition values may be displayed beside the button to make the button with a high priority stand out. Moreover, the structure which changes only the arrangement | positioning of a button may be sufficient, and the structure which changes only the display mode of a button may be sufficient.

  Further, the arrangement of the buttons may be changed according to the order in which the user operates the buttons, and the display mode of the buttons may be changed. For example, the user selects an area after pressing the setting 521. Next, the user presses the shooting mode 525 and selects the manual mode as the shooting mode. Thereafter, the user changes the imaging condition for each region. In such a case, the display control unit 71 places the setting 521 at the top and increases the setting 521. Next, the display control unit 71 places the shooting mode 525 at the top and enlarges the shooting mode 525. After that, the display control unit 71 arranges any one of the ISO sensitivity 522, the shutter 523, and the frame rate 524 at the top according to the subject (image) for each region, and further presses the top button. Enlarge. Thus, the convenience of operation by the user is improved by changing the arrangement and display mode of the buttons in the order according to the user's operation procedure.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. Various modifications or improvements can be added to the above-described embodiment without departing from the spirit of the present invention. In addition, one or more of the requirements described in the above embodiments may be omitted. Such modifications, improvements, and omitted forms are also included in the technical scope of the present invention. In addition, the configurations of the above-described embodiments and modifications can be applied in appropriate combinations.

  For example, in the first embodiment and the second embodiment described above, if the electronic device 1 includes the imaging unit 20 and the system control unit 70 including the control unit 71 and the change unit 72, the lens unit 10 and the recording unit The unit 60 or the like may not be provided. That is, these configurations may be different from the electronic device 1. In the third embodiment described above, the lens unit 10 and the recording unit 60 may be configured separately in the imaging apparatus 1A.

  Further, in each of the above-described embodiments, the arrangement of the color filters 102 is a Bayer arrangement, but an arrangement other than this arrangement may be used. Further, the number of pixels forming the unit group 131 only needs to include at least one pixel. In addition, the block only needs to include at least one pixel. Therefore, it is possible to execute imaging under different imaging conditions for each pixel.

  In each embodiment described above, part or all of the configuration of the drive unit 21 may be mounted on the imaging chip 113, or part or all of the configuration may be mounted on the signal processing chip 111. Further, a part of the configuration of the image processing unit 30 may be mounted on the imaging chip 113 or the signal processing chip 111. Further, a part of the configuration of the system control unit 70 may be mounted on the imaging chip 113 or the signal processing chip 111.

  In each of the above-described embodiments, the ISO sensitivity, the shutter speed, and the frame rate are all changeable as the imaging conditions. However, it is sufficient that at least one of them can be changed. In addition, when the imaging conditions are automatically set, the best mode imaging conditions for optimal exposure may be presented to the user, and a live view image in which the imaging conditions are changed step by step may be displayed. You may make it show to a user.

  In each embodiment described above, the operation button display area 520 is provided in the vicinity of the image display area 510, but may be provided in a position that is not in the vicinity of the image display area 510. Further, the operation button display area 520 may be disposed at a position overlapping the image display area 510. Further, instead of the user touching the second touch panel 54, the operation unit 55 may be operated.

  In each of the above-described embodiments, the user operates the first touch panel 52 to select an area, and operates the second touch panel 54 to set an imaging condition and the like. However, the configuration is not limited to this, and the user may be configured to select an area by operating the operation unit 55 and set an imaging condition or the like.

  In the above-described first embodiment, the user manually sets the area, and selects whether to set the imaging condition manually or automatically by setting the shooting mode. In the second embodiment described above, the user selects whether to manually set the area and the imaging condition or to set the imaging condition by setting the shooting mode. However, the user may set all of the area and the imaging condition only by manual operation. Further, the area may be automatically set, and the imaging condition may be selected manually or automatically by setting the shooting mode.

  In each of the above-described embodiments, the case where the size of the block area is set in advance has been described. However, the user may set the size of the block area. In the first embodiment described above, when the number of blocks set in the image display area 510 is small (FIGS. 9 to 12) and when the number of blocks set in the image display area 510 is large ( 14 to 16). However, the system control unit 70 (selection unit 73) may automatically set a large area block and a small area block. For example, the system control unit 70 (selection unit 73) automatically recognizes the boundary of the region. Next, the system control unit 70 (selection unit 73) sets a block of a small area in a block of a large area when the block of the area having a large boundary is crossed. Then, the system control unit 70 sets an area along the boundary of the area in block units of a small area.

  Further, in each of the above-described embodiments, it is assumed that the imaging condition of the live view image displayed on the first display unit 51 is the same as the imaging condition when imaging is performed according to the shutter operation. . This is because an image actually captured in the live view image can be confirmed. However, the imaging condition of the live view image may be different from the imaging condition of the actually captured image. In this case, the imaging condition is changed to such an extent that the user can recognize the actually captured image based on the live view image.

  DESCRIPTION OF SYMBOLS 1,1B ... Electronic device, 1A ... Imaging device, 20 ... Imaging part, 30, 30A ... Image processing part, 31 ... Composition processing part, 32 ... Detection part, 50 ... Display part, 51 ... First display part, 52 ... First touch panel (selection unit, first operation unit), 53 ... second display unit, 54 ... second touch panel (second operation unit), 70 ... system control unit, 70A ... first system control unit, 70B ... second System control unit (control unit) 71 ... Display control unit (control unit) 72 ... Change unit 73 ... Selection unit 74 ... Imaging control unit (image synthesis unit) 100 ... Imaging element

Claims (15)

An imaging device having a first imaging area for imaging a subject and a second imaging area for imaging the subject;
A setting unit configured to set an imaging condition different from the imaging condition set in the first imaging area in the second imaging area;
The setting unit includes a first image of the subject imaged under the imaging condition set in the first imaging area and a second image of the subject imaged under the imaging condition set in the second imaging area. An electronic device that sets at least one of the imaging condition of the first imaging area and the imaging condition of the second imaging area when being displayed on the screen . The setting unit is configured with storage time of the first imaging area, the electronic device according to claim 1 wherein the set so that different and the storage time of the second imaging area. The setting unit, the frame rate of the first imaging area, according to claim 1 or 2, the electronic apparatus according to set so that different and a frame rate of the second imaging area. The setting unit, the gain of the first imaging area, the electronic device according to any one of claims 1 to 3 to have been set to different and gain of the second imaging area. The setting unit includes a storage condition of the first imaging area based on at least one of the contrast and color change of the image, from claim 1 to have been set to different and accumulation condition of the second imaging area 4 The electronic device as described in any one of. A detection unit for detecting a moving subject;
The setting unit according to the detection result of the detecting unit, and accumulation condition of the first imaging area, any one of claims 1 to 5 to set so that different and the storage conditions of the second imaging area The electronic device as described in the paragraph. An electronic device capable of displaying an image of a subject imaged by an imaging device having a first imaging region for imaging a subject and a second imaging region for imaging a subject,
A first image of a subject imaged with a first imaging condition set in the first imaging region and a subject imaged with a second imaging condition different from the first imaging condition set in the second imaging region A display unit capable of displaying a second image ;
When the first image and the second image is displayed on the display unit, and a control unit for displaying a menu for setting the imaging conditions of the first imaging region and the second imaging region on the display unit , Including electronic equipment. The electronic device according to claim 7 , further comprising a selection unit capable of selecting the first image and the second image . The electronic device according to claim 8 , wherein the selection unit includes a first operation unit that selects a part of the first image and the second image displayed on the display unit . The electronic device according to claim 9 , wherein the first operation unit includes a touch panel formed on the display unit.   The electronic apparatus according to claim 7, further comprising a second operation unit that selects the menu. The electronic device according to claim 7 or 11 , wherein the control unit displays at least one of a menu related to gain, a menu related to accumulation time, and a menu related to frame rate. Wherein the control unit, according to claim 7, 11, 12 electronic device according to any one of displaying the menu in the vicinity of the first image or the second image. An imaging device having a first imaging area for imaging a subject and a second imaging area for imaging a subject, and setting imaging conditions different from the imaging conditions set in the first imaging area in the second imaging area An electronic device control device comprising:
A second image of the subject imaged under the imaging condition set in the second imaging area is displayed on the display unit together with the first image of the subject imaged under the imaging condition set in the first imaging area. In some cases , the control program causes the setting unit to execute setting of at least one of the imaging condition of the first imaging area and the imaging condition of the second imaging area . In a control apparatus for an electronic device capable of displaying an image of a subject captured by an imaging element having a first imaging region for capturing a subject and a second imaging region for capturing a subject ,
A first image of a subject imaged with a first imaging condition set in the first imaging region and a subject imaged with a second imaging condition different from the first imaging condition set in the second imaging region Displaying the second image on the display unit ;
When the first image and the second image is displayed on the display unit, and possible to display a menu for setting the imaging conditions of the said first imaging region second imaging area on the display unit, Control program to execute