JP2020077980A - Imaging device, imaging method, and program - Google Patents

Abstract

To simulate pseudo ND filter shooting before shooting and perform live-view display.SOLUTION: An imaging device 1 includes an imaging unit 20, a first combining unit 61, a first gain applying unit 62, a second combining unit 63, a second gain applying unit 64, and a display unit. The imaging unit 20 acquires first image data at a first exposure time and second image data at a second exposure time. The first combining unit 61 adds and combines a plurality of pieces of first image data acquired until the total exposure time reaches a third exposure time, and the first gain applying unit 62 applies first gain to first combined image data and generates first still image data having a first brightness corresponding to the brightness reduced by an ND filter. The second combining unit 63 sequentially adds and combines the pieces of second image data, and the second gain applying unit 64 applies second gain to second combined image data and generate first live view image data having the first brightness. The display unit displays the first live view image at a frame rate for displaying the live view image.SELECTED DRAWING: Figure 3

Description

  The disclosure of the present specification relates to a photographing device, a photographing method, and a program.

  2. Description of the Related Art Conventionally, in the field of photographing apparatuses, there are known photographing methods that use a ND (Neutral Density) filter to reduce the light, lengthen the exposure time to produce a slow shutter effect, and prevent blown-out highlights in high-luminance subjects. ing. However, in the device configuration in which the ND filter is manually attached / detached, the work load associated with the attachment / detachment is a problem. Normally, the ND filter is used by combining a plurality of ND filters. Therefore, the combination of the ND filters themselves is complicated. Furthermore, the resetting operation of ISO sensitivity, shutter speed, diaphragm, etc., which occurs after the ND filter is attached and the light is dimmed, is complicated. In addition, when the ND filter is attached in a dark environment, there is a visibility problem that the finder cannot be seen. Not only the optical viewfinder but also the EVF (Electronic View Finder) has a similar problem because the amount of incident light decreases. In addition, it is necessary to prepare shooting equipment, which puts a burden on the user. Further, in the device configuration in which the ND filter is built in and is inserted into and removed from the optical path, there are problems in that the size and cost of the imaging device are increased.

  A technique related to such a problem is described in Patent Document 1. Japanese Patent Application Laid-Open No. 2004-242242 describes a technique for reproducing shooting using a pseudo ND filter by combining divided exposure and image processing for the purpose of preventing overexposure of a high-luminance subject. Hereinafter, shooting that reproduces shooting using a pseudo ND filter without using a physical ND filter will be referred to as pseudo ND filter shooting.

  Note that Patent Document 2 describes a technique in which pseudo ND filter shooting is applied in order to prevent blown-out highlights in moving image shooting. In addition, Patent Document 3 describes a technique of reading out each playback frame designated by the user as a target of synthesis from a recorded moving image file, performing playback editing, and generating a still image. Patent Document 4 describes an image processing technique for adding a special effect in a moving image such as multi-echo processing during moving image recording. Patent Document 5 describes a technique of regenerating a composite image in which the exposure amount is corrected by reproduction and editing after the end of shooting. Patent Document 6 discloses a technique of adding an image effect effect in front curtain synchronization / rear curtain synchronization / multi-emission etc. by reproducing and editing a reproduced image after shooting.

JP, 2005-136087, A Japanese Patent Laid-Open No. 2016-058808 JP, 2005-103119, A JP, 2016-048968, A JP, 2017-015276, A JP, 2009-232383, A

  In conventional ND filter shooting and pseudo ND filter shooting, it is complicated and difficult to set appropriate shooting conditions including ND magnification for shooting that takes several seconds to several tens of seconds, and a slow shutter effect is produced until shooting is completed. Still images are not displayed. For this reason, since re-shooting wastes a great deal of time, there is a demand for a technique for simulating the brightness and slow shutter effect associated with the ND magnification of ND filter shooting before the start of shooting. It should be noted that although Patent Documents 1 to 5 describe a technique of pseudo ND filter photographing or a similar photographing technique, in any of the documents, an ND filter is used before the start of photographing to obtain “dimmed brightness. "Simultaneousness" and "slow shutter effect" are set at the same time, and pseudo ND filter shooting having a shooting method, and technology for simulating pseudo ND filter shooting before the start of shooting in order to determine suitability of the setting are described. It has not been.

  In view of the above circumstances, an object of one aspect of the present invention is to provide a technique for simulating a pseudo ND filter shooting before shooting and performing live view display.

  An image capturing apparatus according to an aspect of the present invention is an image capturing unit that captures an image of a subject, acquires first image data for still image recording at a first exposure time, and displays a live view image at a second exposure time. The image capturing unit that acquires the second image data; the first combining unit that adds and combines the plurality of first image data repeatedly acquired by the image capturing unit until the first total exposure time reaches the third exposure time; The first gain application unit that generates the first still image data having the first brightness by applying the first gain to the first combined image data output from the first combining unit, and the image pickup unit acquired the first still image data. A second combining unit for sequentially adding and combining the second image data, and a second gain having a first brightness by applying a second gain to the second combined image data sequentially output from the second combining unit. A second gain applying section for generating one live view image data, wherein the second gain is applied each time the second combined image data is output from the second combining section. Based on the first live view image data generated by the application unit and the second gain application unit, the first live view image is updated and displayed at the frame rate for displaying the live view image in the imaging unit. And a display unit that does.

  A photographing method according to an aspect of the present invention generates a first combined image data by adding and combining a plurality of first image data repeatedly acquired until a first total exposure time reaches a third exposure time. , Each of the plurality of first image data is image data for still image recording, is acquired at a first exposure time, and applies a first gain to the first combined image data to obtain a first image data. The first still image data having brightness is generated, and the second combined image data is generated by sequentially adding and combining the second image data before generating the first combined image data, wherein the second combined image data is generated. The second image data is image data for live view image display, is acquired at the second exposure time, and applies a second gain to the second combined image data before generating the first combined image data. As a result, the first live view image data having the first brightness is generated, and the second gain is applied each time the second combined image data is generated, and the first combined image is generated. Before generating the data, the first live view image is updated and displayed at the frame rate for displaying the live view image based on the first live view image data.

  A program according to an aspect of the present invention is an image capturing unit that captures an image of a subject, acquires first image data for still image recording at a first exposure time, and displays a first image data for live view image display at a second exposure time. The first combination by adding and synthesizing a plurality of first image data repeatedly acquired by the image capturing unit until the first total exposure time reaches the third exposure time in the image capturing apparatus including the image capturing unit that acquires two image data. By generating image data and applying a first gain to the first combined image data to generate first still image data having a first brightness, and before generating the first combined image data, A second gain is added to the second combined image data before the second combined image data is generated by sequentially adding and combining the second image data acquired by the imaging unit to generate the second combined image data. By applying the first live view image data having the first brightness, the second gain is applied each time the second composite image data is generated, and the first gain image data is generated. Before generating, the processing for updating and displaying the first live view image at the frame rate for displaying the live view image in the imaging unit is executed based on the first live view image data.

  According to the above aspect, it is possible to simulate the pseudo ND filter shooting before shooting and perform live view display.

FIG. 3 is a diagram exemplifying a configuration of a photographing device 1. 3 is an external view of the image capturing apparatus 1. FIG. FIG. 3 is a diagram exemplifying a functional configuration of a photographing device 1. It is a figure showing the flow of photography processing. It is a figure showing an example of a live view image. It is the figure which showed another example of a live view image. It is the figure which showed another example of a live view image. It is a flowchart of a pseudo ND shooting button process. It is a flowchart of a dial rotation process during button pressing. It is a figure for demonstrating the method of roughly changing a dimming rate. It is a figure for demonstrating the method of changing the extinction ratio finely. It is a flowchart of a button short push dial rotation process. It is the figure which showed an example of the dimming rate setting screen. It is a figure for demonstrating the method of changing ND filter type. It is a figure for demonstrating the method of changing a target item. It is a flowchart of a dimming rate automatic setting process. It is a flow chart of photography processing. It is a flowchart of preprocessing. It is a modification of the flowchart of preprocessing. It is a flow chart of exposure time setting processing. 9 is a flowchart of a manual ND exposure time setting process. It is a flowchart of a continuity calculation process. It is a modification of the flowchart of the continuity calculation process. It is the figure which showed an example of the warning display regarding continuity. It is a flow chart of reproducibility calculation processing. It is a modification of the flowchart of the reproducibility calculation processing. It is a modification of the flowchart of the exposure time setting process for manual ND. 9 is a flowchart of an exposure time setting process for automatic ND. It is a flowchart of a live simulation process. It is a flowchart of a pseudo ND filter photographing process. It is a flow chart of multi photography processing. It is a figure showing an example of a still picture. It is a figure for demonstrating a half type pseudo ND filter setting. It is a figure for demonstrating the pixel line of a still image. It is the figure which showed an example of the pseudo ND filter table. It is a figure showing a modification of functional composition of photographing instrument 1. It is a modification of the flowchart of the button short push dial rotation processing. It is the figure which showed an example of the twin shutter speed setting screen. It is a figure showing another modification of a functional composition of photographing instrument 1.

  FIG. 1 is a diagram illustrating a configuration of the image capturing apparatus 1. FIG. 2 is an external view of the photographing device 1. The imaging apparatus 1 performs pseudo ND filter imaging that reproduces imaging using a pseudo ND filter by a combination of divided exposure and image processing. Further, the image capturing apparatus 1 simulates the pseudo ND filter image capturing and displays the live view before capturing a still image by the pseudo ND filter image capturing.

  Hereinafter, the configuration of the image capturing apparatus 1 will be described with reference to FIGS. 1 and 2. Hereinafter, the case where the image capturing apparatus 1 is a digital camera will be described as an example, but the image capturing apparatus 1 is not limited to a digital camera as long as it has an image capturing function. The imaging device 1 may be, for example, a mobile terminal such as a smartphone, a mobile phone, or a tablet computer. The image capturing apparatus 1 may be, for example, a stationary computer, a microscope, or the like.

  The image capturing apparatus 1 includes a display unit 2 as shown in FIGS. 1 and 2. The display unit 2 is, for example, a liquid crystal display (LCD) or an organic EL display provided on the back surface of the photographing device 1, and displays a live view image generated by simulating the pseudo ND filter photographing.

  As shown in FIG. 1, the photographing apparatus 1 further includes an imaging unit 20, a memory 26, a system control unit 27, an imaging control unit 28, a shutter control unit 29, an aperture control unit 30, a lens control unit 31, and an AF processing unit 32. , Exposure control unit 33, camera shake detection unit 34, image processing unit 35, power supply unit 36, power supply control unit 37, operation unit 38, external memory 39, non-volatile memory 40, flash control unit 41, flash charging unit 42, and flash. The light emitting unit 43 is provided.

  The image pickup unit 20 includes a lens 21, a diaphragm 22, a mechanical shutter 23, an image pickup device 24, and an A / D conversion unit 25, and picks up an image of a subject to acquire image data of the subject.

  The lens 21 is a single-focus lens or a zoom lens, and includes a single lens or a plurality of optical lenses for forming an optical image of a subject. The lens control unit 31 controls the movement of some or all of the optical lenses that make up the lens 21, thereby performing focusing, zooming, and the like.

  The diaphragm 22 blocks the light that has entered the imaging device 1 to limit the amount of light that enters the image sensor 24. The aperture control unit 30 controls the aperture diameter of the aperture 22 to adjust the amount of light and the depth of field.

  The mechanical shutter 23 switches between an exposure state in which light is incident on the image sensor 24 and a light shielding state in which light is not incident on the image sensor 24. The opening / closing of the mechanical shutter 23 is controlled by the shutter control unit 29, and thereby the exposure state and the light blocking state are switched.

  The image pickup device 24 is, for example, a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal Oxide Semiconductor) image sensor, or the like, and includes a plurality of two-dimensionally arranged photodiodes, each of which constitutes a pixel. .. When the photodiode generates a current according to the amount of received light, electric charge is stored in the capacitor connected to the photodiode. The image pickup control unit 28 controls the exposure time and the frame rate of the image pickup device 24, whereby the image data is output from the image pickup device 24.

  The A / D converter 25 converts the image data, which is analog data output from the image sensor 24, into image data, which is digital data, and outputs the image data to the memory 26.

  The memory 26 is an electrically rewritable volatile memory for temporarily storing image data, and is, for example, an SDRAM (Synchronous Dynamic Random Access Memory).

  The system control unit 27 is an electric circuit that controls the imaging device 1. The system control unit 27 includes a processor and a memory, and may be, for example, an electric circuit in which they are integrated on one chip. The system control unit 27 is connected to various control units (imaging control unit 28, shutter control unit 29, aperture control unit 30, lens control unit 31, AF processing unit 32, exposure control unit 33, flash control unit 41, etc.). There is.

  The AF processing unit 32 performs autofocus processing based on the image data. The exposure control unit 33 is an example of a photometry unit, and detects subject brightness based on image data. The camera shake detection unit 34 detects the camera shake amount generated in the image capturing apparatus 1.

  The image processing unit 35 is an electric circuit that reads out image data from the memory 26 and performs various types of image processing. The image processing unit 35 performs, for example, basic image processing such as optical black subtraction processing, white balance correction processing, demosaicing processing, and color matrix processing, as well as image combining processing performed by pseudo ND filter shooting.

  The power supply unit 36 may be, for example, a primary battery or a secondary battery, or may be an AC adapter connected to a commercial power supply. The power supply control unit 37 is a power supply circuit that supplies the power supplied from the power supply unit 36 to each unit of the imaging apparatus 1.

  The operation unit 38 is a member used by the user to operate, and for example, the pseudo ND shooting button 3, the shooting mode dial 4, the zoom ring 5, the manual focus ring 6, the shutter button 7, and the F dial shown in FIG. 8, an enlargement button 9, a moving image button 10, an LV mode button 11, an R dial 12, and the like are included.

  The external memory 39 is a recording medium that can be attached to and detached from the image capturing apparatus 1, and is, for example, a memory card. The non-volatile memory 40 is, for example, a flash memory. In the external memory 39, for example, still image data obtained by the pseudo ND filter shooting is recorded.

  The flash control unit 41 controls the flash charging unit 42 and the flash light emitting unit 43. The flash control unit 41 uses the energy stored in the flash charging unit 42 to cause the flash light emitting unit 43 to perform a light emitting operation.

  FIG. 3 is a diagram illustrating a functional configuration of the image capturing apparatus 1. As shown in FIG. 3, the image capturing apparatus 1 includes an exposure time setting unit 50, an image generating unit 60, a still image recording unit 70, and a live image recording unit as components for performing the pseudo ND filter image capturing and the simulation thereof. A view image display section 80 and an exposure time display section 90 are provided.

  The exposure time setting unit 50 includes a dimming ratio setting unit 51, and based on the dimming ratio set for still image recording in the pseudo ND filter shooting, the first exposure time, the second exposure time, and the third exposure. Set the time. When the operation unit 38 accepts the user's operation of designating the dimming rate, the dimming rate setting unit 51 sets the dimming rate designated by the user. The functions of the exposure time setting unit 50 and the dimming rate setting unit 51 are realized by, for example, the system control unit 27 shown in FIG.

  The first exposure time is an exposure time for generating a still image of dimmed brightness in pseudo ND filter photography, and is set in the image sensor 24 when generating still image data. In the present embodiment, the first exposure time is the exposure time for determining the first brightness reduced in accordance with the light reduction amount of the pseudo ND filter photography, but it is not always necessary to change it according to the light reduction amount. Instead, for example, the frame time may be fixed to the maximum frame rate of the main exposure reading control. When performing the pseudo ND filter shooting, the imaging unit 20 continuously and repeatedly acquires the image data of the first exposure time by the main exposure read control. The first exposure time is preferably a time during which the output voltage of each pixel is not saturated.

  The second exposure time is set in the image sensor 24 when the live view image data is generated. The imaging unit 20 acquires image data at the second exposure time when simulating the pseudo ND filter imaging. The second exposure time may be, for example, a time (for example, 1 / 120s) corresponding to the display frame rate (for example, 120fps) of the live view image. Here, the display frame rate of the live view image may be changed according to the brightness within a range that does not impair the object followability which is the original finder function. In order to accurately perform live view simulation up to the saturation state, the second exposure time is set to the same as the first exposure time by performing the imaging control by the main exposure readout control with the same aperture value as the main exposure during still image shooting. It is desirable to do. Alternatively, since the main exposure reading control is, for example, 60 fps at maximum, it is desirable to align the live view frame rate with this and set it to 60 fps, but if not aligned, a saturation warning is separately displayed on the live view. You may.

  The third exposure time is an exposure time that determines the tracking time of the motion of the subject, and determines the degree of flow of the subject image, that is, the slow shutter effect. The third exposure time is longer than the first exposure time.

  The extinction ratio is the reciprocal of the value of the ND filter (also referred to as the ND magnification) that is simulated in the pseudo ND filter shooting. For example, it is 1/2 when simulating the ND filter of ND2, and 1/400 when simulating the ND filter of ND400.

  The image generation unit 60 combines the image data in the pseudo ND filter photographing and the simulation of the pseudo ND filter photographing to generate image data for live view display or image data for still image recording. The image generating unit 60 includes a first combining unit 61, a first gain applying unit 62, a second combining unit 63, and a second gain applying unit 64. The first combining unit 61 and the first gain applying unit 62 are used in the pseudo ND filter imaging, and the second combining unit 63 and the second gain applying unit 64 are used in the pseudo ND filter imaging simulation. The function of the image generation unit 60 is realized by, for example, the image processing unit 35 shown in FIG.

  The first combining unit 61 adds and combines a plurality of first image data repeatedly acquired by the imaging unit 20 until the total exposure time in the pseudo ND filter shooting reaches the third exposure time. Then, the first combining unit 61 generates the first combined image data by the addition combining process. The first image data is image data acquired for recording a still image by pseudo ND filter shooting, and is acquired at the first exposure time. Note that, hereinafter, the total exposure time in the pseudo ND filter shooting will be referred to as the first total exposure time.

The first gain applying unit 62 applies the first gain to the first combined image data output from the first combining unit 61 to generate the first still image data having the brightness based on the extinction ratio. It should be noted that the brightness based on the dimming rate means the brightness corresponding to the first exposure time (hereinafter referred to as the first brightness), but the first exposure time is the maximum frame rate of the main exposure reading sequence. Alternatively, the brightness may be fixed to the reciprocal of, and a fixed brightness different from the first brightness may be obtained. The first gain is calculated by the following equation (1).
First gain = third exposure time × extinction rate / first total exposure time (1)

  If the first total exposure time matches the third exposure time, the first gain is the dimming rate itself set by the dimming rate setting unit 51, and is the reciprocal of the ND magnification of the simulated ND filter. is there.

  The second synthesis unit 63 sequentially adds and synthesizes the second image data acquired by the imaging unit 20. Then, the second combining unit 63 generates the second combined image data by the addition combining process. The second image data is image data acquired for live view image display that simulates pseudo ND filter imaging, and is acquired at the second exposure time. Note that, hereinafter, the total exposure time in the simulation of the pseudo ND filter imaging will be referred to as the second total exposure time.

The second gain applying unit 64 applies the second gain to the second combined image data sequentially output from the second combining unit 63, so that the brightness corresponding to the still image data recorded as the product of the ND filter shooting is obtained. First live view image data having a height is generated. That is, the first live view image data having the first brightness is generated. The second gain is calculated by the following equation (2) each time the second combined image data is output from the second combining unit.
Second gain = third exposure time × extinction rate / second total exposure time (2)

  The still image recording unit 70 records the first still image data generated by the first gain applying unit 62 as a product of the pseudo ND filter shooting. The function of the still image recording unit 70 is realized by, for example, the external memory 39 shown in FIG.

  The live view image display unit 80 updates the first live view image at the frame rate for displaying the live view image in the imaging unit 20, based on the first live view image data generated by the second gain applying unit 64. To display. The function of the live view image display unit 80 is realized by the display unit 2 shown in FIG. 1, for example.

  The exposure time display unit 90 displays the third exposure time set by the exposure time setting unit 50. The function of the exposure time display unit 90 is realized by the display unit 2 shown in FIG. 1, for example.

  FIG. 4 is a diagram showing a flow of a photographing process performed by the photographing device 1. In the imaging apparatus 1, for example, the system control unit 27 executes a predetermined program so that the constituent elements shown in FIG. 3 function, and the simulation from pseudo ND filter imaging to pseudo ND filter imaging shown in FIG. 4 is performed. A series of photographing processing is performed.

  When the shooting process shown in FIG. 4 is started, the shooting device 1 first sets the dimming rate for still image recording (step S1). Here, for example, the dimming rate setting unit 51 sets the dimming rate based on the ND magnification specified by the user of the imaging apparatus 1 operating the operation unit 38.

  Next, the imaging device 1 sets the exposure time (step S2). Here, the exposure time setting unit 50 sets the first exposure time and the third exposure time based on the dimming rate set in step S1, and the first exposure time and the third exposure time are set based on the frame rate for live view image display. 2 Set the exposure time. The frame rate for displaying a live view image is also simply referred to as a frame rate for live view.

  Particularly, regarding the first exposure time and the third exposure time, the exposure time setting unit 50 determines the first exposure time and the third exposure time based on the extinction ratio and one of the first exposure time and the third exposure time. The other exposure time is calculated. More specifically, the exposure time setting unit 50 sets the first exposure time so that the ratio of the first exposure time and the third exposure time (= first exposure time / third exposure time) matches the extinction rate. And the other of the third exposure times is calculated.

  For example, the exposure time setting unit 50 may set the exposure time estimated by the imaging apparatus 1 performing automatic exposure (AE) control to the first exposure time. In that case, the first exposure time is dimmed. The third exposure time may be calculated by dividing by the rate. In addition, the exposure time setting unit 50 may set the time manually set by the user as the third exposure time. In that case, by multiplying the manually set third exposure time by the dimming rate, The first exposure time may be calculated.

  When the setting of the exposure time is completed, the photographing apparatus 1 starts the simulation of the pseudo ND filter photographing, and repeats the processing of steps S3 to S7 until the photographing instruction of the pseudo ND filter photographing is instructed in step S8.

  First, the imaging device 1 acquires image data for a live view image (step S3). Here, the imaging control unit 28 sets the second exposure time set in step S2 in the image sensor 24, and the imaging unit 20 acquires the second image data for live view image display with the second exposure time.

  Next, the imaging device 1 synthesizes the image data acquired in step S3 (step S4). Here, the second synthesizing unit 63 sequentially adds and synthesizes the second image data acquired by the imaging unit 20 in the second exposure time to generate the second synthetic image data.

  Furthermore, the imaging device 1 calculates the gain (step S5). Here, the second gain applying unit 64 calculates the second gain by the above-described equation (2).

  When the gain is calculated, the image capturing device 1 generates live view image data (step S6). Here, the second gain application unit 64 generates the first live view image data by applying the second gain to the second combined image data.

  Then, the imaging device 1 displays the live view image (step S7). Here, the live view image display unit 80 updates and displays the first live view image at the frame rate for displaying the live view image based on the first live view image data generated in step S6. Further, the exposure time display unit 90 may display the third exposure time.

  The live view image 100 shown in FIG. 5 is an example of the live view image displayed on the display unit 2 when 0.5 seconds has elapsed from the start of the simulation, and the live view image 101 shown in FIG. 6 is 2 seconds from the start of the simulation. It is an example of a live-view image displayed on the display unit 2 at a point of time. The mark 200 indicates the third exposure time. The marks 201 and 201a indicate the relationship between the third exposure time and the second total exposure time. More specifically, the mark 201 and the mark 201a are a ring graph showing the ratio of the second total exposure time to the third exposure time, and a numerical value showing the second total exposure time provided in the ring graph. It is composed of. In other words, the ring graph shows the ratio of the exposure time corresponding to the second combined image data to the third exposure time. A mark 202 indicates the ND magnification in the pseudo ND filter shooting.

  When the photographing instruction is detected in step S8, the photographing apparatus 1 starts the pseudo ND filter photographing. The shooting instruction is, for example, pressing of the shutter button 7.

  First, the imaging device 1 acquires image data for a plurality of still images (step S9). Here, the image pickup control unit 28 sets the first exposure time set in step S2 in the image pickup device 24, and the image pickup unit 20 acquires the first image data for still image display with the first exposure time. The imaging unit 20 acquires a plurality of first image data by repeating the acquisition of the first image data until the first total exposure time reaches the third exposure time.

  Next, the imaging device 1 synthesizes the image data acquired in step S9 (step S10). Here, the first combining unit 61 adds and combines the plurality of first image data acquired by the imaging unit 20 to generate the first combined image data.

  Furthermore, the imaging device 1 calculates a gain (step S11). Here, the first gain application unit 62 calculates the first gain by the above-described formula (1).

  When the gain is calculated, the image capturing apparatus 1 generates still image data (step S12). Here, the first gain application unit 62 generates the first still image data by applying the first gain to the first combined image data.

  Finally, the photographing device 1 records the still image data (step S13). Here, the still image recording unit 70 records the first still image data generated in step S12.

  As shown in FIG. 4, the image capturing apparatus 1 can display the live view image obtained by simulating the pseudo ND filter photographing and then perform the pseudo ND filter photographing. Therefore, the user can confirm the slow shutter effect of the image obtained by the pseudo ND filter shooting by looking at the live view image. This makes it possible to avoid the failure of the pseudo ND filter shooting, that is, the situation in which the image obtained by the pseudo ND filter shooting is significantly different from the image expected by the user. For this reason, it is possible to prevent a large amount of time from being wasted due to the reshooting.

  As described above, the image capturing apparatus 1 performs live view display of an image obtained by simulating the pseudo ND filter capturing before the pseudo ND filter capturing. On the other hand, for example, the technique of performing a multi-echo process during recording of a moving image to give a special effect, which is described in Patent Document 4, is similar in that a composite image is displayed, but a still image shooting using an ND filter is performed. This is not what is simulated on the view, and the shooting condition of a specific still image is not changed by further simulation. In that respect, the shooting device 1 is significantly different. In addition, the techniques described in Patent Documents 5 and 6 are techniques in which images are combined and edited and reproduced and displayed after the shooting is completed. These technologies also do not simulate the specific still image shooting conditions on the live view, and in that respect, they are significantly different from the shooting device 1.

  Further, the image capturing apparatus 1 displays the live view image with the same brightness as the dimmed still image, and simultaneously displays the slow shutter effect. Further, the slow shutter effect is automatically reset according to the change of the photographing condition and the photographing is restarted, which not only contributes to avoiding the re-imaging of the photographing but also enables the rapid re-imaging.

  Furthermore, the imaging device 1 displays the live view image immediately after the simulation of the pseudo ND filter imaging is started. Since the user can confirm the slow shutter effect according to the elapsed time from the start of the simulation on the live view image, for example, by viewing the live view image 100 and the live view image 101 shown in FIGS. 5 and 6. , The slow shutter effect obtained in the third exposure time can be expected. Therefore, the user can confirm that the required slow shutter effect can be obtained before the third exposure time elapses from the start of the simulation, so that the pseudo ND filter shooting can be performed early while avoiding the reshooting of the shooting. Can start.

  In addition, as described above, the user can confirm the slow shutter effect according to the elapsed time from the start of the simulation on the live view image, and thus the third exposure set for the expected slow shutter effect. It is possible to understand that the time is too long or too short. Therefore, since it is possible to grasp the setting of the appropriate exposure time before the pseudo ND filter shooting, it is possible to avoid the failure of the pseudo ND filter shooting by reviewing the setting.

  5 and 6 show an example in which the display unit 2 displays the third exposure time of the first exposure time to the third exposure time, but as shown in FIG. The first exposure time may be displayed in addition to the third exposure time. In this case, marks (mark 200a, mark 204a) that can distinguish the first exposure time and the third exposure time may be displayed. The mark 200a indicates the third exposure time indicating the degree of flow of the subject image, and the mark 204a indicates the first exposure time indicating the brightness of the image.

  Thereby, in addition to the relationship between the slow shutter effect and the third exposure time, the relationship between the image brightness and the first exposure time can be understood by checking the live view image and the mark. Therefore, the user can adjust the brightness of the image by changing the first exposure time as necessary. Further, the user may set the first exposure time (mark 200a) and the third exposure time (mark 204a) individually, and the configuration may be changed so that the ND magnification (mark 200) is calculated and displayed. ..

  Hereinafter, the processing performed by the image capturing apparatus 1 will be described in more detail. First, with reference to FIGS. 8 to 16, a pseudo ND filter imaging simulation operation and a pseudo ND filter imaging setting operation performed by the user before starting the pseudo ND filter imaging will be described.

  8 is a flowchart of the pseudo ND shooting button process. FIG. 9 is a flowchart of the dial rotation process during button pressing. FIG. 10 is a diagram for explaining a method of roughly changing the dimming rate. Here, the user can quickly select discrete sequence values from ND2 to ND1000 that are often used. Further, by selecting ND_AUTO, it is possible to set the mode in which the ND magnification is automatically selected by the camera. FIG. 11 is a diagram for explaining a method of finely changing the dimming rate. Here, FIG. 10 shows an embodiment of fine adjustment of the ND magnification when ND16 is selected. FIG. 12 is a flowchart of the button short push dial rotation process. FIG. 13 is a diagram showing an example of a dimming rate setting screen. FIG. 14 is a diagram for explaining a method of changing the ND filter type. FIG. 15 is a diagram for explaining a method of changing a target item. FIG. 16 is a flowchart of the dimming rate automatic setting process.

  By pressing the pseudo ND shooting button 3 shown in FIG. 2, the user can set the pseudo ND filter shooting. Specifically, when the pseudo ND shooting button 3 is pressed, the shooting device 1 starts the pseudo ND shooting button process shown in FIG.

  First, the image capturing apparatus 1 determines whether or not the pseudo ND image capturing button 3 is being pressed (step S21). If it is being pressed, the button pressing dial rotation process shown in FIG. 9 is performed (step S22).

  In the dial rotation process while the button is being pressed, the image capturing apparatus 1 determines whether the F dial 8 or the R dial 12 has been rotated (step S31). If so, the pseudo ND filter image capturing Flg is set to "1". Is set (step S32). The pseudo ND filter shooting Flg is a flag indicating whether or not the shooting device 1 performs the pseudo ND filter shooting. When the pseudo ND filter photographing Flg is "1", the photographing apparatus 1 performs the pseudo ND filter photographing, and when the pseudo ND filter photographing Flg is "0", the photographing apparatus 1 does not perform the pseudo ND filter photographing.

  When the flag is set, the image capturing apparatus 1 changes the dimming rate according to the rotation of the dial (step S33 to step S35). First, the photographing apparatus 1 determines whether the rotated dial is the F dial 8 or the R dial 12 (step S33). Then, when the rotated dial is the R dial 12, the light reduction rate setting unit 51 discretely changes the light reduction rate as shown in FIG. 10 (step S34). On the other hand, if the rotated dial is the F dial 8, the dimming ratio setting unit 51 finely changes the dimming ratio so that the ND magnification changes by 1, for example, as shown in FIG. 11 (step S35). ). In the case of changing the extinction ratio finely, as shown in FIG. 11, the upper limit value and the lower limit value of the extinction ratio (ND magnification) may be limited. The changed ND magnification is reflected in the mark 202 on the shooting standby screen shown in FIGS. 5, 6, and 7.

  As described above, in the image capturing apparatus 1, the user can manually set the dimming rate by operating the dial on the image capturing apparatus 1 (shooting standby screen).

  When it is determined that the pressing of the pseudo ND shooting button 3 is a short press (step S23), the imaging device 1 performs the button short press dial rotation process shown in FIG. 12 (step S24).

  In the button short push dial rotation process, the image capturing apparatus 1 determines whether the pseudo ND filter image capturing Flg is "1" (step S41). When it is determined that the pseudo ND filter image pickup Flg is not "1", the image pickup apparatus 1 sets "1" in the pseudo ND filter image pickup Flg (step S47), and ends the button short press dial rotation process.

  When it is determined that the pseudo ND filter shooting Flg is “1”, the shooting device 1 displays the dimming rate setting screen (step S42). The dimming rate setting screen is, for example, as shown in FIG. 13, a screen in which the dimming rate setting wizard 210 is superimposed on the screen displaying the live view image. In the dimming rate setting wizard 210, for example, the type of the pseudo ND filter (item I1) and the ND magnification (item I2 to item I6) can be changed.

  Then, the imaging device 1 determines whether the F dial 8 or the R dial 12 has been rotated (step S43). Then, when it is determined that the rotated dial is the R dial 12, the imaging device 1 changes the setting content of the item (referred to as the target item) currently selected in the dimming rate setting wizard 210 (step S44). .. In the example of FIG. 13, since the item I1 designating the type of the pseudo ND filter is selected, when the R dial 12 is rotated, the types of the pseudo ND filter are “half” and “normal” as shown in FIG. To switch between. Pseudo ND filter photography using a normal type pseudo ND filter applies the same extinction rate to all pixels, whereas pseudo ND filter photography using a half type pseudo ND filter is performed for each pixel line. Different extinction rates are used. The half type will be described in detail later.

  When the item I2 designating the ND magnification is selected, when the R dial 12 is rotated, the discrete series values of the ND magnification (that is, the extinction ratio) are switched as shown in FIG. Further, when any of the items I3 to I6 designating the ND magnification is selected, when the R dial 12 is rotated, the content changes by 1 between "0" and "9". As a result, the ND magnification can be finely changed as shown in FIG.

  When it is determined that the rotated dial is the F dial 8 in step S43, the imaging device 1 changes the target item of the dimming rate setting wizard 210 as shown in FIG. 15 (step S45).

  When the setting content or the target item is changed, the imaging device 1 repeats the processing from step S43 to step S45 until an instruction to end the dimming rate setting is input (step S46 YES).

  As described above, in the image capturing apparatus 1, the user can manually set the ND filter type and the ND magnification (dimming rate) on the dimming rate setting wizard 210.

  When it is determined that the pressing of the pseudo ND shooting button 3 is a long press (step S23), the photographing apparatus 1 sets "0" in the pseudo ND filter Flg, and the photographing apparatus 1 ends the pseudo ND filter photographing. As described above, the setting of the image capturing apparatus 1 is changed.

  When it is determined that the pressing of the pseudo ND shooting button 3 is a double click (step S23), the imaging apparatus 1 performs the light reduction rate automatic setting process shown in FIG. 16 (step S26).

  In the automatic dimming rate setting process, the photographing apparatus 1 first analyzes the live view image (step S51) and determines the photographing scene (step S52).

  When determining that the subject is a waterfall or mountain stream, the image capturing apparatus 1 sets the dimming rate so that the third exposure time is, for example, 30 seconds (step S53). After that, the image capturing apparatus 1 displays the wording "waterfall / river stream like silk" on the display unit 3 for 3 seconds (step S54), and ends the automatic dimming rate setting process.

  When determining that the subject is the water surface, the image capturing apparatus 1 calculates the fluctuation cycle of the brightness of the water surface from the live view image, and the dimming rate is set so that the third exposure time becomes, for example, twice the calculated fluctuation cycle. Is set (step S55). After that, the image capturing apparatus 1 displays the wording "the surface of the water looks like a mirror surface" for 3 seconds on the display unit 2 (step S56), and ends the automatic dimming rate setting process.

  When the photographing apparatus 1 determines that the subject is fireworks, it sets the extinction rate so that, for example, the relationship of “ISO sensitivity / 100 = 4” is established (step S57). After that, the image capturing apparatus 1 displays the phrase “to prevent the color loss of the fireworks” on the display unit 2 for 3 seconds (step S58), and ends the automatic dimming rate setting process.

  When the imaging device 1 determines that the subject is crowded, it sets the dimming rate so that, for example, the third exposure time becomes 2 seconds (step S59). After that, the image capturing apparatus 1 displays the phrase “Make a crowded atmosphere” on the display unit 2 for 3 seconds (step S60), and ends the automatic dimming rate setting process.

  When the imaging device 1 determines that the subject is a cloud, it calculates the cloud flow speed from the live-view image, and the third exposure time indicates that the cloud movement amount is, for example, 10% of the diagonal length of the screen. The dimming rate is set so that the time reaches (step S61). After that, the image capturing apparatus 1 displays the phrase “make a cloud cloud atmosphere” on the display unit 2 for 3 seconds (step S62), and ends the automatic dimming rate setting process.

  As described above, in the photographing apparatus 1, when the user desires, instead of manually setting the dimming rate, the photographing apparatus 1 automatically determines the photographing scene and automatically sets an appropriate dimming rate. Can be set with.

  FIG. 17 is a flowchart of the photographing process performed by the photographing device 1. FIG. 18 is a flowchart of the preprocessing. FIG. 19 is a modification of the flowchart of the preprocessing. FIG. 20 is a flowchart of the exposure time setting process. FIG. 21 is a flowchart of the manual ND exposure time setting process. FIG. 22 is a flowchart of the continuity calculation processing. FIG. 23 is a modification of the flowchart of the continuity calculation processing. FIG. 24 is a diagram showing an example of a warning display regarding continuity. FIG. 25 is a flowchart of the reproducibility calculation process. FIG. 26 is a modification of the flowchart of the reproducibility calculation processing. FIG. 27 is a modified example of the flowchart of the manual ND exposure time setting process. FIG. 28 is a flowchart of the automatic ND exposure time setting process. FIG. 29 is a flowchart of live simulation processing. FIG. 30 is a flowchart of the pseudo ND filter shooting process. FIG. 31 is a flowchart of the multi-shooting process. Hereinafter, the pseudo ND filter imaging simulation and the pseudo ND filter imaging will be described in detail with reference to FIGS. 17 to 31.

  When the shooting process shown in FIG. 17 is started, the shooting device 1 first determines whether or not the pseudo ND filter shooting Flg is "1" (step S71). Here, if it is determined that the pseudo ND filter shooting Flg is not "1", the shooting apparatus 1 performs normal shooting processing (step S78).

  When it is determined that the pseudo ND filter shooting Flg is “1”, the shooting device 1 performs the preprocessing shown in FIG. 18 (step S72). The pre-processing is a preparatory processing for properly performing the pseudo ND filter shooting, and the pre-processing shown in FIG. 18 is performed when the pseudo ND filter shooting is inappropriately set. Is a process of prohibiting the pseudo ND filter photographing and performing the normal process of step S78.

  In the preprocessing shown in FIG. 18, the photographing apparatus 1 first determines the photographing mode (step S81). When the shooting mode is a predetermined mode that is not suitable for the pseudo ND filter shooting, the shooting device 1 performs the normal process without performing the pseudo ND filter shooting (step S78). The predetermined mode that is not suitable for the pseudo ND filter shooting is, for example, an automatic exposure shooting mode, a BULB shooting mode, a flash shooting mode, or a moving image shooting mode.

  The automatic exposure shooting mode is a shooting mode in which at least one of the shutter speed and the aperture is determined according to the brightness of the subject, and includes the P mode, the A mode, the S mode, and the like. Since shooting using an ND filter usually has a target aperture value (depth of field) and shutter speed, the automatic exposure shooting mode in which at least one of these is automatically determined is suitable for pseudo ND filter shooting. Not the proper shooting mode.

  In the BULB shooting mode, the exposure time is indefinite before shooting, and in that respect, it is not suitable for pseudo ND filter shooting. Further, in the flash photography mode, it is difficult to reduce the amount of light incident by the flash according to the designated extinction rate from the viewpoint of the resolution of the flash emission amount control unit, and in that respect, it is suitable for pseudo ND filter photography. Absent. Since the continuity of exposure between frames of a moving image is important in the moving image shooting mode, it is not suitable for pseudo ND filter shooting.

  When it is determined that the shooting mode is other than the predetermined mode, the shooting device 1 determines the shutter mode (step S82). When the shutter mode is the mechanical shutter mode, the imaging device 1 performs normal processing without performing pseudo ND filter imaging.

  When the mechanical shutter is used, an unexposed period occurs within the shooting frame period due to shutter charge and image capture reset. Therefore, continuity is not ensured between the frame images, and the motion of the subject is reproduced discontinuously. The mechanical shutter is not suitable for the pseudo ND filter photographing because this discontinuity can be a factor that hinders the normal achievement of the slow shutter effect.

  When it is determined that the shutter mode is the electronic shutter mode, the image capturing apparatus 1 updates the ISO sensitivity (step S83) and ends the preprocessing. Here, it is desirable that the image capturing apparatus 1 set the ISO sensitivity to, for example, an ISO sensitivity lower than that during normal shooting. It may be limited to the lowest ISO sensitivity that can be set by the photographing apparatus 1, or may be limited to the lowest ISO sensitivity except the extended ISO sensitivity. Further, the ISO sensitivity setting range including the extended ISO sensitivity may be limited in consideration of the dynamic range.

  In this way, in step S83, the ISO sensitivity for normal shooting is changed to the ISO sensitivity for pseudo ND filter shooting to limit the ISO sensitivity. As a result, not only is it meaningless to set the ND magnification high with high ISO sensitivity, but rather it is possible to prevent harmful setting actions in image quality.

  In this way, the image capturing apparatus 1 performs the pre-processing shown in FIG. 18, thereby performing the normal processing of step S78 when the setting inappropriate for the pseudo ND filter imaging is performed. As a result, it is possible to prohibit the pseudo ND filter shooting with inappropriate settings.

  Note that the image capturing apparatus 1 may perform the preprocessing shown in FIG. 19 instead of the preprocessing shown in FIG. The pre-processing shown in FIG. 19 is processing for changing to settings suitable for pseudo ND filter shooting when improper settings are made for pseudo ND filter shooting.

  In the preprocessing shown in FIG. 19, the imaging device 1 first determines the exposure mode (step S91), and when the exposure mode is the automatic exposure mode, sets the exposure mode to the manual exposure mode (step S92). ..

  Further, the image capturing apparatus 1 determines the shutter mode (step S93), and when the shutter mode is the mechanical shutter mode, sets the shutter mode to the electronic shutter mode (step S94).

  Finally, the imaging device 1 updates the ISO sensitivity (step S95) and ends the preprocessing. The process of step S95 is the same as the process of step S83.

  As described above, the image capturing apparatus 1 performs the pre-processing shown in FIG. 19 instead of the pre-processing shown in FIG. 18 to set the user's setting when the pseudo ND filter shooting is inappropriately set. It is desirable to automatically change to an appropriate setting in order to reduce the number of rework steps. In this case as well, similar to the case where the preprocessing shown in FIG. 18 is performed, it is possible to prohibit the pseudo ND filter shooting with an inappropriate setting by the automatic setting change.

  When the preprocessing is completed, the image capturing apparatus 1 performs the exposure time setting process shown in FIG. 20 (step S73). In the exposure time setting process shown in FIG. 20, the imaging device 1 first determines whether or not the automatic ND setting is set (step S101). Note that the automatic ND setting refers to a setting in which the imaging apparatus 1 automatically determines the ND magnification (that is, the dimming rate).

  If the automatic ND setting is not made, the image capturing apparatus 1 performs the manual ND exposure time setting process shown in FIG. 21 (step S102). When the automatic ND setting is made, the image capturing apparatus 1 performs the automatic ND exposure time setting process shown in FIG. 28 (step S103).

  When the manual ND exposure time setting process shown in FIG. 21 is started, the imaging device 1 first sets the second exposure time (step S111), and further determines the exposure mode (step S112). Here, the second exposure time is the reciprocal of the live view frame rate. The frame rate of live view normally takes a value from 15 fps to 120 fps depending on the brightness.

  When the exposure mode is the manual exposure mode, the photographing apparatus 1 sets the time specified by the user in the third exposure time (step S113), and sets the first exposure time in the first exposure time set in step S113. 3 The time calculated by multiplying the exposure time by the extinction ratio is set (step S114).

  On the other hand, when the exposure mode is the automatic exposure mode, the photographing apparatus 1 performs the automatic exposure control to estimate the exposure time (step S115). After that, the imaging apparatus 1 sets the exposure time estimated in step S115 as the first exposure time (step S116), and divides the first exposure time set in step S116 by the dimming rate into the third exposure time. The time calculated by is set (step S117).

  When the first exposure time and the third exposure time are set, the imaging device 1 sets the display exposure time to the third exposure time (step S118), and then performs the continuity calculation process shown in FIG. 22 ( Step S119). The display exposure time is an exposure time displayed on the display unit 2, and is used for generation of the mark 200 shown in FIGS. 5 and 6, for example.

  The continuity calculation process is a process for ensuring that the slow shutter effect is appropriately exerted in the pseudo ND filter shooting. If the first exposure time is too short with respect to the frame rate of the main exposure readout control for still images, the flow showing the motion of the subject that should appear in the image is cut off due to the slow shutter effect. More specifically, the first exposure time is longer than the time corresponding to the reciprocal of the maximum frame rate of the main exposure readout control for still images (that is, 1 / maximum frame rate, also referred to as maximum frame rate time). When it is short, the flow appearing in the image may be cut off. Here, the main-exposure reading frame rate is a frame rate in the control in which the image capturing apparatus 1 reads all pixels, and the larger the image pickup element, the slower the frame rate. A value of 20 fps to 60 fps is usually used for a large image pickup device for one eye.

  Therefore, in the continuity calculation process, the image capturing apparatus 1 determines whether or not the first exposure time is equal to or longer than the time corresponding to the reciprocal of the maximum frame rate of the main exposure readout control for still images (step S121). When one exposure time is less than the time corresponding to the reciprocal of the maximum frame rate for still images, the first exposure time and the third exposure time are reset (steps S122 and S123). Specifically, the photographing apparatus 1 sets a time corresponding to the reciprocal of the maximum frame rate of the main exposure read control for still images in the first exposure time (step S122), and sets the first exposure time in the third exposure time. Is set by the dimming rate (step S123). As a result, the slow shutter effect is sufficiently exerted without the flow being cut off on the image. The first exposure time may be set to a time equal to or longer than the time corresponding to the reciprocal of the maximum frame rate of the main exposure read control for still images.

  Instead of the continuity calculation process shown in FIG. 22, the continuity calculation process shown in FIG. 23 may be performed. In the continuity calculation process illustrated in FIG. 23, the imaging device 1 determines whether the first exposure time is equal to or longer than the time corresponding to the reciprocal of the maximum frame rate for still images (step S131), and the first exposure time is determined. Is less than the time corresponding to the reciprocal of the maximum frame rate of the main exposure reading control for a still image, a warning is displayed (step S132).

  The method of displaying the warning is not particularly limited, but as shown in FIG. 24, the mark 202 indicating the ND magnification and the mark 200 indicating the third exposure time blink, for example, at 2 Hz, so that the movement of the subject appearing in the image is shown. The user may be notified that the flow indicating is cut off. This can encourage the user to voluntarily adjust the first exposure time.

  When the continuity calculation process shown in FIG. 22 or FIG. 23 ends, the imaging device 1 performs the reproducibility calculation process shown in FIG. 25 (step S120).

  The reproducibility calculation process is a process for ensuring that the slow shutter effect in the pseudo ND filter shooting is appropriately reproduced in the simulation of the pseudo ND filter shooting. When the frame rate for displaying the live view image is higher than the maximum frame rate for the main exposure reading for recording the still image, the slow shutter effect that can be confirmed in the live view image is not always obtained in the still image. Even when the second exposure time for displaying the live view image is shorter than the live view frame rate time, the slow shutter effect that can be confirmed in the live view image is not always obtained even in the still image.

  Therefore, in the reproducibility calculation process, the imaging device 1 determines whether the second exposure time is less than the live view frame rate time (step S141), and the second exposure time is less than the live view frame rate time. Then, the live view frame rate time is set to the second exposure time (step S142). As a result, it is possible to prevent a decrease in the simulation reproducibility of the slow shutter effect caused by the difference between the second exposure time and the live view frame rate time. The live view frame rate time is the time corresponding to the reciprocal of the frame rate for displaying the live view image.

  Note that the reproducibility calculation process shown in FIG. 26 may be performed instead of the reproducibility calculation process shown in FIG. In the reproducibility calculation process shown in FIG. 26, the imaging device 1 determines whether the second exposure time is less than the live view frame rate time (step S151), and the second exposure time is less than the live view frame rate time. If there is, a warning is displayed (step S152). This allows the user to notice that there is a problem in the reproducibility of the live view slow shutter effect and the whiteout prevention effect.

  In the manual ND exposure time setting process shown in FIG. 21 described above, when the exposure mode is the manual exposure mode, an example in which the user specifies the third exposure time is shown. Instead of the manual ND exposure time setting process shown in FIG. 21, the manual ND exposure time setting process shown in FIG. 27 may be performed. In the manual ND exposure time setting process shown in FIG. 27, when the exposure mode is the manual exposure mode, the imaging device 1 sets the time specified by the user as the first exposure time (step S163), and A time calculated by dividing the first exposure time set in step S163 by the extinction ratio is set to the three exposure times (step S164). Other processes are the same as the manual ND exposure time setting process shown in FIG. Specifically, the processing of steps S161 and S162 is the same as the processing of steps S111 and S112 shown in FIG. The processing of steps S165 to S170 is the same as the processing of steps S115 to S120 shown in FIG.

  By performing the manual ND exposure time setting process shown in FIG. 21 and FIG. 27, the imaging device 1 causes the first exposure time, the second exposure time, and the third exposure time based on the manually set dimming rate. Can be set appropriately.

  On the other hand, when the automatic ND exposure time setting process shown in FIG. 28 is started, the photographing apparatus 1 first sets the second exposure time (step S171), and further performs automatic exposure control to perform exposure. The time is estimated (step S172).

  Then, the imaging device 1 determines the photometric mode (step S173). If the metering mode is other than the evaluation metering mode (for example, spot metering mode, center-weighted metering mode, etc.), the exposure time estimated in step S172 is set as the first exposure time without performing saturation point detection. Yes (step S178).

  On the other hand, when the light metering mode is the evaluation light metering mode, the image capturing apparatus 1 performs saturation point detection (step S174). If the saturation point exists (YES in step S175), the imaging apparatus 1 recalculates the exposure time (step S176), and sets the first exposure time to the exposure time recalculated in step S176 (step S177). ). When the saturation point does not exist (NO in step S175), the imaging device 1 sets the exposure time estimated in step S172 as the first exposure time (step S178).

  When the first exposure time is set, the imaging device 1 determines the exposure mode (step S179). When the exposure mode is the automatic exposure mode, the imaging device 1 sets the third exposure time to the same time as the first exposure time set in step S177 or step S178 (step S182). On the other hand, when the exposure mode is the manual exposure mode, the imaging device 1 sets the time specified by the user as the third exposure time (step S180). After that, the first exposure time and the third exposure time are compared (step S181). If the first exposure time is long, the first exposure time is set to the first exposure time in order to avoid the ND magnification from being a decimal number. The same time as the exposure time is set (step S182).

  When the first exposure time and the third exposure time are set, the image capturing apparatus 1 sets the display exposure time to the third exposure time (step S183), and finally, the image capturing apparatus 1 sets the first exposure time to the first exposure time. The dimming rate is set based on the third exposure time (step S184), and the automatic ND exposure time setting process ends. The extinction ratio is calculated by dividing the first exposure time by the third exposure time.

  By performing the automatic ND exposure time setting process shown in FIG. 28, the imaging device 1 sets the first exposure time, the second exposure time, and the third exposure time without manually setting the dimming rate. can do.

  When the exposure time setting process (step S73 in FIG. 17) ends, the image capturing apparatus 1 determines whether the LV addition / combination Flg is “1” (step S74). The LV addition / combination Flg is a flag indicating whether or not the imaging device 1 performs a simulation of pseudo ND filter imaging. The user can manually set the LV addition / combination Flg on the setting screen. As a result, the user can instruct the start / stop of the live view simulation of the pseudo ND filter shooting at an arbitrary timing on the shooting standby screen. Further, the LV countable composition Flg is changed according to the operation of changing the shooting condition of the pseudo ND filter shooting, and the simulation is stopped, reset, and restarted.

  When it is determined that the LV addition composition Flg is "1", the imaging device 1 performs the live simulation process shown in FIG. 29 (step S75), and when it is determined that the LV addition composition Flg is "0". The imaging device 1 performs normal live view image display processing (step S76).

  When the live simulation process shown in FIG. 29 is started, the imaging device 1 first determines the ND filter type (step S191). When the ND filter type is the half, the imaging device 1 performs the live view image display process for the half ND filter (step S208).

  On the other hand, when the ND filter type is normal, the image capturing apparatus 1 acquires image data (second image data) F for live view image for one frame (step S192). Here, the imaging unit 20 acquires image data in the second exposure time T2. Next, the imaging device 1 adds and combines the acquired image data F to generate combined image data (step S193). Here, the synthetic image data F1 and the synthetic image data F2 are generated. After the additive composition, the image capturing apparatus 1 updates the counter (step S194). Here, the counter K1 for the combined image data F1 and the counter K2 for the combined image data F2 are updated.

  Next, the imaging device 1 determines whether or not the counter K2 has reached a predetermined threshold value KTH (step S195). The threshold value KTH is a threshold value that controls the update frequency of the live view image under specific conditions. The threshold value KTH may be calculated from the frame rate for displaying the live view image so that the update of the live view image takes about 0.5 to 1 second. When the counter K2 is the predetermined threshold value KTH, the imaging device 1 stores the composite image data F2 in a FIFO (First In, First Out) queue and resets the composite image data F2 and the counter K2 (step S196). As a result, live view countable image data F2 of about 0.5 to 1 second is sequentially queued in the FIFO queue. Countable image data for each frame of live view is stored in the composite image data F2.

  Further, the image capturing apparatus 1 determines whether the total exposure time (second total exposure time) TT for obtaining the combined image data F1 has reached the third exposure time T3 (step S197). When the total exposure time TT does not reach the third exposure time T3 (YES in step S197), the imaging device 1 updates the progress display displayed on the display unit 2 (step S202). The progress display is, for example, the mark 201 shown in FIG. 5 and the mark 201a shown in FIGS. 6 and 7. The imaging apparatus 1 generates, for example, the mark 201 shown in FIG. 5 based on the total exposure time TT and the third exposure time T3, and displays it on the display unit 2. As a result, the mark 201 is updated at any time until the total exposure time TT reaches the third exposure time T3.

  After that, the image capturing apparatus 1 calculates the gain (second gain) G1 by the above-described equation (2) (step S203). Furthermore, the imaging device 1 applies the calculated gain G1 to the composite image data F1 to generate live view image data (step S204), and updates and displays the live view image based on the live view image data (step S204). S205). As described above, the countable composite image data F1 is updated and displayed on the live view at the live view frame rate.

  On the other hand, when the total exposure time TT has reached the third exposure time T3 (step S197 NO), the imaging device 1 determines whether the total exposure time TT has reached the third exposure time T3 + threshold time TTH. Yes (step S198). Here, the threshold time TTH is an exposure time required to acquire the threshold KTH image data F. That is, the threshold time TTH is calculated by (second exposure time T2) × (threshold KTH).

  When the total exposure time TT does not reach the third exposure time T3 + threshold time TTH, the imaging device 1 performs the process of step S206 without updating the live view image. On the other hand, when the total exposure time TT reaches the third exposure time T3 + threshold time TTH, the imaging apparatus 1 takes out the data FO from the FIFO queue (step S199) and subtracts it from the composite image data F1 to combine the data. The image data F1 is updated (step S200). This makes it possible to reflect the latest image data while maintaining the slow shutter effect for the exposure time T3. Further, the image capturing apparatus 1 updates the counter K1 by subtracting the threshold value KTH from the counter K1. The data FO is the oldest data stored in the FIFO queue.

  After that, the image capturing apparatus 1 calculates the gain G1 (step S203) and applies the gain G1 to the composite image data F1 to perform live as in the case where the total exposure time TT does not reach the third exposure time T3. View image data is generated (step S204), and the live view image is updated and displayed based on the live view image data (step S205). In the calculation of the gain G1 in step S203, the total exposure time TT is recalculated in consideration of the subtraction process in step 200. As described above, after the total exposure time TT reaches the third exposure time T3, the countable composite image data F1 is displayed and updated on the live view while suppressing the update frequency from 0.5 seconds to 1 second.

  Lastly, the image capturing apparatus 1 determines whether or not an image capturing instruction for pseudo ND filter image capturing has been input (step S206), and if not input, returns to step S191 to repeat the processing.

  By performing the live simulation shown in FIG. 29, the imaging device 1 can display a live view image that simulates pseudo ND filter imaging. In particular, since the display is updated at the frame rate of the live view image until the total exposure time TT reaches the exposure time T3, the user can confirm the slow shutter effect according to the total exposure time in real time. . After the total exposure time TT reaches the exposure time T3, the user has already confirmed the slow shutter effect according to the exposure time T3. For this reason, the consumption of the buffer memory is suppressed by suppressing the update frequency. Specifically, by updating the display of the live view image for each threshold time TTH, the latest subject information can be reflected in the display. With the above-mentioned configuration, a large capacity buffer memory is not required, and even if it is about the normal buffer memory capacity of a single-lens camera, the ND magnification exceeds 400, and a real-time live view simulation at a long time of ten or more seconds is achieved. -It becomes possible to perform an option.

  When the live simulation or the normal live view image display processing in step S75 is completed by the input of the shooting instruction for the pseudo ND filter shooting, the shooting device 1 performs the pseudo ND filter shooting processing shown in FIG. 30 (step S77).

  When the pseudo ND filter photographing process shown in FIG. 30 is started, the photographing apparatus 1 performs all-pixel reading at the frame rate under the main exposure reading control, and one frame of image data (first image data) F for a still image is read. Minutes are acquired (step S211). Here, the imaging unit 20 acquires image data at the first exposure time T1. Next, the imaging device 1 adds and combines the acquired image data F to generate combined image data (step S212). Here, the synthetic image data Y1 is generated. Further, the photographing apparatus 1 performs the multi-photographing process shown in FIG. 31 (step S213), and then the total exposure time (first total exposure time) YT for obtaining the combined image data Y1 reaches the third exposure time T3. Until (step S214 YES), the main exposure read control is seamlessly and continuously repeated, and the processing from step S211 to step S213 is repeated. The multi-shooting process will be described later.

  When the total exposure time YT reaches the third exposure time T3, the imaging device 1 calculates the gain (first gain) GY1 by the above-mentioned formula (1) (step S215). Furthermore, the image capturing apparatus 1 generates still image data by applying the calculated gain GY1 to the combined image data Y1 (step S216), and records the generated still image data (step S217).

  By performing the pseudo ND filter photographing shown in FIG. 30, the photographing apparatus 1 can reproduce the photographing using the pseudo ND filter without using the ND filter and obtain a still image having a slow shutter effect. Further, by confirming the slow shutter effect in advance by the live simulation shown in FIG. 29, the slow shutter effect as intended by the user can be obtained in the pseudo ND filter shooting shown in FIG.

  Note that the multi-shooting process shown in FIG. 31 is a process of recording not only still image data corresponding to the exposure time T3 but also still image data corresponding to an intermediate time before reaching the exposure time T3. Specifically, when the multi-photographing setting is set to ON (YES in step S221), the photographing apparatus 1 calculates the recording timing based on the preset number of recording sheets (step S222). Then, when the total exposure time YT matches the recording timing (YES in step S223), the imaging device 1 calculates the gain GY1 (step S224) and applies the gain GY1 to the combined image data Y1 to obtain the still image data. It is generated (step S225), and the generated still image data is recorded (step S226). As a result, in addition to the still image data corresponding to the exposure time T3, still image data having a slow shutter effect different from that of the still image data corresponding to the exposure time T3 can be obtained.

  In the above, the case where the ND filter type is normal has been illustrated, but the pseudo ND filter imaging can be performed even when the ND filter type is half. Hereinafter, the pseudo ND filter imaging when the ND filter type is half will be described with reference to FIGS. 32 to 35. Note that FIG. 32 is a diagram showing an example of a still image. FIG. 33 is a diagram for explaining the half type pseudo ND filter setting. FIG. 34 is a diagram for explaining a pixel line of a still image. FIG. 35 is a diagram showing an example of the pseudo ND filter table.

  For example, when shooting a landscape as shown in FIG. 32, it may be desired to make the ND magnification different between the sky portion and the mountain portion. Half-type pseudo ND filter photography is suitable for such a case.

  As shown in FIG. 33, on the screen for setting the half type pseudo ND filter, the ND magnification to be applied to each pixel can be set using the upper limit boundary line 301 and the lower limit boundary line 302. For example, ND100 is set as the ND magnification on the upper limit boundary line 301, and the upper limit boundary line 301 is moved to the vicinity of the boundary between the sky and the mountain using the button 301a. As a result, the ND 100 is set to the upper limit boundary line 301 and the pixel line above it. Further, ND2 is set as the ND magnification on the lower limit boundary line 302, and the lower limit boundary line 302 is moved to a desired position using the button 302a. As a result, ND2 is set to the lower limit boundary line 302 and the pixel lines below it. Further, the ND magnification between the upper limit ND100 and the lower limit ND2 is set in the pixel line between the upper limit boundary line 301 and the lower limit boundary line 302. For example, the ND magnification calculated by linearly interpolating ND100 and ND2 may be set to each pixel line between the upper limit boundary line 301 and the lower limit boundary line 302. The same ND magnification may be set in units of several pixel lines, and the ND magnification may be gradually changed from the upper limit to the lower limit. Also, the ND magnification between the upper limit boundary line 301 and the lower limit boundary line 302 is not limited to linear interpolation, and may be interpolated by a higher-order function such as a quadratic function.

  By performing the above-described operation, the ND magnification is set for each of the pixel line LINE (1) to the pixel line LINE (N) shown in FIG. 34 and recorded in the table 310 shown in FIG. In the half-type pseudo ND filter photography, the ND magnification (light reduction rate) is set for each pixel line by referring to the table 310, and each pixel is exposed for an exposure time corresponding to the ND magnification.

  The embodiments described above show specific examples for facilitating the understanding of the invention, and the embodiments of the present invention are not limited to these. The image capturing device, the image capturing method, and the program can be variously modified and changed without departing from the scope of the claims.

  Although the exposure time setting unit 50 including the dimming rate setting unit 51 is illustrated in FIG. 3, the photographing apparatus 1 may include the exposure time setting unit 50a illustrated in FIG. 36 instead of the exposure time setting unit 50. Good. The exposure time setting unit 50a differs from the exposure time setting unit 50 in that it has a first exposure time setting unit 51a and a third exposure time setting unit 51b instead of the dimming rate setting unit 51. The first exposure time setting unit 51a sets the first exposure time specified by the user operating the operation unit 38, and the third exposure time setting unit 51b allows the user to operate the operation unit 38. Set the specified third exposure time. The exposure time setting unit 50a calculates and sets the extinction ratio from the first exposure time set by the first exposure time setting unit 51a and the third exposure time set by the third exposure time setting unit 51b.

  When the imaging apparatus 1 has the exposure time setting unit 50a instead of the exposure time setting unit 50, it performs the button short push dial rotation process shown in FIG. 37 instead of the button short push dial rotation process shown in FIG. ..

  In the button short-press dial rotation process shown in FIG. 37, the imaging device 1 determines whether or not the pseudo ND filter imaging Flg is “1” (step S231). When it is determined that the pseudo ND filter shooting Flg is not "1", the image capturing apparatus 1 sets "1" in the pseudo ND filter shooting Flg (step S238), and ends the button short press dial rotation process.

  When it is determined that the pseudo ND filter shooting Flg is "1", the shooting device 1 displays the twin shutter speed setting screen (step S42). The twin shutter speed setting screen is, for example, as shown in FIG. 38, a screen in which the twin shutter speed setting wizard 220 is superimposed on the screen displaying the live view image. In the twin shutter speed setting wizard 220, for example, the first exposure time that determines the brightness of the image and the third exposure time that determines the slow shutter effect can be changed. Note that FIG. 38 shows an example in which the first exposure time is 1/60 s and the third exposure time is set to 10 seconds.

  Then, the imaging device 1 determines whether the F dial 8 or the R dial 12 has been rotated (step S234). Then, when it is determined that the rotated dial is the R dial 12, the imaging device 1 changes the third exposure time displayed in the twin shutter speed setting wizard 220 according to the rotation amount (step S235). In addition, when it is determined that the rotated dial is the F dial 8, the image capturing apparatus 1 changes the first exposure time indicated on the twin shutter speed setting wizard 220 according to the rotation amount (step S236). Note that in steps S235 and S236, the ND magnification is recalculated and the display of the ND magnification is updated along with the change of the first exposure time or the third exposure time.

  The image capturing apparatus 1 repeats the processing from step S234 to step S236 until an instruction to end the shutter speed setting is input (step S237 YES).

  As described above, even when the exposure time setting unit 50a is provided instead of the exposure time setting unit 50, the imaging device 1 can simulate the pseudo ND filter imaging before the imaging and display the live view.

  Although the exposure time setting unit 50 having the dimming rate setting unit 51 is illustrated in FIG. 3, the photographing apparatus 1 may include the exposure time setting unit 50b shown in FIG. 39 instead of the exposure time setting unit 50. Good. The exposure time setting unit 50b differs from the exposure time setting unit 50 in that it has an additive composite number setting unit 51c instead of the dimming rate setting unit 51. The additive composite number setting unit 51c sets the additive composite number in the pseudo ND filter shooting specified by the user operating the operation unit 38, and calculates the first exposure time and the third exposure time based on the additive composite number. To do. It should be noted that the number of combined images is the reciprocal of the extinction ratio.

  As described above, even when the exposure time setting unit 50b is provided instead of the exposure time setting unit 50, the imaging device 1 can simulate the pseudo ND filter imaging before the imaging and display the live view.

  Further, the photographing apparatus 1 may reset the sequential addition processing of the second image data under a predetermined condition. For example, when the second synthesis unit 63 is notified of the change in the shooting settings, the second synthesis image data that has already been generated is reset, and the second image acquired by the imaging unit 20 after the shooting settings have been changed. The data may be sequentially added and combined. The shooting settings include, for example, focus adjustment by operating the manual focus ring 6, operation of a magnifying button 9, and change of magnification by operating the zoom ring 5. The change of the shooting setting may be detected by the operation of the operation unit 38 performed by the user. When the camera shake detection unit 34 detects a camera shake amount equal to or greater than the first threshold, the second composition unit 63 resets and ends the second composite image data that has already been generated, and the camera shake amount is the first camera shake amount. Alternatively, only the second image data that is smaller than the threshold value of 1 may be sequentially added and combined. .. This prevents images with different composition from being combined due to changes in the angle of view due to disturbances caused by camera shake or zoom changes, and from continuing unsuitable simulations due to images with different focus conditions being used during shooting. It is possible to perform a quick simulation according to the change of the photographing condition, which contributes to a quick confirmation by the user and a quick redo.

1 Imaging Device 2 Display 3 Pseudo ND Shooting Button 4 Shooting Mode Dial 5 Zoom Ring 6 Manual Focus Ring 7 Shutter Button 8 F Dial 9 Enlargement Button 10 Video Button 11 LV Mode Button 12 R Dial 20 Imaging Unit 21 Lens 22 Aperture 23 Mechanical Shutter 24 Image sensor 25 A / D converter 26 Memory 27 System controller 28 Imaging controller 29 Shutter controller 30 Aperture controller 31 Lens controller 32 AF processor 33 Exposure controller 34 Hand shake detector 35 Image processor 36 Power supply Unit 37 Power supply control unit 38 Operation unit 39 External memory 40 Non-volatile memory 41 Flash control unit 42 Flash charging unit 43 Flash light emitting units 50, 50a, 50b Exposure time setting unit 51 Extinction rate setting unit 51a First exposure time setting unit 51b Third exposure time setting unit 51c Additive synthesis number setting unit 60 Image generation unit 61 First synthesis unit 62 First gain application unit 63 Second synthesis unit 64 Second gain application unit 70 Still image recording unit 80 Live view image display unit 90 Exposure time display section 100, 101 Live view image 200, 200a, 201, 201a, 202, 204a Mark 210 Extinction rate setting wizard 220 Twin shutter speed setting wizard 301 Upper limit boundary line 301a, 302a Button 302 Lower limit boundary line 310 Table

Claims (20)

An image pickup unit for picking up an image of a subject, wherein the first image data for still image recording is acquired at a first exposure time, and the second image data for live view image display is acquired at a second exposure time. ,
A first combining unit that adds and combines a plurality of first image data repeatedly acquired by the imaging unit until the first total exposure time reaches a third exposure time;
A first gain applying unit that generates a first still image data having a first brightness by applying a first gain to the first combined image data output from the first combining unit;
A second combining unit that sequentially adds and combines the second image data acquired by the imaging unit;
A second gain applying unit that generates a first live view image data having the first brightness by applying a second gain to the second combined image data sequentially output from the second combining unit. A second gain applying section that applies the second gain each time the second combining image data is output from the second combining section;
A display unit for updating and displaying the first live view image at a frame rate for displaying the live view image in the imaging unit, based on the first live view image data generated by the second gain applying unit. An image pickup apparatus comprising: The photographing apparatus according to claim 1, further comprising:
The first exposure time and the third exposure time are set based on the extinction ratio set for the still image recording, and the second exposure time is set based on the frame rate for displaying the live view image. Equipped with an exposure time setting unit that
The exposure time setting unit may calculate the other of the first exposure time and the third exposure time based on the extinction ratio and one of the first exposure time and the third exposure time. Characteristic imaging device. The photographing apparatus according to claim 2,
The exposure time setting unit calculates the other of the first exposure time and the third exposure time so that the ratio of the first exposure time and the third exposure time matches the dimming rate. Characteristic imaging device. In the imaging device according to claim 2 or 3,
The first exposure time is an exposure time estimated by the automatic exposure control performed by the imaging device,
The imaging apparatus, wherein the exposure time setting unit calculates the third exposure time by dividing the first exposure time by the light reduction rate. In the imaging device according to claim 2 or 3,
The imaging apparatus, wherein the exposure time setting unit calculates the first exposure time by multiplying the third exposure time manually set in the imaging apparatus by the dimming rate. The photographing apparatus according to any one of claims 2 to 5, further comprising:
An operation unit that receives a user operation for designating the dimming rate,
An imaging apparatus comprising: a dimming rate setting unit that sets the dimming rate specified by the user. The photographing apparatus according to any one of claims 2 to 6,
The exposure time setting unit,
It is determined whether the first exposure time is equal to or longer than a time corresponding to the reciprocal of the maximum frame rate of the main exposure reading for still image recording in the image capturing unit,
When it is determined that the first exposure time is less than the time corresponding to the reciprocal of the maximum frame rate, the first exposure time is changed to a time equal to or longer than the time corresponding to the reciprocal of the maximum frame rate. Shooting device. The photographing apparatus according to any one of claims 2 to 6,
The exposure time setting unit determines whether the first exposure time is equal to or longer than a time corresponding to a reciprocal of the maximum frame rate of the main exposure reading for recording the still image in the imaging unit,
The image capturing apparatus, wherein the display unit displays a warning when the exposure time setting unit determines that the first exposure time is less than a time corresponding to an inverse number of the maximum frame rate. The photographing apparatus according to any one of claims 2 to 6,
The exposure time setting unit,
It is determined whether the second exposure time is less than the time corresponding to the reciprocal of the frame rate for displaying the live view image,
When it is determined that the second exposure time is less than the time corresponding to the reciprocal of the live view image display frame rate, the second exposure time corresponds to the reciprocal of the live view image display frame rate. An imaging device characterized by changing to time. The photographing apparatus according to any one of claims 2 to 6,
The exposure time setting unit determines whether the second exposure time is less than a time corresponding to an inverse number of a frame rate for displaying the live view image,
The display unit displays a warning when the second exposure time is determined by the exposure time setting unit to be less than a time corresponding to the reciprocal of the frame rate for displaying the live view image. Shooting device. The imaging device according to any one of claims 1 to 10,
The imaging device, wherein the second composition unit sequentially adds and combines the second image data acquired by the imaging unit after the imaging setting is changed, when the imaging setting change is notified. The photographing apparatus according to claim 1, further comprising:
A camera shake detection unit that detects the amount of camera shake of the imaging device;
When the camera shake detection unit detects a camera shake amount equal to or greater than a first threshold, the second composition unit resets and ends, and the image capturing unit acquires the camera shake amount smaller than the first threshold value. A photographing apparatus, wherein the second image data is sequentially and countably combined. The photographing apparatus according to claim 1, further comprising:
An exposure time setting unit configured to set the first exposure time and the third exposure time based on the number of combined images set for recording the still image,
The exposure time setting unit may calculate the other of the first exposure time and the third exposure time based on the additive composite number and one of the first exposure time and the third exposure time. Characteristic imaging device. The photographing apparatus according to claim 1, further comprising:
A photometer that detects subject brightness,
An imaging apparatus, comprising: an exposure time setting unit that sets the first exposure time, the second exposure time, and the third exposure time based on subject brightness detected by the photometry unit. The photographing apparatus according to any one of claims 1 to 14,
The said display part displays the said 3rd exposure time, The imaging device characterized by the above-mentioned. The imaging device according to any one of claims 1 to 15,
The image pickup apparatus, wherein the display unit displays the first exposure time and the third exposure time. The photographing apparatus according to any one of claims 1 to 16,
The display device displays a ratio of an exposure time corresponding to the second combined image data to the third exposure time. The photographing apparatus according to any one of claims 1 to 17,
The first exposure time determines the first brightness,
The photographing apparatus, wherein the third exposure time determines a tracking time of the motion of the subject. The first combined image data is generated by adding and combining the plurality of first image data repeatedly acquired until the first total exposure time reaches the third exposure time, where each of the plurality of first image data is , Image data for still image recording, acquired at the first exposure time,
Applying a first gain to the first composite image data to generate first still image data having a first brightness,
Before the first composite image data is generated, second image data is sequentially added and combined to generate second composite image data, wherein the second image data is image data for live view image display. And is acquired at the second exposure time,
Before the first composite image data is generated, a second gain is applied to the second composite image data to generate first live view image data having the first brightness, wherein the first live view image data having the first brightness is generated. The second gain is applied each time the second composite image data is generated,
Before the first composite image data is generated, the first live view image is updated and displayed at the frame rate for displaying the live view image based on the first live view image data. How to shoot. An image pickup unit for picking up an image of a subject, wherein the first image data for still image recording is acquired at a first exposure time, and the second image data for live view image display is acquired at a second exposure time. Including the shooting device,
First combined image data is generated by adding and combining a plurality of first image data repeatedly acquired by the imaging unit until the first total exposure time reaches the third exposure time,
Applying a first gain to the first composite image data to generate first still image data having a first brightness,
Before the first composite image data is generated, the second composite image data is generated by sequentially adding and combining the second image data acquired by the imaging unit,
Before the first composite image data is generated, a second gain is applied to the second composite image data to generate the first live view image data having the first brightness and the second gain. Is applied every time the second composite image data is generated,
Processing for updating and displaying the first live-view image at the frame rate for displaying the live-view image in the imaging unit based on the first live-view image data before generating the first composite image data A program characterized by causing to execute.