JP2019028378A - Imaging device and imaging device control method - Google Patents

Abstract

To provide an imaging device that determines a light metering area on the basis of brightness of an entire imaging screen or a depth of a main subject and a background, and can conduct main light emission with respect to the main subject with a proper amount of light.SOLUTION: An imaging device, which causes light emission means to conduct pre-light emission ahead of main light emission, has: luminance information acquisition means that acquires first luminance information obtained upon non-light emission of the light emission means, and second luminance information obtained upon pre-light emission of the light emission means; computation area determination means that determines a computation area of the main light emission; and main light emission-amount determination means that determines an amount of light emission of the main light emission from a light metering result obtained in the computation area of the main light emission. The computation area determination means is configured to calculate a weighted value based on luminance from the first luminance information; calculate a weighted value based on a depth of an entire screen from differential information between the first luminance information and the second luminance information; and calculate the computation area to be used in computation of determining the amount of light emission of the main light emission on the basis of the weighted value based on the luminance and the weighted value based on the depth.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image pickup apparatus that performs pre-light emission prior to main light emission, and a method for controlling the image pickup apparatus.

  2. Description of the Related Art Conventionally, in a digital still camera equipped with an electronic flash, it has been widely performed to obtain an appropriate exposure in main light emission by performing pre-light emission prior to main light emission during photographing.

  For example, a method is known in which the imaging screen is divided into a plurality of areas, pre-emission photometry is performed in each area, and emission control of main emission is performed based on the result. Such a method is particularly effective because it can determine the state of the entire screen and perform appropriate light emission control.

  A situation where appropriate light emission control is necessary is, for example, the presence or absence of the depth of the main subject and the background. When there is no depth, an appropriate amount of reflected light can be obtained from the entire imaging screen, so using the entire imaging screen as a photometric area makes it easier to obtain appropriate exposure, while when there is depth, photometry is performed only from the main subject. It is easier to get proper exposure. In other words, depending on the depth of the main subject and the background, it is necessary to appropriately determine whether only the main subject is used as the photometric area or whether the entire imaging screen including the background is used as the photometric area.

  As a technique for performing control according to the situation by measuring the pre-emission in this way, Patent Document 1 is cited. In Patent Document 1, the degree of variation in the difference in luminance information between pre-emission light emission and non-light emission is obtained. When the degree of variation is small, the entire imaging screen is used as the calculation region, and when the degree of variation is large, the imaging screen An invention is disclosed in which a photometry calculation area for main light emission calculation is changed depending on the degree of variation, such that a part is set as a calculation area.

JP 2005-121834 A

  However, the invention described in Patent Document 1 has the following problems.

  First, when almost no difference information can be acquired, there is a problem that it is difficult to determine whether there is depth. For example, when shooting in an environment with strong steady light such as outdoors on a sunny day, the amount of pre-emission is relatively small with respect to the amount of steady light, and almost no reflection can be acquired. Therefore, the depth of the main subject and the background cannot be determined, and proper exposure cannot be obtained.

  In addition, there is a problem that the brightness of the entire imaging screen cannot be determined only by the difference information. The invention described in Patent Document 1 can determine the depth of the main subject and the background by acquiring difference information, but does not evaluate the brightness of the entire imaging screen. For example, consider a case where the background and the main subject are not separated and there is a large difference in brightness between the background and the main subject. In this case, since the variation of the difference hardly occurs in the entire imaging screen, the entire imaging screen is determined as the photometric area from the degree of variation of the difference in Patent Document 1. However, if the ratio of the background to the imaging screen is large at this time, the exposure determination is pulled by the brightness of the background, and an appropriate exposure cannot be obtained for the main subject.

  From the above problems, the present invention uses the luminance information in the steady light in addition to the difference information when calculating the photometric area, thereby determining the photometric area based on the brightness of the entire imaging screen and the depth of the main subject and the background. An object of the present invention is to provide an imaging apparatus capable of performing main light emission with an appropriate amount of light.

  The invention described in claim 1 is an imaging apparatus that includes an imaging device and a light emitting unit, and causes the light emitting unit to emit pre-light prior to the main light emission, and the light emitting unit is imaged by the imaging device when not emitting light. Luminance information acquisition means for acquiring the first luminance information obtained in this manner and the second luminance information obtained by imaging the light emitting means with the imaging device during pre-emission, and determining the amount of light emission of main light emission A calculation area determining means for determining a calculation area to be used for calculation, and a main light emission amount determination for determining the light emission quantity of the main light emission from a photometry result obtained in the calculation area used for the calculation of determining the light emission quantity of the main light emission. Means for calculating a weighting value based on luminance from the first luminance information, and from difference information that is a difference between the first luminance information and the second luminance information. Based on the depth of the entire screen Calculating a weighting value, which is an imaging apparatus characterized by calculating a calculation area used in the calculation to determine the amount of light emission of the main emission on the basis of the weighting value based on the weighting values and the depth based on the brightness.

  According to a second aspect of the present invention, the calculation area determining means calculates a weighting value for high luminance, a weighting value for low luminance, and a mixing ratio of weighting for luminance from the first luminance information, and the luminance is calculated. 2. The imaging apparatus according to claim 1, wherein a result of mixing the high-luminance weighting value and the low-luminance weighting value based on the weighting mixing ratio is used as the weighting value based on the luminance. is there.

  According to a third aspect of the present invention, there is provided a weighting value with a depth that is set such that the larger the difference amount, the larger the difference amount, and the smaller the difference amount, the smaller the weighting value. The weighting value without depth set to be uniform and the depth amount are calculated from the difference information. The larger the depth amount, the larger the ratio of using the weighting value with depth, and the smaller the depth amount. 3. The imaging apparatus according to claim 1, wherein a result of mixing so that a ratio of using the weight value without depth becomes larger is set as a weight value based on the depth. 4. is there.

  According to a fourth aspect of the present invention, the calculation region used for the calculation for determining the light emission amount of the main light emission includes a weighting value based on the luminance and a weighting value of the calculation region related to photometry calculated from the weighting value based on the depth. The imaging device according to claim 1, wherein the imaging device is a region that exceeds a predetermined value.

  The invention described in claim 5 is an image pickup apparatus control method comprising an imaging device and a light emitting means, wherein the light emitting means performs pre-light emission prior to the main light emission, and the light emitting means performs the imaging when not emitting light. Acquiring first luminance information obtained by imaging with an element, obtaining second luminance information obtained by imaging the light emitting means with the imaging element during pre-emission, and the first Calculating the difference information that is the difference between the luminance information of the first luminance information and the second luminance information, calculating the weighting value based on the luminance from the first luminance information, and calculating the depth of the entire screen from the difference information. A step of calculating a weighting value based on the luminance, and a step of calculating a calculation region used for a calculation for determining a light emission amount of the main light emission based on the weighting value based on the luminance and the weighting value based on the depth. That is a control method of the imaging apparatus.

  According to the present invention, the luminance information in the steady light is used in addition to the difference information when calculating the photometric area, thereby determining the photometric area based on the brightness of the entire imaging screen and the depth of the main subject and the background. In contrast, it is possible to provide an imaging apparatus capable of performing main light emission with an appropriate amount of light.

It is a block diagram which shows the main structures of a camera system. It is a schematic diagram which shows the division | segmentation of the photometry area | region of image data. It is a flowchart explaining an imaging process. It is a flowchart explaining this light emission amount determination. It is the schematic diagram which showed calculation of difference information. (1) It is a schematic diagram which shows the brightness | luminance in stationary light data. (2) It is a schematic diagram which shows the brightness | luminance in pre emission data. (3) It is a schematic diagram which shows difference information. (1) It is a schematic diagram showing weighting for high luminance. (2) It is a schematic diagram showing weighting for low luminance. It is a schematic diagram which shows weighting with a depth.

  The best mode for carrying out the present invention will be described below with reference to the accompanying drawings. In addition, this invention is not limited by this embodiment.

  FIG. 1 is a block diagram showing a main configuration of a camera system according to an embodiment of the present invention. As shown in FIG. 1, the camera system includes an imaging device 100, an optical device 200, and a light emitting device 300.

  The optical device 200 is replaceable with the imaging device 100, and includes a lens CPU (not shown). The photographing optical system 210 is composed of a plurality of lens groups (not shown) including a focus lens group and a zoom lens group. In this figure, only one lens is depicted for simplicity.

  The imaging device 100 is a main device for imaging, and includes an imaging element 110, a signal processing unit 120, an image display unit 130, a main control unit 140, a luminance information calculation unit 150, and a main light emission amount calculation unit 160. , A memory unit 170 and a release button 180.

  The image sensor 110 is composed of imaging pixels, receives the light beam collected by the imaging optical system 210, photoelectrically converts it, and outputs it as a signal value. A CMOS image sensor is used as the image sensor 110 of the present embodiment. In addition, the image sensor 110 according to the present embodiment includes a variable gain amplifier that amplifies a signal read from a pixel and an A / D converter that digitally converts an analog signal.

  The signal processing unit 120 performs normal signal processing on the signal output from each imaging pixel of the imaging element 110. Normal signal processing includes dark processing, linearization, and the like, but the description thereof is omitted because it is the same as known technology.

  The image display unit 130 displays image data processed by the image processing unit 120, image data read from a recording medium (not shown), and the like.

  The main control unit 140 performs comprehensive control of the entire imaging apparatus 100. In the present embodiment, a control signal is output to the light emission control unit 310 in particular.

  The luminance information calculation unit 150 calculates luminance information for all signals by performing a known calculation on individual signals of image data. The luminance information is used for calculation of the main light emission amount, and is also used for various processes such as photometry.

  The main light emission amount calculation unit 160 calculates the main light emission amount from the luminance information of the image data before and after the pre-light emission. The method for determining the photometric area will be described in detail later.

  The memory unit 170 is a member that functions as a buffer for various data. In the present embodiment, in particular, luminance information of image data and difference information calculated by the main light emission amount calculation unit 160 are recorded.

  The release button 180 is a kind of user interface. When the user operates the release button 180, the imaging apparatus 100 performs imaging.

  The light emitting device 300 is replaceable with the imaging device 100 and includes a light emission control unit 310 and a light emitting unit 320. The light emission control unit 310 receives a control signal from the main control unit 140 and controls the light emission unit 320, and the light emission unit 320 emits light under the control of the light emission control unit 310. Here, in the present embodiment, the light emitting device 300 is configured to be detachable, but may be provided integrally with the imaging device 100.

  In addition, the imaging apparatus 100 according to the present embodiment has a through image shooting mode. The through image shooting mode is a kind of still image shooting mode, and is a mode in which signals are continuously read from the image sensor 110 until still image shooting is performed and displayed on the image display unit 130 as image data. The through image shooting mode is a well-known technique and will not be described in detail.

  Next, a photometric method in the present embodiment will be described. FIG. 2 is a schematic diagram showing division of a photometric area of image data according to an embodiment of the present invention. In this embodiment, photometry is performed by dividing the image data into several areas as shown in FIG. The luminance information calculation unit 150 calculates the luminance information of each area by averaging the luminance information calculated from individual pixels for each divided area. By dividing the photometric area in this way, it is possible to reduce the time required for calculating the luminance information of the image data, which is advantageous in continuous luminance information calculation in through image shooting or the like. Here, the divided individual areas are referred to as divided photometry areas. Further, the number of divisions of the image data and the size of the divided photometric area may be appropriately selected according to the convenience of the practitioner.

  Next, general imaging processing of the camera system in the present embodiment will be described. FIG. 3 is a flowchart illustrating the imaging process according to the embodiment of the present invention.

  When a command for through image shooting mode is transmitted from the main control unit 140 in step S101, through image shooting is performed in step S102. In the through image shooting mode, the image sensor 110 is continuously driven, and the signal output from the image sensor 110 is subjected to signal processing by the signal processing unit 120 and displayed on the image display unit 130, and is also used as data relating to photometry. And so on.

  In step S103, it is determined whether the release button 180 has been operated in the through image shooting mode. If the release button 180 is operated, it is determined that the release is ON, and the process proceeds to step S104. If no operation is performed on the release button 180, the process returns to step S101.

  In step S104, the luminance information in the through image when the flash is not emitted when the release is turned on is calculated by the luminance information calculation unit 150 and stored in the memory unit 170 as the luminance information in the steady light. Further, a through image when the flash is not emitted when the release is turned on is referred to as steady light data.

  In step S105, the main control unit 140 instructs the light emitting unit 320 to perform pre-light emission at a predetermined intensity, and pre-light emission is performed. In the present embodiment, the light emission amount of the pre-light emission is a fixed value that does not depend on the conditions, but may be calculated based on the luminance information calculated in step S104.

  In step S106, the luminance information calculation unit 150 calculates the luminance in the through image at the time of pre-emission, and stores the luminance information in the memory unit 170 as luminance information in the pre-emission. A through image at the time of pre-emission is referred to as pre-emission data.

  In step S107, the main light emission amount calculation unit 160 calculates the main light emission amount from the luminance information in the steady light and the luminance information in the pre-light emission. The calculation of the main light emission amount will be described later in detail.

  In step S108, the main control unit 140 instructs the light emission control unit 310 to perform main light emission at the light emission amount calculated by the main light emission amount calculation unit 160, and the light emission control unit 310 controls the light emission unit 320 to control the main light emission. Light is emitted.

  In step S109, the main control unit 140 performs imaging, and the image data obtained by imaging is recorded in a memory card (not shown), and the flowchart ends in S110.

  The above is the general imaging process in the present embodiment. Next, the main light emission amount determination method performed in step S107 will be described. FIG. 4 is a flowchart for explaining the main light emission amount determination in one embodiment of the present invention. Further, the main light emission amount is determined by the main light emission amount calculation unit 160.

  When an instruction to start the actual light emission amount calculation is issued from the main control unit 140 in step S201, difference information is calculated in step S202.

  The difference information is calculated by calculating the difference between the luminance information in the steady light data acquired in step S104 and the luminance information in the pre-emission data acquired in step S106. FIG. 5 is a schematic diagram showing calculation of difference information. FIG. 5 (1) shows the luminance information in the steady light data, FIG. 5 (2) shows the luminance information in the pre-emission data, and FIG. 5 (3) shows the difference information. For these divided photometry areas, the difference information is obtained by calculating the amount of difference by associating the luminance information in the steady light data with the luminance information in the pre-emission data.

  In steps S203 to S206, a photometric area used for calculation for determining the light emission amount of the main light emission is calculated. In order to calculate an appropriate main light emission amount, it is necessary to determine an appropriate photometric area from the entire imaging screen. The photometric area is determined by weighting the divided photometric areas and calculating a weight value for each area. In step S203, a weighting value based on luminance is calculated from the steady light data, and in step S204, a weighting value based on depth is calculated from the difference information. In step S205, the weighted values related to photometry are calculated by adding up the weighted values. In step S206, the required areas and unnecessary areas are selected from the weighted values related to photometry, so that the photometric areas related to the main light emission are determined. It is determined. The above process will be described in order.

  In step S203, weighting based on luminance is performed. The weighting based on the luminance is a weighting for calculating the photometric area by evaluating the brightness of the steady light data that cannot be obtained only by the difference information when determining the light quantity of the main light emission.

  Here, how to obtain the photometric area in an environment where the steady light is relatively bright will be described. For example, when there is a difference in luminance between the background and the main subject in an environment where the background is relatively bright, such as outdoors, and the ratio of the background to the entire imaging screen is large, the entire image data has high luminance. In this case, if the photometry is performed from the entire imaging screen, the photometry result depends on the high luminance region. Therefore, if the light quantity of the main light emission is determined using the photometry result of the entire photometry area, the light quantity is sufficient for the high brightness area, but the light quantity is insufficient for the low brightness area. . Therefore, when the image data has a high luminance as a whole, an appropriate photometric area can be obtained by using a high-luminance weighting that is set so that the lower luminance area has higher weighting and the higher luminance area has lower weighting. Can be determined.

  FIG. 6A is a schematic diagram showing weighting for high luminance. The numbers described in the figure are the luminance values detected for each divided photometry area. In addition, the hatched area indicates a low weight area, and the other areas indicate high weight areas. As shown in the figure, in the high-luminance weighting, a low-luminance region is set to have a high weight, and a high-luminance region is set to have a low weight.

  In addition, the high-luminance weighting value in each divided photometry area is calculated by applying the high-luminance weighting formula stored in advance in the main light emission amount calculation unit 160 to the luminance information in the steady light.

  On the other hand, if there is a difference in brightness between the background and the main subject in an environment where the steady light is relatively dark, such as indoors, and the background occupies a large proportion of the entire imaging screen, the image data will be low overall. The photometric result depends on the low luminance region. Therefore, when the image data has a low luminance as a whole, an appropriate photometric area can be determined by using the low luminance weighting that is set such that the higher the luminance is, the higher the luminance is.

  FIG. 6B is a schematic diagram illustrating weighting for low luminance. As shown in the figure, in the low-luminance weighting, the low-luminance area is set to a low weight, and the high-luminance area is set to a high weight.

  In addition, the low-luminance weighting value in each divided photometry area is calculated by applying a low-luminance weighting formula stored in advance in the main light emission amount calculation unit 160 to the luminance information in the steady light.

  In the present embodiment, an appropriate photometry area based on luminance is determined by mixing weighting for high luminance and weighting for low luminance in accordance with the brightness of steady light. The mixing of the weights is performed by mixing the weight values in the respective divided photometry areas at a ratio corresponding to the brightness of the steady light.

  The brightness of the steady light is calculated from luminance information in the steady light. In the present embodiment, the brightness of steady light is calculated by averaging the luminance information of all photometric areas. Here, the brightness of the stationary light may be evaluated by a different method such as using the median value of the histogram.

  The calculated brightness of the steady light is normalized by a dynamic range that is the vertical width of the luminance, and is calculated as a weighting mixing ratio of 0 or more and 1 or less. The ratio of weighting related to luminance is such that the higher the steady-state light brightness, the higher the ratio of using the high-luminance weight value, and the lower the steady-state light brightness, the greater the ratio of using the low-luminance weight value. Is calculated as follows.

  Also, in a predetermined divided metering area, the weighting value based on luminance is LW, the weighting value for high luminance is LWH, the weighting value for low luminance is LWL, and the mixing ratio of weighting for luminance is LR. The value is represented by the following formula.

  As described above, the weighting value based on the luminance is calculated for all the divided photometric areas. Subsequently, in step S204, weighting based on depth is performed. The weighting based on the depth is a weighting calculated from the difference information, and is a weighting for calculating the photometric area by evaluating the depth of the entire imaging screen when determining the light amount of the main light emission.

  Appropriate exposure based on depth by using only the subject with a large amount of difference as the photometry area when there is depth, and using the entire imaging screen as the photometry area when there is no depth. Can be obtained. Therefore, weighting based on depth by mixing weighting with depth, which is set high for subjects with large difference amounts, and weighting without depth, where weighting is set uniformly over the entire imaging screen, according to the depth amount. Is calculated.

  By setting in this way, it is determined whether the subject is the background or the main subject, and as a result, it is possible to increase the weighting of the main subject.

  FIG. 7 is a schematic diagram showing weighting with depth. The numbers described in the figure are the difference amounts calculated for each divided photometry area. In addition, the hatched area indicates a low weight area, and the other areas indicate high weight areas. As shown in the figure, weighting with depth is set such that a region with a small difference amount has a low weighting, and a region with a large difference amount has a high weighting. On the other hand, weighting without depth is set to be equal to all divided photometry areas.

  The weighted value with depth is calculated by applying a weighting formula with depth stored in advance in the main light emission amount calculation unit to the difference information. On the other hand, the weighting value without depth is stored in advance in the main light emission amount calculation unit 160 and is called in step S204.

  Further, the depth amount is calculated from the difference information. In this embodiment, a difference obtained by subtracting the maximum value and the minimum value of the difference amount in the difference information is the depth amount. Here, the depth amount may be evaluated by a different method such as using the median value of the histogram of the difference information.

  The calculated depth amount is normalized by being divided by a constant, and is calculated as a value of 0 or more and 1 or less as a mixing ratio of weighting related to the depth. The mixing ratio of weighting related to depth is calculated such that the larger the depth, the larger the ratio of using the weighted value with depth, and the smaller the depth, the larger the ratio of using the weighting value without depth. Further, the constant related to the division is a value that is set in advance as a numerical value related to the determination of the depth and is stored in the main light emission amount calculation unit 160, and may be determined within a range required by the practitioner.

  In a predetermined divided metering area, if the weighting value based on depth is DW, the weighting value with depth is DWH, the weighting value without depth is DWL, and the weighting value related to depth is DR, the weighting value based on depth is as follows: It is expressed by a formula.

  As described above, the weighting values based on the depth are calculated for all the divided photometric areas. Subsequently, in step S205, a weighting relating to photometry for determining a photometric area relating to the main light emission is calculated. The weighting for photometry is calculated by integrating the weighting based on the luminance calculated in step S203 and the weighting based on the depth calculated in step S204. Here, when the weighting value for photometry is W, the weighting value for photometry is expressed by the following equation.

  In step S206, a photometric area related to the main light emission is determined. That is, a divided photometry area that is equal to or greater than a predetermined value in the weighting value related to photometry is determined as the photometry area related to the main light emission. Here, the predetermined value may be determined as necessary so that the photometric result desired by the practitioner can be acquired.

  In step S207, the main light emission amount is calculated based on the photometric area determined in step S206, and the flow chart ends in step S208.

  According to the above embodiment, it is possible to calculate a photometric area based on luminance in addition to depth. As a result, even when the difference information due to the pre-light emission cannot be obtained, it is possible to detect the main subject and perform the main light emission with an appropriate light amount.

  In addition, by calculating a photometry area based on luminance from weighting for high luminance and weighting for low luminance, it is possible to determine the brightness of the entire imaging screen that cannot be determined only by difference information. Therefore, even when there is no depth and the luminance difference between the background and the main subject is large, it is possible to emit light with an appropriate amount of light.

  In this embodiment, the luminance information is acquired in the through image shooting mode. However, any form may be used as long as it is possible to acquire luminance information related to photometry, such as providing a dedicated photometric sensor.

  As described above, according to the imaging apparatus 100 of the present invention, the brightness of the entire imaging screen and the depth of the main subject and the background are obtained by using the luminance information in the steady light in addition to the difference information when calculating the photometric area. Thus, it is possible to provide the imaging device 100 that can determine the photometric area based on the above and perform main light emission with an appropriate amount of light on the main subject.

100 imaging device 110 imaging device 120 signal processing unit 130 image display unit 140 main control unit 150 luminance information calculation unit 160 main light emission amount calculation unit 170 memory unit 180 release button 200 optical device 210 photographing optical system 300 light emitting device 310 light emission control unit 320 Light emitting part

Claims (5)

An image sensor and light emitting means;
An imaging apparatus that pre-emits the light emitting means prior to the main light emission,
Luminance for acquiring first luminance information obtained by imaging the light emitting means with the imaging element when the light emitting means is not emitting light and second luminance information obtained by imaging the light emitting means with the image pickup element during pre-light emission. Information acquisition means;
A calculation area determining means for determining a calculation area to be used for calculation for determining a light emission amount of the main light emission;
From the photometric result obtained in the calculation area used for the calculation for determining the light emission amount of the main light emission,
A main light emission amount determining means for determining the light emission amount of the main light emission,
The calculation area determining means calculates a weighting value based on luminance from the first luminance information,
Calculating a weighting value based on the depth of the entire screen from difference information which is a difference between the first luminance information and the second luminance information;
An image pickup apparatus that calculates a calculation region used for calculation for determining the light emission amount of the main light emission based on the weighting value based on the luminance and the weighting value based on the depth. The calculation area determining means calculates a high-luminance weighting value, a low-luminance weighting value, and a blending ratio of weighting relating to luminance from the first luminance information,
2. The weighting value based on the luminance is a result of mixing the weighting value for the high luminance and the weighting value for the low luminance based on the mixing ratio of the weighting related to the luminance. Imaging device. The calculation area determining means is such that the weighting is set so that the weighting increases as the difference amount increases and the weighting decreases as the difference amount decreases, and the depth set so that the weighting of the entire screen is uniform. Calculating the weighting value of none and the depth amount from the difference information,
Weighting based on the depth is a result of mixing such that the larger the depth amount, the larger the proportion of using the weighted value with depth, and the smaller the depth amount, the larger the proportion of using the weighting value without depth. The imaging device according to claim 1, wherein the imaging device is a value.   The calculation area used for the calculation for determining the light emission amount of the main light emission is an area where the weighting value based on the luminance and the weighting value of the calculation area related to the photometry calculated from the weighting value based on the depth exceed a predetermined value. The imaging apparatus according to claim 1, wherein the imaging apparatus is provided. An image sensor and light emitting means;
A control method of an imaging apparatus for causing the light emitting means to perform pre-light emission prior to main light emission,
Obtaining first luminance information obtained by imaging the light emitting means with the imaging element when not emitting light;
Obtaining second luminance information obtained by imaging the light emitting means with the imaging element during pre-emission;
Calculating difference information that is a difference between the first luminance information and the second luminance information;
Calculating a weighting value based on luminance from the first luminance information;
Calculating a weighting value based on the depth of the entire screen from the difference information;
And a calculation area used for calculation for determining a light emission amount of main light emission based on the weighting value based on the luminance and the weighting value based on the depth.

Images