JP2019124715A - Control device, imaging device, control method, and program - Google Patents

Abstract

To provide a control device capable of photographing a plurality of subjects at correct exposure.SOLUTION: A control device (101) includes: a luminance calculation unit (101a) for calculating first luminance of a first subject (main subject) and second luminance of a second subject (sub-subject) on the basis of each of multiple pieces of image data obtained by taking images in different illumination directions; and a control unit (101b) for controlling the illumination direction at the time of actual photographing on the basis of difference between the first luminance and the second luminance.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image pickup apparatus for photographing a plurality of subjects with proper exposure.

  In Patent Document 1, the flash emission amount for main shooting is obtained based on the difference between the subject brightness when light emission is not performed and the subject brightness when light emission is performed in order to obtain the light emission amount for flash shooting. Methods are disclosed. Patent Document 2 discloses a method of performing light control while driving a strobe light emitting unit, and determining a light emission angle of bounce light emission photographing in which diffuse light obtained by emitting light toward a ceiling or the like is emitted to an object. There is.

Patent No. 3461220 JP, 2011-69920, A

  However, according to the method disclosed in Patent Document 1, when there are a plurality of subjects, one of the subjects can be photographed with the correct exposure, but the other subject is underexposed (or the reverse) without the strobe light reaching. )Become. Patent Document 2 does not consider the case where a plurality of subjects are present.

  Therefore, the present invention has an object to provide a control device, an imaging device, a control method, and a program capable of photographing a plurality of subjects with proper exposure.

  The control device according to one aspect of the present invention is configured such that the first brightness of the first subject and the second brightness of the second subject are obtained based on each of a plurality of image data obtained by imaging in different illumination directions. And a control unit which controls the illumination direction at the time of main photographing based on the difference between the first brightness and the second brightness.

  An imaging apparatus according to another aspect of the present invention includes an imaging device that photoelectrically converts an optical image formed through an imaging optical system, and the control device.

  A control method according to another aspect of the present invention is a control method according to another aspect of the present invention, in which a first luminance of a first object and a second luminance of a second object are obtained based on each of a plurality of image data obtained by imaging in different illumination directions. The method further comprises the steps of calculating the luminance and controlling the illumination direction at the time of main photographing based on a difference between the first luminance and the second luminance.

A program as another aspect of the present invention causes a computer to execute the control method. Other objects and features of the present invention will be described in the following embodiments.

  According to the present invention, it is possible to provide a control device, an imaging device, a control method, and a program capable of photographing a plurality of subjects with proper exposure.

It is a block diagram of an imaging device in this embodiment. It is a flowchart of the light control photography in this embodiment. It is a flowchart of the bracket light control in this embodiment. It is explanatory drawing of the area block for calculating the brightness | luminance of the main to-be-photographed object in this embodiment, and a to-be-photographed object. FIG. 2 is an overhead view of a main subject and a sub-subject in the present embodiment. It is explanatory drawing of calculation of the last light emission angle of the angle bracket in this embodiment. It is an explanatory view of angle bracket light control in this embodiment. It is explanatory drawing of the main to-be-photographed object of the scene which needs light distribution bracket light control in this embodiment, and a to-be-photographed object. It is explanatory drawing of the light distribution bracket light control in this embodiment. It is a table showing the bracket angle and the luminance of the main subject and the sub-subject in the present embodiment. It is a graph of the table | surface shown by FIG.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  First, with reference to FIG. 1, the configuration of an imaging device in the present embodiment will be described. FIG. 1 is a block diagram of an imaging device 10. The imaging device 10 is a camera system including a camera body (imaging device body) 100, and a lens unit (lens device) 200 and a strobe (illumination device) 300 which are detachable from the camera body 100. Hereinafter, the configuration of the imaging device 10 in a state in which the lens unit 200 and the electronic flash 300 are attached to the camera body 100 will be described with reference to FIG.

  The camera system control unit 101 is a control unit that controls each part of the camera body 100 in an integrated manner. The memory 102 is a memory such as a RAM or a ROM connected to the camera system control unit 101. The image sensor 103 is a charge storage type image sensor such as a CMOS sensor, and photoelectrically converts an optical image (object image) formed through the lens unit 200 to output analog image data. Driving of the shutter 104 is controlled based on a signal from the camera system control unit 101. The shutter 104 is in a light blocking state in which the image sensor 103 is shielded from light flux incident through the lens unit 200, and in a retracted state in which an object image (optical image) incident through the lens unit 200 is guided to the image sensor 103. To work. The A / D conversion unit 105 is a conversion unit that converts analog image data output from the imaging element 103 into digital image data. The digital image data converted by the A / D converter 105 is recorded in the memory 102.

  The image processing unit 106 performs predetermined image interpolation, resizing processing such as reduction, color conversion processing, and saturated pixels and black squashed pixels on data from the A / D converter 105 or data from the memory control unit 107. Calculation processing of the number of incorrect pixel data such as. The D / A conversion unit 108 is conversion means for converting digital image data recorded in the memory 102 into analog image data for display. The display unit 109 is a display unit configured by a TFT type LCD (Thin Film Transistor Drive Type Liquid Crystal Display) or the like, and can display analog image data for display. The display unit 109 can also perform live view display by sequentially displaying analog image data output from the D / A conversion unit 108. The display unit 109 can also display various information other than the acquired image data.

  The timing generator (TG) 110 is timing generation means for transmitting timings related to the operation of the camera body 100, such as the exposure timing of the image sensor 103, the change of the frame rate, the timing of shielding by the shutter 104, etc. . The release button 111 and the operation unit 112 are operation means for inputting various operation instructions to the camera system control unit 101. The release button 111 is an instruction unit for instructing the start of the imaging preparation operation and the imaging operation. When the user instructs the start of the imaging preparation operation by changing the release button to the SW1 state (for example, half-pressing), the camera system control unit 101 starts ranging arithmetic processing, photometric arithmetic processing, and the like. In addition, when the user instructs the start of the imaging operation by changing the release button to the SW2 state (for example, full press), the camera system control unit 101 takes a series of steps from imaging the subject image to acquiring an image. Start processing of The operation unit 112 is an input device group including an operation member such as a switch, a button, a dial, and the like for the user to perform various instructions and settings on the camera body 100. For example, a power switch, a menu button, a live view display start button, a direction instruction button, and the like are included. Note that the display unit 109 is a capacitive touch panel, and by operating the UI displayed on the display unit 109, it is possible to input the same information as when operating the operation unit 112. It is also good.

  The distance measurement unit 113 performs distance measurement calculation using the image data obtained from the image processing unit 106, and outputs the distance measurement result to the camera system control unit 101. The photometry unit 114 performs photometry calculation using the image data obtained from the image processing unit 106, and outputs the photometry result to the camera system control unit 101. When the flash unit 300 is attached, the photometry unit 114 synchronizes the timing with the TG 110, and the photometric value (brightness) of the image data when the flash is fired and the photometric value (brightness) of the image data when the flash is not fired And can be determined respectively. The subject detection unit 115 detects a subject using the image data obtained from the image processing unit 106. For example, in the case of face detection, the subject detection unit 115 detects the size of the face of the subject, the position of the subject on the screen, and the like as an output result. When the subject detection unit 115 detects the subject position on the image data, the photometry unit 114 can obtain the luminance of the subject as a photometric value.

  The strobe drive calculation unit 116 calculates the angle bracket light emission of the head operated by the head drive unit 304 of the strobe 300 and the light distribution angle operated by the light distribution drive unit 305. The distance measuring unit 113, the photometry unit 114, the subject detection unit 115, and the strobe drive calculation unit 116 described above may be configured integrally with the camera system control unit 101. In this case, the camera system control unit 101 executes the distance measurement process, the photometric process, the subject detection process, and the strobe drive arithmetic process described above.

  The lens system control unit 201 is a control unit that generally controls the operation of the lens unit 200. In the state where the lens unit 200 is attached to the camera body 100, the lens system control unit 201 and the camera system control unit 101 can communicate via an interface (not shown). For example, in accordance with an instruction from the camera system control unit 101, information on the lens unit 200 attached to the camera body 100 is output to the camera system control unit 101. The imaging lens group 202 includes a shift lens (anti-vibration lens) movable in a direction perpendicular to the optical axis OA, and a plurality of lenses including a zoom lens and a focus lens movable in a direction along the optical axis OA. It is a group (imaging optical system). The diaphragm 203 is a light amount adjusting member for adjusting the light amount of the light beam passing through the photographing lens group 202, and the driving thereof is controlled by the lens system control unit 201. When the lens system control unit 201 is not provided in the lens unit 200, the operations of the photographing lens group 202 and the diaphragm 203 are controlled based on an instruction from the camera system control unit 101.

  The electronic flash 300 has a main body portion 306 connected to the camera body 100 and a head portion 307 provided with a light emitting portion 303. A strobe system control unit 301 is a control unit that controls the operation of the strobe 300 in an integrated manner. In the state where the flash 300 is attached to the camera body 100, the flash system control unit 301 and the camera system control unit 101 can communicate via an interface (not shown).

  The operation unit 302 is various operation members as an input unit that receives an operation from a user. The operation unit 302 can perform various settings related to flash photography, such as light emission mode setting, light distribution angle, and light control mode setting. The light emitting unit 303 performs light emission control in accordance with a light emission instruction from the strobe system control unit 301. The head drive unit 304 can drive the head unit 307 in the horizontal direction and the vertical direction with respect to the main body unit 306 according to an instruction from the flash system control unit 301. Further, the head drive unit 304 obtains the drive amount and outputs the drive amount to the flash system control unit 301 as a relative position with respect to the main unit 306. By driving the head portion 307, the light emitting portion 303 can be oriented in any direction with respect to the subject. The light distribution drive unit 305 can adjust the light distribution at the time of flash light emission by causing the light emitting unit 303 to perform a zoom operation at the head unit 307.

  In the present embodiment, the camera system control unit (control device) 101 includes a luminance calculation unit 101a and a control unit 101b. The brightness calculation unit 101a uses the light measurement unit 114 to set the brightness (first brightness) of the main subject (first subject) based on each of a plurality of image data obtained by imaging in different illumination directions. The luminance (second luminance) of the sub-subject (second object) is calculated. The control unit 101b controls the illumination direction (illumination angle of the light emitting unit 303) at the time of main shooting based on the difference between the first brightness and the second brightness. Preferably, the control unit 101 b changes the illumination direction by changing the angle (illumination angle) of the light emitting unit 303 of the strobe (illumination device) 300. The details of these will be described later.

  Hereinafter, a method of obtaining the illumination angle of the strobe 300 at the time of main photographing from angle bracket light emission will be described by way of an example in which two subjects (faces) exist. First, with reference to FIG. 2, light control shooting (strobe shooting) according to the present embodiment will be described. FIG. 2 is a flowchart of light control shooting. Each step in FIG. 2 is mainly executed by an instruction of the camera system control unit 101.

  First, in step S 201, the camera system control unit 101 performs subject detection (face detection) using the subject detection unit 115 based on image data obtained by imaging by the imaging device 103. When the subject detection unit 115 detects a plurality of subjects (faces), the camera system control unit 101 can hold detection information of all the faces. Subsequently, in step S202, the camera system control unit 101 determines whether the release button (SW1) for starting the photographing operation is on (whether the shutter button is half-pressed). If the release button (SW1) is not on, step S201 is repeated. On the other hand, if the release button (SW1) is on, the process proceeds to step S203.

  In step S203, the camera system control unit 101 starts distance measurement (acquisition of distance information, focus detection) using the distance measurement unit 113. When a plurality of faces are detected in step S201, the distance measuring unit 113 starts distance measurement for a face with high priority, but distance information can be acquired for objects within the angle of view. . When the distance measurement is completed and the main subject (first subject) is focused, the process proceeds to step S204. In step S204, the camera system control unit 101 performs frontal light adjustment of the strobe 300. Subsequently, in step S205, the camera system control unit 101 determines whether a plurality of subjects (faces) detected in step S201 exist. If there is not a plurality of faces, the process proceeds to step S212. On the other hand, if there are multiple faces, the process proceeds to step S206.

  In step S206, the camera system control unit 101 determines whether or not angle bracket light adjustment is to be performed as the flash light adjustment mode. If angle bracket dimming is not to be performed, the process proceeds to step S212. On the other hand, when angle bracket light control is performed, the process proceeds to step S207. In step S207, the camera system control unit 101 (brightness calculation unit 101a) uses the photometry unit 114 to calculate the brightness of each of a plurality of subjects (faces) based on the image data and the face detection result.

  FIG. 4 is an explanatory diagram of an area block for calculating the luminance of a plurality of subjects (main subjects and sub subjects). Here, as shown in FIG. 4A, a case where two faces of a main subject (first subject) and a sub-subject (second subject) are detected will be described as an example. The camera system control unit 101 divides the image data into a plurality of areas as shown in FIG. 4 (b). Further, the camera system control unit 101 obtains luminance (first luminance) using the blocks B21, B22, B23, and B24 for the main subject (first subject), and blocks for the sub-subject (second subject). The luminance (second luminance) is determined using B11. Then, the camera system control unit 101 calculates the difference between the luminance of the main subject and the luminance of the sub-subject.

  Subsequently, in step S208, the camera system control unit 101 determines whether the difference between the luminance of the main subject and the luminance of the sub-subject is equal to or less than a predetermined value. If the difference is equal to or less than the predetermined value, the camera system control unit 101 considers that both the main subject and the sub-subject are equally illuminated by the front strobe light, and the process proceeds to step S212. On the other hand, when the difference is larger than the predetermined value, the camera system control unit 101 performs strobe bracket light control.

  Here, the strobe bracket light control (step S209) will be described in detail with reference to FIG. FIG. 3 is a flowchart of bracket light control. Each step in FIG. 3 is mainly executed based on a command from the camera system control unit 101.

  First, in step S301, the camera system control unit 101 determines whether or not front light emission has been performed on the subject with low luminance calculated in step S207. If it is determined that the previous light adjustment is not front emission to a subject with low luminance, the process advances to step S302, and the camera system control unit 101 performs angle bracket light adjustment. On the other hand, if the previous light adjustment is front emission to a subject with low luminance, the process proceeds to step S306, and the camera system control unit 101 performs light distribution bracket light adjustment.

  When angle bracket light adjustment is performed, first, in step S303, the camera system control unit 101 determines the horizontal drive direction of angle bracket light adjustment. FIG. 5 is an overhead view of the main subject and the sub-subject (composition of FIG. 4A). When viewed from the camera body 100, the sub-subject is located behind the main subject. Therefore, when the luminance of the sub-subject is low as a result of the front light emission, the camera system control unit 101 determines the horizontal drive direction so as to horizontally drive the strobe 300 (head unit 307) in the left direction where the sub-subject exists. .

  Subsequently, in step S304, the camera system control unit 101 determines a bracket angle. The bracket angle is determined based on the strobe drive angle when front-lighting toward a low luminance sub-subject. Here, how to obtain the strobe drive angle will be described with reference to FIG. FIG. 6 is an explanatory diagram of calculation of the final light emission angle (final illumination angle) of the angle bracket. FIG. 6 shows the image data actually captured, and the horizontal length from the center to the edge of the image is “SensorH”, and the horizontal length from the center of the image to the center of the sub-subject's face is shown Let "Face H". Assuming that the angle of view of the lens unit 200 mounted on the camera body 100 is “Lens Θ”, the strobe drive angle “StroboDriveEnd Θ” that emits light frontward to the sub-subject is represented by the following Expression (1).

StroboDriveΘ = LensΘ / 2 × FaceH / SensorH ... (1)
For example, assuming that the angle of view of the lens unit 200 mounted on the camera body 100 is 60 ° and the FaceH / SensorH is 2/3, the strobe drive angle for front emission to the sub-subject is 20 °. . Since the flash emission angle at which the brightness of the sub-subject is highest is the case where the sub-subject emits light frontally, the final emission angle of the bracket light control can be set to “StroboDriveEndΘ”.

  Subsequently, in step S305 in FIG. 3, the camera system control unit 101 determines the number of times of the bracket (the number of times of illumination) obtained from the bracket angle up to the final light emission angle. Then, the camera system control unit 101 drives the light emitting unit 303 of the strobe 300 in the horizontal drive direction by the bracket angle determined in step S304. FIG. 7 is an explanatory view of angle bracket light control, and shows an example in which the light emission angle up to the final light emission angle is divided by 10 degrees to perform light control. 7 (a) shows the first frontal light emission, FIG. 7 (b) shows the light emission driven 10 ° in the left direction with the sub-subject present, and FIG. 7 (c) shows the light emission driven 20 ° in the left direction with the sub-subject present Light emission (final light emission) is shown. Here, the bracket angle is set to 10 °, and the number of brackets is set to two.

  As described above, in the present embodiment, the camera system control unit 101 (control unit 101b) causes the light emitting unit 303 to emit light at the first angle (front pre-emission) before the main shooting, based on the image data captured. The number of illuminations and the illumination angle range of the light emitting unit 303 are determined. For example, the camera system control unit 101 determines an angle of the light emitting unit 303 in a direction toward a low luminance subject (here, the sub subject) among the main subject and the sub subject obtained by causing the light emitting part 303 to emit light at the first angle. Change Then, the camera system control unit 101 sets a range from the first angle to the second angle (the angle shown in FIG. 7C) facing the sub-subject as the illumination angle range of the light emitting unit 303.

  Subsequently, in step S309 in FIG. 3, the camera system control unit 101 performs light control at the position of the light emitting unit 303 after driving. The subsequent steps S310 and S311 are the same as the steps S207 and S208, respectively, and the description thereof will be omitted. If it is determined in step S311 that the difference in luminance is equal to or less than the predetermined value, the camera system control unit 101 ends the bracket light adjustment. On the other hand, when the difference in luminance is larger than the predetermined value, the process proceeds to step S312.

  In step S312, the camera system control unit 101 determines whether the difference in luminance in the current light adjustment is larger than the difference in luminance in the previous light adjustment. If the difference in luminance at this time is larger than the difference in luminance at the previous time, the camera system control unit 101 ends the bracket light adjustment. On the other hand, when the difference of the present brightness is equal to or less than the difference of the previous brightness, the process proceeds to step S313.

  In step S313, the camera system control unit 101 determines whether or not bracket light adjustment of a predetermined number of times (predetermined number of times of illumination) has ended. If angle bracket light adjustment has not been completed a predetermined number of times, the process returns to step S301, and the camera system control unit 101 performs angle bracket light adjustment again. If the predetermined number of angle bracket dimming operations is completed, the process proceeds to step S314. In step S314, the camera system control unit 101 determines whether light distribution bracket light adjustment has ended. If the difference in luminance is not smaller than the predetermined value in angle bracket light adjustment (if light distribution bracket light adjustment has not ended), the process returns to step S301 to perform light distribution bracket light adjustment. Then, in step S306, the camera system control unit 101 performs light distribution bracket light control.

  When light distribution bracket light adjustment is performed, first, in step S307, the camera system control unit 101 determines the light distribution angle of the strobe 300. FIG. 8 is an explanatory view of a main subject and a sub-subject in a scene requiring light distribution bracket light control. In FIG. 8, the sub-subject whose luminance is lower than that of the main subject is located on the optical axis OA of the imaging device 10 and behind the main subject. FIGS. 9A to 9C illustrate an example in which front emission is performed while changing the light distribution angle toward a sub-subject with low luminance, and the emission reach distance is extended. FIG. 9 (a) shows the first frontal light emission, FIG. 9 (b) shows the frontal light emission at 45 ° after narrowing the light distribution by 15 °, and FIG. 9 (c) shows the front light emission at further narrow 15 °. Here, the light distribution bracket angle is set to 15 °, and the number of bracketing times is set to two.

  Subsequently, in step S308 of FIG. 3, the camera system control unit 101 uses the light distribution drive unit 305 to emit light so as to change the light distribution of the strobe 300 according to the light distribution determined in step S307. The unit 303 is driven. As described above, the camera system control unit 101 causes the luminance (first luminance) of the main subject and the luminance of the sub-subject (second light) obtained by causing the light emitting unit 303 to emit light at the second angle (angle facing the sub-subject). The light distribution angle of the strobe 300 is controlled when the difference between the Then, the camera system control unit 101 calculates the first luminance and the second luminance based on a plurality of image data obtained at different light distribution angles.

  With regard to the subsequent processing, as described above, bracket light adjustment is ended if the conditions of steps S311 to S314 are satisfied. The flashlight conditions of the angle bracket light control and the light distribution bracket light control used in the flowchart of FIG. 3 and the luminance of each object are stored in storage means such as the memory 102 or the internal memory of the camera system control unit 101. The above is the strobe bracket light control of step S209 in FIG.

  Subsequently, in step S210 in FIG. 2, the camera system control unit 101 determines the optimum light emission condition (main shooting) based on the result of the strobe bracket light control (angle bracket light control and light distribution bracket light control) in step S209. Determine the lighting direction or lighting angle) of In the present embodiment, the camera system control unit 101 controls the brightness of the main subject (first brightness) and the brightness of the sub-subject (second brightness) based on the light emission condition used in flash bracket light adjustment and the result of the subject brightness. The light emission condition in which the difference with the luminance of the light source is small is set as the optimum light emission condition. Preferably, the camera system control unit 101 sets a light emission condition (illumination direction or illumination angle) that minimizes the difference between the luminance of the main subject and the luminance of the sub-subject obtained based on the image data as the optimum light emission condition. Preferably, the camera system control unit 101 performs an approximation operation based on the light emission condition and the change in luminance of each subject (face), and the light emission condition under which the difference obtained by the approximation operation becomes the optimum light emission condition Ask as.

  For example, consider the case where the result of bracket dimming is as shown in FIG. FIG. 10 is a table showing the bracket angle and the luminance of the main subject and the sub-subject. In the case where the light emission condition in which the difference between the main subject and the sub-subject luminance obtained based on the image data is the minimum is the optimum light emission condition, as shown in FIG. When driven at 10 ° ((2) in FIG. 10), this is used for the main photographing as the optimum light emission condition. On the other hand, the case where the light emission condition in which the difference is minimized by the approximation operation is determined as the optimum light emission condition will be described with reference to FIG. FIG. 11 is a graph of the table shown in FIG. As shown in FIG. 11, when the intersection of straight lines plotting changes in the luminance of the main subject and the sub-subject is determined, the optimal light emission condition that minimizes the difference in luminance is light emission with respect to the optical axis OA of the imaging device 10 The result is that the portion 303 is driven at 12 °.

  After determining the light emission angle (optimum light emission angle) of the flash device 300, the camera system control unit 101 proceeds to step S211 in FIG. 2 and drives the light emission unit 303 of the flash device 300 to achieve the determined light emission angle. Thereafter, the process proceeds to step S212, and the camera system control unit 101 determines whether the release button (SW2) is turned on (whether the release button is fully pressed). If the release button (SW2) is not turned on, step S212 is repeated. On the other hand, if the release button (SW2) is turned on, the process proceeds to step S213. In step S213, the camera system control unit 101 performs final light adjustment. Subsequently, in step S214, the camera system control unit 101 performs strobe light emission via the strobe system control unit 301. Subsequently, in step S215, the camera system control unit 101 performs shooting.

  According to the present embodiment, even when there are a plurality of subjects having different distances with respect to the imaging device, the light emission angle and the light distribution of the strobe are changed to perform light adjustment, and the plurality of subjects can be exposed properly. It can be taken.

  Note that the bracket angle may be set in advance for the division of the bracket angle performed in step S304 in FIG. 3, and the light control may be continued until the final light emission angle is reached. Alternatively, the number of times of bracket light adjustment may be determined in advance, and it may be determined how many times light adjustment is performed until the final light emission angle. Whether or not to calculate the final light emission condition to be used for the main photographing may be determined in advance, or may be configured to be selectable according to the number of times of light emission of light control.

(Other embodiments)
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. Can also be realized. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

  According to the present embodiment, it is possible to provide a control device, an imaging device, a control method, and a program capable of photographing a plurality of subjects with proper exposure.

  As mentioned above, although the preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

101 Camera system control unit (control device)
101a luminance calculation unit 101b control unit

Claims (14)

A luminance calculation unit that calculates a first luminance of a first subject and a second luminance of a second subject based on each of a plurality of image data obtained by imaging in different illumination directions;
A control unit configured to control the illumination direction at the time of main shooting based on a difference between the first brightness and the second brightness. The control unit performs the main photographing in the illumination direction in which the difference between the first brightness and the second brightness calculated based on each of the plurality of image data is the smallest. The control device according to claim 1, wherein The control unit
An approximation operation is performed using the first luminance and the second luminance calculated based on each of the plurality of image data,
The control device according to claim 1, wherein the main photographing is performed in the illumination direction in which the difference obtained by the approximation operation is minimized. It further has a subject detection unit,
The control device according to any one of claims 1 to 3, wherein the subject detection unit detects the first subject and the second subject based on a face detection result. Distance measuring unit,
And a subject detection unit,
The control according to any one of claims 1 to 4, wherein the subject detection unit detects the first subject and the second subject based on the distance measurement result by the distance measurement unit. apparatus. The control device according to any one of claims 1 to 5, wherein the control unit changes the illumination direction by changing an angle of a light emitting unit of a lighting device. The control unit is configured to calculate the first brightness and the second brightness based on image data captured by causing the light emitting unit to emit light at a first angle before the main shooting. The control apparatus according to claim 6, wherein the number of illuminations and the illumination angle range of the light emitting unit for obtaining the image data of are determined. The control unit
Changing an angle of the light emitting unit in a direction toward a subject with low luminance among the first subject and the second subject obtained by causing the light emitting unit to emit light at the first angle;
The control device according to claim 7, wherein a range from the first angle to a second angle facing the subject with low luminance is set as the illumination angle range of the light emitting unit. The control unit is configured to cause a difference between the first brightness of the first subject and the second brightness of the second subject obtained by causing the light emitting unit to emit light at the second angle. 9. The control device according to claim 8, wherein, in the case of the above, the light distribution angle of the illumination device at the time of the main photographing is controlled. The luminance calculation unit is configured to calculate the first luminance of the first subject and the second luminance of the second subject based on each of a plurality of image data obtained by imaging at different light distribution angles. To calculate
The control device according to claim 9, wherein the control unit performs the main photographing at the light distribution angle at which a difference between the first brightness and the second brightness is minimum. The luminance calculation unit is configured to calculate the first luminance of the first subject and the second luminance of the second subject based on each of a plurality of image data obtained by imaging at different light distribution angles. To calculate
The control unit
An approximation operation is performed using the first luminance and the second luminance,
10. The control apparatus according to claim 9, wherein the main photographing is performed at the light distribution angle at which the difference obtained by the approximation operation is minimized. An imaging element that photoelectrically converts an optical image formed through an imaging optical system;
An image pickup apparatus comprising: the control device according to any one of claims 1 to 11. Calculating a first brightness of the first subject and a second brightness of the second subject based on each of a plurality of image data obtained by imaging in different illumination directions;
Controlling the illumination direction at the time of main photographing based on the difference between the first luminance and the second luminance. A program causing a computer to execute the control method according to claim 13.