JP2015219487A - Imaging device and control method of the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mechanism that allows an AF control to correctly focus on a main subject intended by a user.SOLUTION: An imaging device comprises: distance information acquisition means (S501) that acquires focus detection information on a phase difference detection method as distance information to a subject from an image pickup element 22 photoelectrically converting a subject image formed via a photographing optical system; face detection means (S504) that detects a face in a photograph screen on the basis of a photograph signal acquired from the image pickup element 22; face area acquisition means (S505) that acquires an area of the face from face detection information when the face is detected; determination means (S506) that determines whether the detected face is a face of a main subject or a face of other subject on the basis of the acquired area of the face and the focus detection information; and in-focus means (S507 and 508) that focuses on the main subject when the detected face is determined to be the face of the main subject, and focuses on a subject other than other subject when the detected face is a face of the other subject.

Description

  The present invention relates to an imaging apparatus such as a digital camera or a digital video camera having a focus adjustment function, and a control method thereof.

  Some imaging devices such as digital cameras perform autofocus (AF) control using an imaging element such as a CCD sensor or a CMOS sensor (Patent Document 1). AF control detects, for example, a person as a subject, obtains distance information to the detected subject, and sets the focal length and focal position of the imaging lens so that the subject falls within the depth of field based on the obtained distance information. Adjust the aperture. In addition, a technique is disclosed in which an imaging element that performs AF control using a contrast method is used to reduce the time required for AF even if a subject includes a face photograph (Patent Document 2).

Japanese Patent Laid-Open No. 06-303491 JP 2012-42833 A

  However, in Patent Documents 1 and 2, in AF control, for example, when a detected subject includes a “signboard printed with a person's face” and a “main subject such as a person”, the user matches the main subject. There is a problem of focusing on a signboard even though it is intended to be burnt.

  Accordingly, an object of the present invention is to provide a mechanism that can accurately focus on a main subject intended by a user in AF control.

  To achieve the above object, the imaging apparatus of the present invention acquires focus detection information of a phase difference detection method as distance information from an imaging element that photoelectrically converts a subject image formed through a photographing optical system to the subject. A distance information acquisition unit that detects a face in the imaging screen based on an imaging signal acquired from the imaging element, and a face detected from the face detection information when the face is detected by the face detection unit. Based on the face area acquired by the face area acquiring means and the focus detection information, the face detected by the face detecting means is the face of the main subject or other A determination means for determining whether the face is a subject; and when the detected face is determined to be the face of the main subject by the determination means, the main subject is focused, and the detected face is determined by the determination means. Other subjects If it is determined that the face, characterized in that it comprises a focusing means to focus on the subject with the exception of the other object, the.

  The imaging apparatus according to the present invention acquires focus detection information of a phase difference detection method as distance information from an imaging element that photoelectrically converts a subject image formed through a photographing optical system to a subject, and a peripheral region of the subject Distance information acquisition means for acquiring distance information up to, a face detection means for detecting a face in an imaging screen based on an imaging signal acquired from the imaging element, and a peripheral region of the face detected by the face detection means If the difference between the average value of the distance information and the focus detection information exceeds a threshold value, it is determined that the detected face is the face of the main subject, and the difference between the average value and the focus detection information is A determination unit that determines that the detected face is the face of another subject when the threshold is equal to or less than the threshold; and the main subject when the detected unit determines that the detected face is the face of the main subject Focus on Combined, wherein when said detected face the judgment means judges that the face of the other object, characterized in that it comprises a focusing means to focus on the subject with the exception of the other object, the.

  An imaging apparatus according to the present invention includes distance information acquisition means for acquiring focus detection information of a phase difference detection method as distance information from an imaging element that photoelectrically converts a subject image formed through a photographing optical system to a subject, Based on the imaging signal acquired from the imaging device, when two faces are detected by the face detection means for detecting the face in the imaging screen and the face detection means, the distance information of the detected two faces Assuming that the distance information on the near side is D1 and the distance information on the far side is D2, when D1 / D2 is equal to or smaller than the threshold and a zoom operation is performed, the face on the far side where the distance information is the face of the main subject When D1 / D2 is equal to or smaller than the threshold value and the zoom operation is not performed, and when D1 / D2 exceeds the threshold value, the face with the closest distance information is the face of the main subject. Judge to judge When, characterized in that it and a focusing means focusing against determined face as the main subject by the determining means.

  According to the present invention, it is possible to accurately focus on a main subject intended by a user in AF control.

It is the perspective view which looked at the digital camera which is an example of the embodiment of the imaging device of the present invention from the back side. It is a block diagram which shows the structural example of the electric system of the digital camera shown in FIG. It is a figure which shows roughly the structure of 1 pixel of an image pick-up element. It is sectional drawing which shows notionally the mode that the light beam emitted from the exit pupil of an imaging lens injects into an image pick-up element. It is a flowchart figure which shows an example of AF control of a digital camera. (A) is a diagram in the case where the subject of the captured image acquired from the image sensor is actually a person, and (b) is a “face” in which the subject of the captured image acquired from the image sensor is printed on a signboard or the like. FIG. It is a figure which shows the positional relationship of a camera and a to-be-photographed object. FIG. 6 is a graph showing the relationship between the distance to the subject acquired in step S502 of FIG. 5 and the area of the “face” estimated from the distance as a conversion table. FIG. 9 is a graph showing a case where the conversion table shown in FIG. 8 is applied to the subject shown in FIGS. 6 and 7. It is a figure which shows other embodiment of this invention. It is a figure which shows other embodiment of this invention. It is a figure which shows other embodiment of this invention. It is a figure which shows other embodiment of this invention.

  Hereinafter, an example of an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a perspective view of a digital camera, which is an example of an embodiment of an imaging apparatus according to the present invention, as viewed from the back side.

  As shown in FIG. 1, the digital camera 100 according to the present embodiment includes a display unit 28, an operation unit 70, a mode switch 60, and the like on the back side, and an imaging lens (to be described later) on the front side (subject side). 103, barrier 102, and the like are arranged. A release button 61, a power switch 72, and the like are disposed on the top surface of the digital camera 100, and a connector 112 to which the connection cable 111 is connected is disposed on the right side when the digital camera 100 is viewed from the back side. . In addition, a recording medium slot 201 into which a recording medium 200 such as a memory card is detachably mounted is disposed on the bottom surface of the digital camera 100, and the recording medium slot 201 can be opened and closed by a lid 202.

  FIG. 2 is a block diagram showing a schematic configuration example of the electrical system of the digital camera 100 shown in FIG. In FIG. 2, an imaging lens 103 is a photographing optical system including a zoom lens, a focus lens, and the like, and is protected by a barrier 102. The shutter 101 has a diaphragm function, and the subject image that has passed through the imaging lens 103 and the shutter 101 forms an image on the imaging element 22.

  The image sensor 22 is composed of a CCD sensor, a CMOS sensor, or the like, and photoelectrically converts the formed subject image. The image sensor 22 has an A / D conversion function, converts an analog image signal obtained by photoelectric conversion into a digital image signal, and then converts the analog image signal into an AF evaluation value detection unit 23, a memory control unit 15, and an image processing unit 24 as image data. Output to.

  The AF evaluation value detection unit 23 calculates an AF evaluation value from contrast information obtained from the digital image signal, and outputs the calculated AF evaluation value to the system control unit 50. The strobe device 90 can compensate for illuminance when shooting in a low-light scene or shooting in a backlight scene by emitting light during shooting.

  The image processing unit 24 performs resizing processing such as pixel interpolation and reduction, and color conversion processing on the image data output from the image sensor 22 or the image data from the memory control unit 15. The image processing unit 24 performs predetermined calculation processing using the captured image data, and the system control unit 50 performs exposure control and AF control based on the obtained calculation result. Thereby, TTL type AE processing and EF (flash automatic light control emission) processing are performed. The image processing unit 24 performs AF processing. At this time, the output of the AF evaluation value detection unit 23 may be used. The image processing unit 24 further performs predetermined calculation processing using the captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained calculation result.

  Image data output from the image sensor 22 is directly written into the memory 32 via the image processing unit 24 and the memory control unit 15 or via the memory control unit 15. The memory 32 has a storage capacity sufficient to store a predetermined number of still images, a moving image and sound for a predetermined time. The memory 32 also serves as an image display memory (video memory). The D / A converter 13 converts the display image data stored in the memory 32 into an analog image signal and supplies the analog image signal to the display unit 28. Thus, the display image data written in the memory 32 is displayed on the display unit 28 via the D / A converter 13.

  The display unit 28 is composed of an LCD or the like, and performs display according to the analog image signal from the D / A converter 13. The digital image signal A / D converted by the image sensor 22 and stored in the memory 32 is converted into an analog signal by the D / A converter 13 and sequentially transferred to the display unit 28 for display, thereby functioning as an electronic viewfinder. Through images can be displayed. The display unit 28 is provided with a touch panel on which various function buttons and the like are arranged.

  The nonvolatile memory 56 is an electrically erasable / recordable memory, and for example, a flash memory or the like is used. The nonvolatile memory 56 stores constants for operating the system control unit 50, control programs, and the like.

  The system control unit 50 controls the entire digital camera 100. The system control unit 50 expands and executes the control program recorded in the nonvolatile memory 56 in the system memory 52. The system control unit 50 also performs display control by controlling the memory 32, the D / A converter 13, the display unit 28, and the like. The system memory 52 is a RAM. In the system memory 52, constants, variables and the like for operation of the system control unit 50 are recorded. The system timer 53 is a time measuring unit that measures the time used for various controls and the time of a built-in clock.

  The mode switch 60 switches the operation mode of the system control unit 50 to any one of a still image recording mode, a moving image recording mode, a reproduction mode, and the like. Modes included in the still image recording mode include an auto shooting mode, an auto scene discrimination mode, a manual mode, various scene modes for shooting settings for each shooting scene, a program AE mode, a custom mode, and the like. The mode changeover switch 60 can directly switch to one of these modes included in the still image shooting mode. It should be noted that after switching to the still image shooting mode once with the mode switch 60, it may be switched to any of these modes included in the still image shooting mode using another operation member. Similarly, the moving image shooting mode may include a plurality of modes.

  For example, when the release button 61 is pressed halfway (shooting preparation instruction), SW1 is turned on, and the system control unit 50 starts operations such as AF processing, AE processing, AWB processing, and EF processing in response to the SW1 on signal. . Further, the release button 61 is turned on by, for example, a full press (shooting instruction) operation, and the system control unit 50 performs a series of operations from reading a signal from the image sensor 22 to writing image data on the recording medium 200 by an ON signal of SW2. The shooting process starts. The operation unit 70 includes various switches, dials, buttons, a touch panel, and the like that receive various operations from the user.

  The power supply control unit 80 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like, and detects whether or not a battery is attached, the type of battery, and the remaining battery level. Further, the power control unit 80 controls the DC-DC converter based on the detection result and an instruction from the system control unit 50, and supplies a necessary voltage to each unit including the recording medium 200 for a necessary period. The power supply unit 40 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, or the like. The recording medium I / F 18 is an interface with the recording medium 200 such as a memory card.

  In the digital camera 100 according to the present embodiment, it is possible to perform photographing using the central one-point AF or the face AF. The center one-point AF is to perform AF on one point at the center position in the photographing screen. The face AF is to perform AF on the face in the shooting screen detected by the face detection function.

  Next, the face detection function will be described. The system control unit 50 sends the image data to be detected to the image processing unit 24. Under the control of the system control unit 50, the image processing unit 24 causes a horizontal bandpass filter to act on the image data, and causes a vertical bandpass filter to act on the processed image data. By these horizontal and vertical band pass filters, edge components are detected from the image data.

  Thereafter, the system control unit 50 performs pattern matching on the detected edge components, and extracts a candidate group of eyes, nose, mouth, and ears. Then, the system control unit 50 determines an eye pair that satisfies a preset condition (for example, distance between two eyes, inclination, etc.) from the extracted eye candidate group. Narrow down the candidate group of only those with.

  Then, the system control unit 50 associates the narrowed-down eye candidate group with other parts (nose, mouth, ears) that form the corresponding face, and passes a preset non-face condition filter. , Detect the face. The system control unit 50 outputs face information according to the face detection result, and ends the process. At this time, the system control unit 50 records feature quantities such as the number of faces in the system memory 52.

  There is a face detection mode as a mode for preferentially focusing the face detected by the face detection function. The face detection mode can be set to enable / disable by the user. As described above, it is possible to detect subject information by analyzing image data that is displayed in live view or reproduced and extracting feature amounts of the image data. In this embodiment, face information is taken as an example of subject information. However, subject information includes various information such as red-eye information, eye information, eye-brow information, and smile information.

  FIG. 3 is a diagram schematically showing the configuration of one pixel of the image sensor 22. As illustrated in FIG. 3, the pixel 221 includes a microlens 222 and a plurality of photodiodes (PD) 223 and 224 as photoelectric conversion regions. In the example of FIG. 3, two PDs 223 and 224 are shown, but the number of PDs is not particularly limited as long as it is two or more.

  FIG. 4 is a cross-sectional view conceptually showing a state where a light beam emitted from the exit pupil of the imaging lens 103 is incident on the imaging element 22. In FIG. 4, a microlens 222, a color filter 403, and PDs 223 and 224 are arranged in the pixel array 401 of the image sensor 22. In the example of FIG. 4, the center of the light beam emitted from the exit pupil 406 of the imaging lens 103 is the optical axis 409 for the pixel having the microlens 222.

  As shown in FIG. 4, among the light fluxes emitted from the exit pupil 406 of the imaging lens 103, the light flux 410 exiting from the region 407 above the exit pupil 406 with the optical axis 409 as a boundary enters the PD 224 and exits the exit pupil 406. A light beam 411 emitted from the lower region 408 enters the PD 223. That is, the PDs 223 and 224 receive light in different regions of the exit pupil 406 of the imaging lens 103, respectively. Here, assuming that the signal received by the PD 223 is an A image and the signal received by the PD 224 is a B image, a focus shift amount (defocus amount) is calculated based on a phase difference signal of a pair of the A image and the B image. Focus detection information can be acquired.

  Next, an operation example of the digital camera 100 shown in FIG. 1 will be described with reference to FIGS. FIG. 5 is a flowchart showing an example of AF control of the digital camera 100. Each process in FIG. 5 is executed by the CPU or the like of the system control unit 50 by developing the control program recorded in the nonvolatile memory 56 in the system memory 52. Note that when the processing of FIG. 5 is started, the above-described face detection mode is enabled.

  In FIG. 5, in step S501, the system control unit 50 acquires an imaging signal from the imaging element 22, and proceeds to step S502.

  In step S502, the system control unit 50 acquires information about the distance to the subject (focus detection information of the phase difference detection method) based on the imaging signal acquired in step S501, and the process proceeds to step S503. As described above, the distance information acquisition process here can be acquired based on the phase difference signals of the A image and the B image of the image sensor in which the light receiving unit is divided into two.

  In step S503, the system control unit 50 determines whether there are a plurality of subjects from the captured image acquired in step S501. If the system control unit 50 determines that there is one subject, the system control unit 50 proceeds to step S508. If it is determined that there are a plurality of subjects, the system control unit 50 proceeds to step S504.

  In step S <b> 504, the system control unit 50 determines whether “faces” exist in a plurality of subjects. The system control unit 50 proceeds to step S508 when the “face” does not exist in the plurality of subjects, and proceeds to step S505 when the “face” exists in the plurality of subjects. The presence / absence of the “face” here can be determined from the face detection information of the system control unit 50 by the face detection function described above.

  In step S505, the system control unit 50 acquires the area (size) of the “face” in the captured image, and proceeds to step S506. Similarly, the area information of “face” can be acquired from the detection result of the system control unit 50 by the above-described face detection function.

  In step S506, the system control unit 50 determines whether the detected “face” is a person from the distance information to the “face” acquired from the imaging signal and the area information of the “face” acquired in step S505, or a signboard or the like. It is determined whether it is a “face” printed on. The system control unit 50 proceeds to step S508 if the detected “face” is a human face, and proceeds to step S507 if the detected “face” is a “face” printed on a signboard or the like. move on.

  Here, with reference to FIG. 6 to FIG. 9, the “face” determination method in step S506 will be described.

  6A is a diagram in the case where the subject A of the captured image acquired from the image sensor 22 is actually a person. FIG. 6B is a diagram in which the subject B of the captured image acquired from the image sensor 22 is printed on the signboard. It is a figure in the case of being made "face". Here, the areas of the “faces” of the subjects A and B acquired from the system control unit 50 are Y1 and Y2.

  FIG. 7 is a diagram illustrating a positional relationship between the camera and the subjects A and B. As shown in FIG. 7, the distance D1 between the camera and the subject A and the distance D2 between the camera and the subject B are acquired in step S502.

  FIG. 8 is a graph showing the relationship between the distance D to the subject acquired in step S502 and the area X of the “face” estimated from the distance D as a conversion table. In the example of FIG. 8, the minimum value of the “face” area X estimated from the distance D to the subject is C1, and the maximum value of the “face” area X estimated from the distance D to the subject is C2. .

  In this case, assuming that the area X of the “face” acquired by the system control unit 50 is Y, if C1 ≦ Y ≦ C2, it is determined that the detected “face” is a human face that actually exists, and C2 <Y In this case, it can be determined that the detected “face” is the “face” printed on the signboard.

  FIG. 9 is a graph showing a case where the conversion table shown in FIG. 8 is applied to the subjects A and B shown in FIGS. In the example of FIG. 9, the minimum value of the area X of the “face” of the subject A estimated from the distance D1 is A_C1, and the maximum value is A_C2. In addition, the minimum value of the area X of the “face” of the subject B estimated from the distance D2 is B_C1, and the maximum value is B_C2.

  Here, when the face areas A_C1 to A_C2 and B_C1 to B_C2 estimated by the conversion table are compared with the face areas Y1 and Y2 of the subjects A and B acquired by the system control unit 50, A_C1 ≦ Y1 ≦ A_C2, B_C2 < Y2. Thereby, it can be determined that the subject A is a “face” of a person who actually exists, and the subject B is a “face” printed on a signboard.

  Here, the “face” of a person who actually exists and the “face” printed on a signboard or the like are illustrated, but a poster or the like on which a large “face” is printed at the same distance as the subject A exists as the subject B. It is effective even if it is. Further, by using the relational expression of Y <C1, it is possible to determine the subject A and the subject B having a small “face (mascot, doll, etc.)”.

  Returning to FIG. 5, in step S507, since the detected “face” is a “face” printed on a signboard or the like, the system control unit 50 focuses on another detected subject as a main subject, and performs processing. finish.

  In step S508, since each of step S503, step S504, and step S506 is No, the system control unit 50 focuses the detected subject as the main subject, and ends the process.

  As described above, in the present embodiment, in AF control, focus detection information and face area information of a subject are acquired from an imaging signal, and the main subject intended by the user is instantly accurately obtained from the acquired information. Can be focused.

  In addition, this invention is not limited to what was illustrated to the said embodiment, In the range which does not deviate from the summary of this invention, it can change suitably.

  For example, in the above-described embodiment, it is determined whether the face is printed on a signboard or the like using the face area information, the distance information to the subject (focus detection information), and the conversion table. The determination accuracy can be further increased by using the focus detection information around the face.

  Referring to FIG. 10, in FIG. 10, the average values of the distances to the peripheral areas S1 and S2 of the subjects A and B are represented by D1 'and D2', respectively. D1 ′ and D2 ′ can be obtained by acquiring the distance data of the surrounding area and calculating the average when acquiring the distance data of each subject in step S502).

  Then, the average values D1 ′ and D2 ′ are compared with the focus detection information D1 and D2 of the subjects A and B. If the difference is equal to or smaller than the threshold value, the detected “face” can be determined to be a signboard. For example, if | D1-D1 ′ |> threshold K1, subject A is determined to be a “face” of a person that actually exists, and if | D2-D2 ′ | ≦ threshold K1, subject B is printed on a signboard. It can be determined that it is the “face”. In this case, the face area acquisition process in step S505 in FIG. 5 is not necessary.

  In the above embodiment, if it is determined that the “face” detected in step S506 in FIG. 5 is a “face” printed on a signboard or the like, another subject other than the signboard or the like is set as the main subject in step S507. Although the focus is adjusted, the following may be used instead. That is, if it is determined that the “face” detected in step S506 in FIG. 5 is a “face” printed on a signboard or the like, and if the detected “face” exists in the center of the screen, the signboard It is also possible to consider that the “face” printed on the main subject is the main subject and to focus on the main subject.

  Referring to FIG. 11 and FIG. 12, in FIG. 11, the lengths obtained by dividing the vertical and horizontal directions of the imaging screen into four are a and b. In this case, assuming that the area S3 of horizontal: 8b / 3 × vertical: 3a is the center of the screen, when photographing the subject shown in FIG. 12, the “face” printed on the signboard or the like is determined as the main subject. Information on the position of the “face” in the imaging screen can be acquired from the system control unit 50.

  In the above embodiment, the face area information, the distance information to the subject (focus detection information), and the conversion table are used to determine whether the face is printed on a signboard or the like. However, the present invention is not limited to this. For example, as shown in FIG. 13, when there is a subject A that is sufficiently close to the camera and a subject B that is far from the camera, the main subject can be determined to be the subject B if a zoom operation is performed.

  Specifically, first, a ratio (D1 / D2) of the distance D1 to the subject A and the distance D2 to the subject B is obtained. When the obtained ratio is equal to or less than the threshold value K2 ((D1 / D2) ≦ K2), when the zoom operation is performed, the “face” of the subject B printed on a signboard or the like is determined as the main subject, and the subject A (Here, a person) is determined as another subject. When (D1 / D2) ≦ K2 and no zoom operation is performed, and when the obtained ratio exceeds the threshold K ((D1 / D2)> K2), the face of the subject A is determined as the main subject. The subject B is determined as another subject. Also in this case, the face area acquisition process in step S505 in FIG. 5 is not necessary.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed. It can also be realized by executing software (program) acquired via a network or various storage media on a personal computer (CPU, processor).

22 Image sensor 23 AF evaluation value detection unit 50 System control unit 52 System memory 56 Non-volatile memory 100 Digital camera

Claims (7)

Distance information acquisition means for acquiring focus detection information of a phase difference detection method as distance information from an image sensor that photoelectrically converts a subject image formed through a photographing optical system to the subject;
Face detection means for detecting a face in an imaging screen based on an imaging signal acquired from the imaging element;
Face area acquisition means for acquiring the face area from the face detection information when a face is detected by the face detection means;
Determining means for determining whether the face detected by the face detecting means is the face of the main subject or the face of another subject based on the face area acquired by the face area acquiring means and the focus detection information;
When the determination means determines that the detected face is the face of the main subject, the main object is focused, and when the detection means determines that the detected face is the face of another subject And an in-focus means for focusing on a subject other than the other subject. Acquires focus detection information of a phase difference detection method as distance information from an image sensor that photoelectrically converts a subject image formed through a photographing optical system to a subject, and also acquires distance information to a peripheral region of the subject. Distance information acquisition means;
Face detection means for detecting a face in an imaging screen based on an imaging signal acquired from the imaging element;
If the difference between the average value of the distance information to the peripheral area of the face detected by the face detection means and the focus detection information exceeds a threshold, the detected face is determined to be the face of the main subject; Determination means for determining that the detected face is the face of another subject when the difference between the average value and the focus detection information is equal to or less than the threshold;
When the determination means determines that the detected face is the face of the main subject, the main object is focused, and when the detection means determines that the detected face is the face of another subject And an in-focus means for focusing on a subject other than the other subject. Determining means for determining whether the face detected by the face detecting means is located at the center of the imaging screen;
When the focusing means determines that the detected face is the face of another subject and the determining means determines that the detected face is located at the center of the imaging screen, The imaging apparatus according to claim 1, wherein the other subject is focused. Distance information acquisition means for acquiring focus detection information of a phase difference detection method as distance information from an image sensor that photoelectrically converts a subject image formed through a photographing optical system to the subject;
Face detection means for detecting a face in an imaging screen based on an imaging signal acquired from the imaging element;
When two faces are detected by the face detecting means, if distance information on the near side in the distance information of the detected two faces is D1, and distance information on the far side is D2, D1 / D2 is a threshold value. In the following, when the zoom operation is performed, it is determined that the face whose distance information is far is the face of the main subject, D1 / D2 is equal to or less than the threshold value, and the zoom operation is not performed, and D1 When / D2 exceeds the threshold value, a determination unit that determines that the face on the side closer to the distance information is the face of the main subject;
An imaging apparatus comprising: focusing means for focusing on the face determined as the main subject by the determination means. A distance information acquisition step for acquiring focus detection information of a phase difference detection method as distance information from an image sensor that photoelectrically converts a subject image formed through a photographing optical system to the subject;
A face detection step of detecting a face in the imaging screen based on an imaging signal acquired from the imaging element;
A face area acquisition step of acquiring a face area from face detection information when a face is detected in the face detection step;
A determination step of determining whether the face detected in the face detection step is a face of a main subject or another subject based on the face area acquired in the face area acquisition step and the focus detection information;
When it is determined that the detected face is the face of the main subject in the determination step, the main subject is focused, and when the detected face is determined as the face of another subject in the determination step And a focusing step of focusing on a subject other than the other subject. Acquires focus detection information of a phase difference detection method as distance information from an image sensor that photoelectrically converts a subject image formed through a photographing optical system to a subject, and also acquires distance information to a peripheral region of the subject. A distance information acquisition step;
A face detection step of detecting a face in the imaging screen based on an imaging signal acquired from the imaging element;
If the difference between the average value of the distance information to the peripheral area of the face detected in the face detection step and the focus detection information exceeds a threshold, the detected face is determined to be the face of the main subject; A determination step of determining that the detected face is the face of another subject when the difference between the average value and the focus detection information is equal to or less than the threshold;
When it is determined that the detected face is the face of the main subject in the determination step, the main subject is focused, and when the detected face is determined as the face of another subject in the determination step And a focusing step of focusing on a subject other than the other subject. A distance information acquisition step for acquiring focus detection information of a phase difference detection method as distance information from an image sensor that photoelectrically converts a subject image formed through a photographing optical system to the subject;
A face detection step of detecting a face in the imaging screen based on an imaging signal acquired from the imaging element;
When two faces are detected in the face detection step, if distance information on the near side in the distance information of the detected two faces is D1 and distance information on the far side is D2, D1 / D2 is a threshold value. In the following, when the zoom operation is performed, it is determined that the face whose distance information is far is the face of the main subject, D1 / D2 is equal to or less than the threshold value, and the zoom operation is not performed, and D1 When / D2 exceeds the threshold value, a determination step of determining that the face on the side closer to the distance information is the face of the main subject;
And a focusing step of focusing on the face determined as the main subject in the determination step.