JP2015126369A - Imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily make face recognition a success by photographing the image for recognition of a photographer at the timing where the front face of the photographer is easily photographed by using the behavior of a user.SOLUTION: In an imaging apparatus 100 which includes a main camera 101 imaging a main object, a sub camera 102 photographing the photographer, a movable display device 103 displaying a photographed video, and a recognition part 104 performing the face recognition with respect to the image for the face recognition of the photographed photographer and in which the sub camera 102 is arranged in the movable display device 103, a CPU 105 performing the control of the imaging apparatus 100 controls the sub camera 102, so as to photograph the image for the face recognition of the photographer by the sub camera 102, after the imaging apparatus 100 is started up and before predetermined display is performed on the movable display device 103.

Description

  The present invention relates to an imaging apparatus, and more particularly to an imaging apparatus that includes two systems of imaging means for capturing a subject and stores data captured by each imaging means in association with each other.

  As an image pickup apparatus such as a digital camera or a digital video camera, an apparatus capable of shooting a photographer who is operating the image pickup apparatus at the same time as shooting a main subject has been proposed. For example, Patent Document 1 is an image pickup apparatus including two types of image pickup means, and takes a picture of a photographer who takes an image of a main subject with a first image pickup means and operates the image pickup apparatus with a second image pickup means. A technique is described in which video signals (image signals) are combined and stored in a storage medium.

  FIG. 9 is a perspective view illustrating a schematic configuration of an imaging apparatus including two systems of imaging means. An imaging apparatus 900 illustrated in FIG. 9 includes a main camera 901 and a sub camera 902. The sub camera 902 is mounted on an LCD panel 903 that is movable 90 degrees between a state orthogonal to a photographing optical axis of the main camera 901 and a state parallel to the photographing optical axis.

  FIG. 10 is a diagram illustrating a state in which the photographer is shooting with the LCD panel 903 of the imaging apparatus 900 closed. FIG. 11 is a diagram illustrating a state in which the photographer is shooting with the LCD panel 903 of the imaging apparatus 900 opened.

  The photographer often faces the direction of the main subject photographed by the main camera 901. When the LCD panel 903 is closed as shown in FIG. 10, the photographer often faces the main subject and holds the imaging device 900 in front of the face. It makes it easier to shoot a face. On the other hand, when the LCD panel 903 is open as shown in FIG. 11, the photographer often holds the imaging device 900 below the face. Therefore, when the photographer turns to the main subject, it is difficult for the sub camera 902 to photograph the front face of the photographer, and the photographer's face is easily photographed from below.

  Here, by extracting feature values of different face regions such as the positions of eyes and nose from the face image detected by the face detection function and comparing them with dictionary data of face images registered in advance, the detected face is A face recognition function for identifying whether or not a person is registered is known. By using the face recognition function, for example, the video file obtained by reducing and capturing the captured video of the sub camera 902 into the captured video of the main camera 901 is organized by main subject or photographer. be able to.

  If the dictionary data of the face image is a front face, the face feature amount differs between the front face and the face photographed from below, so that the face recognition accuracy is lowered and the recognition is difficult to succeed. For this reason, for example, Patent Documents 2 and 3 propose techniques for acquiring an image of the front face of the photographer using the photographer's habits and enabling face recognition.

  In the technique described in Patent Document 2, an imaging unit is arranged in the vicinity of a specific operation unit of the recognition device, and when the user operates the specific operation unit, a face image is captured by the imaging unit, thereby the front of the user. A face image is acquired. In the technique described in Patent Document 3, in the face recognition of a subject, whether or not the subject's face is in the shooting direction is determined based on whether or not the facial feature can be extracted, and the face is not in the shooting direction. Is guided to face the shooting direction.

JP-A-6-165029 JP 2006-344100 A JP 2010-218039 A

  However, in the technique described in Patent Document 2, it is difficult to recognize a face when there is no front face image in the image acquired when the photographer operates a specific operation unit. The problem remains. On the other hand, when the LCD panel is closed in the imaging apparatus 900 shown in FIG. 9, the front face of the photographer is likely to be photographed, so that the possibility of successful face recognition is high. Therefore, in this case, unlike the technique described in Patent Document 3, it is not necessary to extract the feature of the photographer's face and determine whether or not the face is facing the imaging direction.

  An object of the present invention is to provide a technique for facilitating successful face recognition in an imaging apparatus that performs face recognition by photographing a photographer together with a main subject.

  An image pickup apparatus according to the present invention includes a first image pickup unit that picks up a main subject, a second image pickup unit that picks up a photographer who operates the first image pickup unit, the first image pickup unit, and the first image pickup unit. And a movable display device that displays an image picked up by the two image pickup means, wherein the second image pickup means is disposed on the movable display device, and at least the second image pickup means Recognizing means for performing face recognition on the photographer's face recognizing image photographed by the imaging device, and after the activation of the imaging device, before the predetermined display is performed on the movable display device, the second imaging And a control means for controlling the second imaging means so as to photograph the photographer's face recognition image by means.

  In the present invention, the face recognition is likely to be successful by taking the photographer's face in a situation where the front face is easily photographed using the photographer's habits.

1 is a block diagram illustrating a schematic configuration of an imaging apparatus according to a first embodiment of the present invention. 3 is a flowchart of face recognition processing executed in the imaging apparatus of FIG. It is a block diagram which shows schematic structure of the imaging device which concerns on 2nd Embodiment of this invention. It is a flowchart of the face recognition process performed in the imaging device of FIG. It is a block diagram which shows schematic structure of the imaging device which concerns on 3rd Embodiment of this invention. 6 is a flowchart of face recognition processing executed in the imaging apparatus of FIG. It is the top view and side view which show the principle of the gaze detection method used in the gaze detection process performed by step S603 of FIG. FIG. 8 is a schematic diagram of an eyeball image projected on the imaging sensor and a diagram showing output intensity of the imaging sensor in the visual line detection method shown in FIG. It is a perspective view which shows schematic structure of an imaging device provided with an imaging means of 2 systems. FIG. 10 is a diagram illustrating a state where a photographer is taking a picture with the LCD panel of the imaging apparatus of FIG. 9 closed. FIG. 10 is a diagram illustrating a state where a photographer is taking a picture with the LCD panel of the imaging apparatus of FIG. 9 opened.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

<First Embodiment>
FIG. 1 is a block diagram showing a schematic configuration of an imaging apparatus 100 according to the first embodiment of the present invention. An imaging apparatus 100 illustrated in FIG. 1 includes a main camera 101 that is a first imaging unit, a sub camera 102 that is a second imaging unit, a movable display device 103, a recognition unit 104, and a CPU 105.

  The main camera 101, the sub camera 102, and the movable display device 103 in the imaging apparatus 100 are respectively equivalent to the main camera 901, the sub camera 902, and the LCD panel 903 of the imaging apparatus 900 shown in FIG. In addition, the arrangement form and appearance are the same as those of the imaging apparatus 900.

  The main camera 101 is mainly used for photographing a main subject (subject other than the photographer), and the sub camera 102 is mainly used for photographing a photographer's face image (face image). The movable display device 103 is, for example, an LCD panel or an organic EL panel, and the display screen is between a state (closed state) orthogonal to the photographing optical axis of the main camera 101 and a state parallel to the state (open state). It is movable with. The sub camera 102 is disposed on the movable display device 103.

  The recognition unit 104 performs face recognition on the face images captured by the main camera 101 and the sub camera 102. The recognition unit 104 stores a face image of a predetermined person in advance as dictionary data, and here, it is assumed that a front face image is stored in the dictionary data. The recognition unit 104 performs face recognition by comparing the captured face image with the face image of the dictionary data.

  The CPU 105 controls the overall operation of the imaging apparatus 100. For example, the CPU 105 performs various operations executed by the imaging apparatus 100 such as a shooting operation by the main camera 101 and the sub camera 102, execution of face recognition by the recognition unit 104, and display of an image (video) on the movable display device 103. Control operations and processes.

  FIG. 2 is a flowchart of face recognition processing executed in the imaging apparatus 100 when the imaging apparatus 100 is activated. Each process shown in the flowchart of FIG. 2 is performed by the CPU 105 developing and executing a predetermined program stored in a ROM (not shown) on a RAM (not shown), thereby controlling the operation and processing of each unit constituting the imaging apparatus 100. It is executed by doing.

  In step S <b> 201, the CPU 105 acquires (captures) a photographer's face recognition face image (hereinafter referred to as “face recognition image”) by the sub camera 102. Here, after the imaging apparatus 100 is activated, the photographer displays a startup screen such as a logo (manufacturer) of the imaging apparatus 100 on the movable display device 103, and a predetermined display such as a default menu display is displayed. In the meantime, the screen of the movable display device 103 is often viewed.

  Using the photographer's habits, the photographer's face recognition image is photographed in step S <b> 201, and the photographer immediately after starting the imaging apparatus 100 points his face in the direction of the movable display device 103. To do when. As a result, the front face of the photographer can be easily photographed in step S201, and face recognition processing in the subsequent step S204 can be performed on the acquired face image, thereby facilitating successful face recognition. On the other hand, while a startup screen such as a logo is displayed on the movable display device 103 and a predetermined display such as a default menu display is being performed, the main subject is included within the angle of view of the main camera 101. The possibility is not high. For this reason, the face recognition image by the sub camera 102 is started while the predetermined display is being performed, but the face recognition image by the main camera 101 is started after the predetermined display is completed. .

  In subsequent step S202, CPU 105 determines whether or not acquisition of the image for recognizing the photographer's face by sub camera 102 has been completed. The CPU 105 repeats the determination until acquisition of the photographer's face recognition image is completed (NO in S202). When the photographer's face recognition image is acquired (YES in S202), step S203 (route A) and step are performed. The processing of S204 to 206 (route B) is executed in parallel.

  In step S <b> 203, the CPU 105 combines the video signals obtained by the main camera 101 and the sub camera 102 and displays the combined video on the movable display device 103. For example, the video obtained by the main camera 101 is displayed on the entire screen of the movable display device 103 and the video obtained by the sub camera 102 is displayed in a small superimposed manner on the lower right of the screen of the movable display device 103.

  In step S204, the CPU 105 performs face recognition processing by the recognition unit 104 on the photographer's face recognition image acquired in step S201. Detected by extracting feature quantities of different face regions for each individual from the photographer's face recognition image acquired in step S201 and comparing them with dictionary data of face images registered in advance. Identify whether the face is a registered person.

  In subsequent step S205, CPU 105 determines whether or not face recognition is successful (OK) as a result of the face recognition processing in step S204. If the face recognition fails (NO in S204), the CPU 105 advances the process to step S206. If the face recognition succeeds (YES in S204), the CPU 105 ends the process. Note that when the photographing operation is continued, the display of the video obtained by the main camera 101 and the sub camera 102 on the movable display device 103 (S203) is continued.

  In step S206, the CPU 105 re-acquires (re-photographs) the photographer's face recognition image by the sub camera 102, and then returns the process to step S204. That is, face recognition is performed again by replacing the face recognition images.

  As described above, in the first embodiment, since the image for face recognition is acquired when the photographer is facing the face in the direction of the movable display device 103, it is easy to acquire a front face image. , Can make face recognition easy to succeed.

Second Embodiment
FIG. 3 is a block diagram illustrating a schematic configuration of an imaging apparatus 300 according to the second embodiment of the present invention. An imaging apparatus 300 shown in FIG. 3 includes a main camera 101 as a first imaging means, a sub camera 102 as a second imaging means, a movable display device 103, a recognition unit 104, a CPU 105, and a display device state detection unit 301. Prepare. Since the main camera 101, the sub camera 102, the movable display device 103, the recognition unit 104, and the CPU 105 are the same as the respective units (blocks) constituting the imaging device 100 according to the first embodiment, description thereof is omitted here. .

  The display device state detection unit 301 uses, for example, an acceleration sensor that detects a change in the state of the movable display device 103 and specifically detects the movement of the movable display device 103. The display device state detection unit 301 detects whether the movable display device 103 is in an open state or a closed state (a state accommodated in the main body of the imaging device 300) under the control of the CPU 105. In addition, if it uses a magnetic sensor etc., when it is in an open state, it can also be comprised so that it may detect at what angle it is open.

  FIG. 4 is a flowchart of face recognition processing executed in the imaging apparatus 300. Each process shown in the flowchart of FIG. 4 is performed by the CPU 105 developing and executing a predetermined program stored in a ROM (not shown) on a RAM (not shown), thereby controlling the operation and processing of each unit constituting the imaging apparatus 300. It is executed by doing.

  In step S <b> 401, the CPU 105 detects the state of the movable display device 103 by the display device state detection unit 301. In subsequent step S402, CPU 105 determines whether or not movable display device 103 has moved based on the detection processing result in step S401. Specifically, it is determined whether or not the photographer has detected the force applied in the movable direction to move the movable display device 103 as an acceleration signal by the acceleration sensor. If there is no movement in movable display device 103 (NO in S402), CPU 105 returns the process to step S401, and if there is movement in movable display device 103 (YES in S402), the process proceeds to step S403.

  In step S <b> 403, the CPU 105 acquires (photographs) a photographer's face recognition image by the sub camera 102. Here, when the determination is “YES” in step S <b> 402, the photographer is turning the movable display device 103, so the photographer's face faces the direction of the movable display device 103. There are many. Therefore, when the photographer's face recognition image is photographed in step S402, the front face is easily photographed, and the face recognition process in the subsequent step S404 is performed on the acquired face image, thereby facilitating the successful face recognition. Can do.

  In step S404, the CPU 105 performs face recognition processing by the recognition unit 104 on the photographer's face recognition image acquired in step S403. In subsequent step S405, CPU 105 determines whether or not face recognition is successful (OK) as a result of the face recognition processing in step S404. If the face recognition has failed (NO in S405), the CPU 105 returns the process to step S401. If the face recognition has succeeded (YES in S405), the CPU 105 ends this process.

  As described above, in the second embodiment as in the first embodiment, the face recognition image is acquired in order to obtain the face recognition image when the photographer is facing the face in the direction of the movable display device 103. This makes it possible to facilitate the face recognition. Moreover, even if face recognition fails once, when the movement of the movable display device 103 is detected again, the face image is preferentially acquired and face recognition is performed, so that face recognition can be made easy to succeed. .

<Third Embodiment>
FIG. 5 is a block diagram showing a schematic configuration of an imaging apparatus 500 according to the third embodiment of the present invention. An imaging apparatus 500 shown in FIG. 5 includes a main camera 101 as a first imaging means, a sub camera 102 as a second imaging means, a movable display device 103, a recognition unit 104, a CPU 105, and a display device state detection unit 301. Prepare. The main camera 101, the sub camera 102, the movable display device 103, the recognition unit 104, the CPU 105, and the display device state detection unit 301 are the same as each unit (block) that configures the imaging device 300 according to the second embodiment. The description here is omitted.

  In addition, the imaging apparatus 500 includes a photographer state determination unit 501, an LED 502, and a speaker 503. The photographer state determination unit 501 determines whether the photographer's face is facing the movable display device 103 (or the sub camera 102) by, for example, line-of-sight detection. For example, when the face recognition is not successful, the LED 502 emits light under the control of the CPU 105 and issues a warning to the photographer. In addition, when the face recognition is not successful, the speaker 503 emits a sound such as “Please turn your face to the screen” or a warning sound (so-called beep sound). The movable display device 103 functions as a warning unit when face recognition is not successful. A message such as “Please turn your face to the screen” is displayed on the movable display device 103 when a warning is given by the LED 502 or the speaker 503 or alone.

  FIG. 6 is a flowchart of face recognition processing executed in the imaging apparatus 500. Each process shown in the flowchart of FIG. 6 is performed by the CPU 105 developing and executing a predetermined program stored in a ROM (not shown) on a RAM (not shown), thereby controlling the operation and processing of each unit constituting the imaging apparatus 500. It is executed by doing.

  In step S <b> 601, the CPU 105 detects the state (position) of the movable display device 103 by the display device state detection unit 301. In subsequent step S602, CPU 105 determines whether or not movable display device 103 is open. If the movable display device 103 is open (YES in S602), the CPU 105 proceeds to step S603, and if the movable display device 103 is closed (NO in S602), the process proceeds to step S606.

  In step S603, the CPU 105 performs a photographer's line-of-sight detection process. Specifically, in the photographer's gaze detection process, the gaze state is detected by the photographer state determination unit 501, and it is determined whether or not the photographer's face is facing the movable display device 103 (sub camera 102). By discriminating, it is discriminated whether or not a front face is obtained when a face image is taken. Details of the line-of-sight detection process in step S603 will be described later with reference to FIGS.

  Next, in step S604, the CPU 105 determines whether the photographer's pupil is at the center of the eye based on the result of the line-of-sight detection process in step S603. If the photographer's pupil is not in the center of the eye (NO in S604), the CPU 105 proceeds the process to step S605. If the photographer's pupil is in the center of the eye (YES in S604), the process proceeds to step S606. .

  The case where the photographer's pupil is not in the center of the eye indicates that the photographer's face is not directed toward the movable display device 103 (sub camera 102). Therefore, in step S605, the CPU 105 performs a warning process, and then returns the process to step S601. The warning processing in step S605 includes light emission of the LED 502, voice warning from the speaker 503, warning display on the movable display device 103, and the like.

  On the other hand, when the photographer's pupil is in the center of the eye, it indicates that the photographer's face is facing the movable display device 103 (sub camera 102). If the movable display device 103 is closed in step S602 (NO in S602), it is assumed that the photographer holds the imaging device 500 in front of him and is looking at the movable display device 103. . Therefore, in step S606, the CPU 105 captures the photographer's face image by the sub camera 102, and the recognition unit 104 performs face recognition on the photographed face image.

  Next, in step S607, the CPU 105 determines whether face recognition has been successful. If the face recognition is successful (YES in S607), the CPU 105 ends the process, and if face recognition fails (YES in S607), the process returns to step S601.

  The line-of-sight detection process in step S603 will be described with reference to FIGS. 7A and 7B are a top view and a side view, respectively, showing the principle of the line-of-sight detection method. Infrared light is irradiated toward the photographer's face from light sources 702 and 703 such as light emitting diodes that emit infrared light insensitive to the photographer. Here, the light sources 702 and 703 are positioned substantially symmetrical with respect to the optical axis of the condenser lens 706 in the x direction (horizontal direction) in the figure and in the y direction (vertical direction) in the figure. It is arranged at a position slightly below the optical axis, and diverges and illuminates the observer's eyeball. Part of the infrared light reflected by the photographer's eyeball 704 forms an image on the image sensor 707 by the condenser lens 706. The imaging sensor 707 is an image sensor such as a CMOS sensor or a CCD sensor that converts an optical image into an electrical signal.

  FIG. 8A is a schematic diagram of an eyeball image projected on the image sensor 707, and FIG. 5B is a diagram illustrating the output intensity of the image sensor 707. Considering the horizontal plane (z-x plane), as shown in FIG. 7A, the infrared light emitted from the light source 703 illuminates the cornea 705 of the eyeball 704 of the photographer. At this time, a cornea reflection image d, which is a virtual image formed by infrared light reflected from the surface of the cornea 705, is collected by the condenser lens 706 and formed at a position d ′ on the image sensor 707. Similarly, the infrared light emitted from the light source 702 illuminates the cornea 705 of the eyeball, and the cornea reflection image e which is a virtual image formed by the infrared light reflected by the surface of the cornea 705 is obtained by the condenser lens 706. The light is collected and imaged at a position e ′ on the image sensor 707. Further, light beams from the ends a and b of the iris 701 are imaged at positions a ′ and b ′ on the image sensor 707 via the condenser lens 706.

When the rotation angle θ of the optical axis of the eyeball 704 with respect to the optical axis of the condenser lens 706 is small, assuming that the x coordinates of the ends a and b of the iris 701 are (x _a , x _b ), (x _a , x _b ) Can be obtained on the image sensor 707 (multiple points in FIG. 5A). Therefore, the x coordinate x _C of the pupil center c is first calculated by the least square method of the circle. On the other hand, when the x coordinate of the center of curvature O of the cornea 705 is x _O , the horizontal rotation angle θ _{X with} respect to the optical axis of the eyeball 704 is expressed by the following formula 1. Note that “oc” in Equation 1 below is the distance between the center of curvature O of the cornea 705 and the pupil center c.

Also, the corneal reflected images d, x-coordinate _{x k} of the center k of e, because the cornea reflection image d, x-coordinate of the center of each e _x d, with _{x e} represented by the following formula 2, the cornea 705 The x coordinate x _O of the center of curvature _O is expressed by the following formula 3 in consideration of the correction value δ _X. The correction value [delta] _X is a numerical value geometrically obtained from the installation process and the eyeball distance, and the like of the visual line detection device, it is possible to use techniques well known in the calculation method, a detailed description Is omitted.

By substituting the following expression 3 into the following expression 1, the rotation angle θ _X can be obtained from the following expression 4. Further, the coordinates of each feature point projected on the image sensor 707 are rewritten into the following equation 5 with “′ (dash)”. In the following formula 5, “β” is a magnification determined by the distance sze between the condensing lens 706 and the eyeball 704 (FIG. 7A), and actually the interval between the corneal reflection images d and e | xd′−xe It is obtained as a function of ′ |.

Considering the vertical plane (yz plane), as shown in FIG. 7B, the corneal reflection image generated by the light sources 702 and 703 is generated at the same position, and this is defined as a corneal reflection image i. The calculation method of the rotation angle θ _{y in} the vertical direction with respect to the optical axis of the eyeball 704 is almost the same as that in the horizontal plane, but only the expression corresponding to the following expression 3 is different, and the y coordinate y _O of the cornea 705 curvature center _O is , Represented by the following formula 6. Here, “δ _y ” is a numerical value obtained geometrically from the installation method of the eye gaze detection device, the eyeball distance, and the like, and a well-known technique can be used for the calculation method. Description is omitted. Therefore, from the following formula 6, the rotation angle θ _y can be obtained by the following formula 7.

[Equation 1]
oc × sin θ _X = x _C −x _O Formula 1
x _k = (x _d + x _e ) / 2 Equation 2
x _O = (x _d + x _e ) / 2 + δ _X Equation 3
θ _X = arcsin [[x _C − {(x _d + x _e ) / 2 + δ _X }] / oc] Equation 4
theta _X = arcsin _{[[x C '- {(x} d' + x e ') / 2 + δ X'}] / oc / β ] Equation 5
y _O = y _i + δ _{y (} Formula 6)
θ _y = arcsin [[yc ′ − (yi ′ + δy ′)] / oc / β] Equation 7
As shown in FIG. 8, the detection of the pupil edge uses the rise xb ′ and fall xa ′ of the output waveform of the image sensor 707. The coordinates of the cornea reflection images d and e use sharp rising portions xd ′ and xe ′. Thus, line-of-sight detection can be performed. Then, an angle threshold for determining whether or not the photographer's face is a front face is set at the rotation angles θx and θy with respect to the optical axis of the eyeball 704. For example, at least one of the rotation angles θx and θy is If the angle is larger than the threshold angle, it is determined that the photographer's face is not a front face.

  As described above, in the third embodiment, the recognition is successful only when the movable display device 103 is open, that is, when the photographer's face is likely to be photographed from below and the recognition is difficult. It is determined whether or not a face image that can be easily acquired can be acquired. If the face is difficult to recognize, a warning is issued and the photographer is directed to turn the face in the shooting direction in order to photograph the front face. Thereby, it is possible to easily photograph the front face of the photographer and to facilitate the recognition.

  In addition, when the movable display device 103 is closed, as described with reference to FIG. 10, since it is highly possible to photograph the front face of the photographer, the opening of the movable display device 103 is detected. Only when the photographer's line of sight is detected. In this manner, when the movable display device 103 is closed, the user's line of sight is not detected, so that unnecessary processing can be eliminated and usability can be improved.

<Other embodiments>
Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. Furthermore, each embodiment mentioned above shows only one embodiment of this invention, and it is also possible to combine each embodiment suitably.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program code. It is a process to be executed. In this case, the program and the storage medium storing the program constitute the present invention.

100, 300, 500 Imaging device 101 Main camera 102 Sub camera 103 Movable display device 104 Recognition unit 105 CPU
301 Display device state detection unit 501 Photographer state determination unit 502 LED
503 Speaker

Claims (14)

First imaging means for imaging a main subject;
A second imaging means for photographing a photographer who operates the first imaging means;
A movable display device that displays an image captured by the first imaging unit and the second imaging unit, and the second imaging unit is disposed on the movable display device. And
Recognition means for performing face recognition on the photographer's face recognition image captured by at least the second imaging means;
After the imaging device is activated, the second imaging unit is controlled so that the second imaging unit captures an image for recognizing the face of the photographer before a predetermined display is performed on the movable display device. And an imaging device.   The control means is a result of face recognition by the recognition means on the photographer's face recognition image taken by the second imaging means before the predetermined display is performed on the movable display device. When face recognition is not successful, the second image pickup unit re-photographs the photographer's face recognition image and performs face recognition by the recognition unit on the re-photographed face recognition image. The imaging apparatus according to claim 1, wherein the second imaging unit and the recognition unit are controlled as described above.   The second imaging unit is configured to capture the photographer's face recognition image by the second imaging unit and perform face recognition by the recognition unit until face recognition by the recognition unit is successful. The image pickup apparatus according to claim 2, wherein a control unit and a recognition unit are controlled. The recognizing unit performs face recognition on the face recognition image of the main subject imaged by the first imaging unit;
The control unit controls the first imaging unit so that the first imaging unit captures a face recognition image of the main subject after the predetermined display is performed on the movable display device. The image pickup apparatus according to claim 1, wherein the image pickup apparatus is an image pickup apparatus. First imaging means for imaging a main subject;
A second imaging means for photographing a photographer who operates the first imaging means;
A movable display device that displays an image captured by the first imaging unit and the second imaging unit, and the second imaging unit is disposed on the movable display device. And
Recognition means for performing face recognition on the photographer's face recognition image captured by at least the second imaging means;
Detecting means for detecting the state of the movable display device;
According to the state of the movable display device detected by the detection means, the second imaging means acquires the photographer's face recognition image, and performs the face recognition on the acquired image. An image pickup apparatus comprising: an image pickup means; and a control means for controlling the recognition means.   When the control unit detects that the state of the movable display device has changed by the detection unit, the control unit acquires the photographer's face recognition image by the second imaging unit, and the acquired image The imaging apparatus according to claim 5, wherein the second imaging unit and the recognition unit are controlled so as to perform face recognition.   The imaging device according to claim 5, wherein the detection unit detects a movement of the movable display device.   When the detection means detects the movement of the movable display device, the control means performs the photographing of the photographer's face recognition image by the second imaging means and the face recognition for the photographed image. The imaging apparatus according to claim 7, wherein the second imaging unit and the recognition unit are controlled so as to be performed until face recognition by the recognition unit is successful. First imaging means for imaging a main subject;
A second imaging means for photographing a photographer who operates the first imaging means;
A movable display device that displays an image captured by the first imaging unit and the second imaging unit, and the second imaging unit is disposed on the movable display device. And
Recognition means for performing face recognition on the photographer's face recognition image captured by at least the second imaging means;
Detecting means for detecting the state of the movable display device;
Discriminating means for discriminating the state of the photographer in the face recognition image of the photographer photographed by the second imaging means;
Warning means for issuing a predetermined warning when face recognition by the recognition means is not successful;
It is determined whether to perform discrimination by the discrimination unit or face recognition by the recognition unit according to the result of the detection unit, and whether to perform face recognition by the recognition unit according to the result of the discrimination unit or by the warning unit An image pickup apparatus comprising: control means for determining whether to perform a warning.   The control means performs face recognition by the recognition means when the detection means detects that the movable display device is housed in the main body of the imaging device, and the detection means performs the movable display. 10. The recognizing unit and the determining unit are controlled so as to perform determination by the determining unit when it is detected that the apparatus is not stored in a main body of the imaging apparatus. Imaging device.   11. The determination unit according to claim 9, wherein the determination unit determines whether or not the photographer's face in the image for recognizing the photographer's face photographed by the second imaging unit is a front face. Imaging device.   The imaging apparatus according to claim 11, wherein the determination unit determines whether or not the photographer's face is a front face by detecting a line of sight.   The control means performs face recognition by the recognition means when the determination means determines that the photographer's face is a front face, and the determination means determines that the photographer's face is not a front face. The imaging apparatus according to claim 11 or 12, wherein the recognition unit and the warning unit are controlled so that a warning is sometimes issued by the warning unit.   The warning means issues a warning for guiding the photographer to face the photographer in the direction of the second imaging means. The imaging device described in 1.

Images