JP2016012845A - Imaging apparatus, method for controlling the same, and control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display a sub-window for displaying an in-image, without influencing on a face existing in a main image, even when a plurality of faces exist in the main image.SOLUTION: A main camera part 101 images an object, to obtain the main image and an in-camera part 107 images a photographer, to obtain the in-image. When displaying a window for displaying the in-image on the main image displayed in a display part 115, a system control part 118 detects a face area in each of the main image and the in-image by image processing parts 106 and 112. The system control part obtains the position and size of the face area in the main image and the size of the face area in the in-image and controls the position and size of the window, according to the position and size of the face area in the main image and the size of the face in the in-image.

Description

  The present invention relates to an imaging apparatus, a control method thereof, and a control program, and more particularly to display control when displaying an image obtained as a result of imaging.

  In recent years, in an imaging apparatus such as a digital camera, a first imaging unit (hereinafter referred to as a main camera) for capturing a main subject and a second imaging unit (hereinafter referred to as an in-camera) for capturing a photographer. There is something to prepare. In such an image pickup apparatus, when an image obtained by each of the main camera and the in-camera is displayed on one display device, an image obtained by the in-camera (referred to as an in-camera image) is obtained by the main camera. A sub window is displayed on an image (hereinafter referred to as a main camera image).

  However, the sub window is displayed in a predetermined area on the main camera image (that is, on the display screen) regardless of the main camera image. For this reason, the main subject (for example, face) in the sub window and the main camera image may overlap, and the face of the main subject may not be visible.

  In order to deal with such a situation, there is a technique in which a sub window is displayed by searching for an area that does not overlap the face of the main subject (see Patent Document 1).

JP 2001-188525 A

  However, in the display method described in Patent Document 1 described above, if a large number of faces exist in the main camera image, there may be no area for displaying the subwindow on the display screen.

  Therefore, an object of the present invention is to display a sub-window for displaying an in-camera image without affecting the faces existing in the main camera image even when there are a plurality of faces in the main camera image. An imaging apparatus, a control method thereof, and a control program are provided.

  In order to achieve the above object, an imaging apparatus according to the present invention includes a first imaging unit that captures a subject and obtains a first image, and a second that captures a photographer other than the subject and obtains a second image. And an imaging device that displays the second image superimposed on the first image displayed on the display unit, wherein a predetermined part of the first image is defined as the first part. Detecting means for detecting as a part of the first part, and control means for controlling a position at which the second image is superimposed on the first image according to the position of the first part. When a plurality of the first parts are detected in the first image, the control unit superimposes the second image on the first image according to the priority of the plurality of the first parts. The position is controlled.

  The control method according to the present invention includes a first imaging unit that captures a subject and obtains a first image, and a second imaging unit that captures a photographer other than the subject and obtains a second image, A method for controlling an imaging apparatus that displays a second image superimposed on the first image displayed on a display unit, wherein a predetermined part of the first image is detected as a first part. A detection step; and a control step for controlling a position at which the second image is superimposed on the first image according to the position of the first part. In the control step, the detection step When a plurality of the first parts are detected in the first image, controlling a position at which the second image is superimposed on the first image according to the priority of the plurality of first parts. It is characterized by.

  The control program according to the present invention includes a first imaging unit that captures a subject and obtains a first image, and a second imaging unit that captures a photographer other than the subject and obtains a second image, A control program for use in an imaging apparatus that displays the second image superimposed on the first image displayed on the display unit, the computer program included in the imaging apparatus, wherein the first image is predetermined. Detecting a detected part as a first part, and a control step for controlling a position at which the second image is superimposed on the first image according to the position of the first part, In the control step, when a plurality of the first parts are detected in the first image by the detection step, the second image is converted into the first image according to the priority of the plurality of first parts. Overlaid on one image And controlling the.

  According to the present invention, when controlling the position at which the second image is superimposed on the first image in accordance with the position of the first part (for example, the face) in the first image, When the first part is detected, the position at which the second image is superimposed on the first image is controlled according to the priority of the plurality of first parts. As a result, even when there are a plurality of faces in the first image, the sub-window can be displayed without affecting the faces existing in the first image.

It is a figure which shows the external appearance about an example of the imaging device by the 1st Embodiment of this invention, (a) is the figure seen from the back surface, (b) is the figure seen from the front surface. It is a block diagram which shows the example about the structure of the camera shown in FIG. 3 is a flowchart for explaining an example of the operation of the camera shown in FIG. 2. It is a figure for demonstrating the state which displayed on the display part the image obtained by imaging | photography with the main camera part shown in FIG. 1, and the image acquired by the in-camera part, (a) is an example of a display state (B) is a figure which shows the other example of a display state. FIG. 4 is a flowchart for explaining photographing mode processing shown in FIG. 3. FIG. 6 is a flowchart for explaining a sub-window size calculation process shown in FIG. 5. It is a flowchart for demonstrating the area | region weighting process shown in FIG. It is a flowchart for demonstrating the subwindow display position determination process shown in FIG. It is a flowchart for demonstrating the reproduction | regeneration mode process shown in FIG. It is a flowchart for demonstrating the area | region weighting process performed in the 2nd Embodiment of this invention.

  Hereinafter, an example of an imaging apparatus according to an embodiment of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a diagram showing an appearance of an example of an imaging apparatus according to the first embodiment of the present invention. FIG. 1A is a view from the back, and FIG. 1B is a view from the front.

  The illustrated imaging apparatus is, for example, a digital camera (hereinafter simply referred to as a camera) 201, and a display unit 202 is disposed on the back side thereof (see FIG. 1A). The display unit 202 is, for example, a liquid crystal display, and an image and various types of information are displayed on the display unit 202.

  A shutter button 203 and a power switch 206 are disposed on the upper surface of the camera 201. A power switch 206 is used when turning on or off the power of the camera 201. Then, a shooting instruction is performed by operating the shutter button 203.

  A mode changeover switch 204 is arranged on the upper right side of the display unit 202. A mode change switch 204 is used when changing various modes in the camera 201. An operation unit 205 is arranged on the right side of the display unit 202. The operation unit 205 includes various switches and buttons for receiving various user operations. An in-camera unit 207, which is a second imaging unit, is arranged on the upper side of the display unit 202, and a photographer who is a user other than the subject is photographed by the in-camera unit 207.

  On the front side shown in FIG. 1B, the camera 201 has a main camera unit 208 which is a first imaging unit. The main subject is photographed by the main camera unit 208. The main camera unit 208 includes a zoom mechanism for zooming in or zooming out the main subject.

  FIG. 2 is a block diagram showing an example of the configuration of the camera 201 shown in FIG.

  As described above, the camera 201 has a main camera unit and an in-camera unit. In FIG. 2, reference numbers 101 and 107 are assigned to the main camera unit and the in-camera unit, respectively. The main camera unit 101 includes a photographing lens unit (hereinafter simply referred to as a photographing lens) 102, and the photographing lens 102 includes a zoom lens and a focus lens.

  A mechanical mechanism unit 103 is disposed following the photographing lens 102. The mechanical mechanism unit 103 enlarges or reduces the subject image incident through the photographing lens 102 and forms it on the image sensor 104. The mechanical mechanism unit 103 includes a zoom mechanism for driving the photographing lens 102, a diaphragm mechanism for controlling the amount of light, and a shutter mechanism for blocking light during photographing.

  An imaging element 104 such as a CMOS image sensor is disposed at the subsequent stage of the mechanical mechanism unit 103. The image sensor 104 outputs an electrical signal (analog signal) corresponding to the formed subject image. An analog signal that is an output of the image sensor 104 is sent to the A / D converter 105. The A / D converter 105 converts the analog signal into a digital signal and sends it to the image processing unit 106.

  The image processing unit 106 performs predetermined resizing processing such as pixel interpolation and reduction, and color conversion processing on the digital signal sent from the A / D converter 105 or the image data sent from the memory control unit 113. Further, the image processing unit 106 performs face detection processing for detecting a human face area in the image data obtained as a result of imaging.

  Similarly, the in-camera unit 107 includes a photographing lens 108, a mechanical mechanism unit 109, and an image sensor 110. The analog signal that is the output of the image sensor 110 is converted into a digital signal by the A / D converter 111. The image processing unit 112 performs predetermined pixel interpolation, resizing processing such as reduction and color conversion processing on the digital signal sent from the A / D converter 111 or the image data sent from the memory control unit 113. Note that the image processing unit 112 performs face detection processing for detecting a human face area in the image data obtained as a result of imaging.

  The digital signal that is the output of the A / D converter 105 is directly written into the memory 114 as image data via the image processing unit 106 and the memory control unit 113 or via the memory control unit 113. Similarly, the digital signal that is the output of the A / D converter 111 is directly written into the memory 114 as image data via the image processing unit 112 and the memory control unit 113 or via the memory control unit 113.

  In the following description, image data obtained by the main camera 101 is called main image data or main image, and image data obtained by the in camera 107 is called in-image data or in-image.

  The memory 114 stores the above-described main image data and in-image data, and also stores display image data to be displayed on the display unit 115. The memory 114 has a sufficient storage capacity for storing a predetermined number of still images or a moving image for a predetermined time, and audio. The memory 114 also serves as an image display memory (video memory).

  Under the control of the system control unit 118, the memory control unit 113 converts the display image data stored in the memory 114 by the D / A converter 116 into an analog signal and sends it to the display unit 115. As a result, the display image data stored in the memory 114 is displayed as an image on the display unit 115 via the D / A converter 116.

  The display unit 115 (shown by the display unit 202 in FIG. 1) is, for example, an LCD, and displays an image corresponding to an analog signal that is an output of the D / A converter 116. The main image data or in-image data stored in the memory 114 is converted into an analog signal by the D / A converter 116, and the analog signal is sequentially transferred to the display unit 115 for display, thereby displaying a through image ( (Hereinafter also referred to as live view display). That is, it functions as a so-called electronic viewfinder at the time of shooting.

  The nonvolatile memory 117 is an electrically erasable and recordable memory. For example, an EEPROM is used. The nonvolatile memory 117 stores constants and programs for operating the system control unit 118. This program includes a program for executing various flowcharts to be described later.

  The system control unit 118 controls the entire camera 201. For example, the system control unit 118 performs a process described later by executing a program recorded in the nonvolatile memory 117.

  The memory 114 is, for example, a RAM, and constants and variables for operation of the system control unit 118, a program read from the nonvolatile memory 117, and the like are expanded in the memory 114. The system control unit 118 controls the memory 114, the D / A converter 116, the display unit 115, and the like to perform display control.

  The operation unit 119 illustrated in FIG. 2 includes the shutter button 203, the power switch 206, the mode change switch 204, and the operation unit 205 illustrated in FIG. The mode switch is used when the operation mode of the system control unit 118 is switched to, for example, one of the shooting mode and the playback mode. The shooting modes include, for example, a still image shooting mode and a moving image shooting mode. In the shooting mode, live view display is performed by the display unit 115. In the reproduction mode, a captured image (main image and / or in-image) is displayed on the display unit 115 for viewing.

  The still image shooting mode includes an auto shooting mode, an auto scene discrimination mode, a manual mode, various scene modes for shooting settings for each shooting scene, a program AE mode, a custom mode, and the like.

  These modes included in the still image shooting mode are switched by, for example, a mode switch. It should be noted that after switching to the still image shooting mode once using the mode switch, the mode is switched to one of these modes included in the still image shooting mode using another operation member provided in the operation unit 119. Also good. Also, the moving image shooting mode may include a plurality of modes.

  The shutter button provided in the operation unit 119 has a first shutter switch and a second shutter switch. When the shutter button is in a half-pressed state during the operation (shooting preparation instruction), the first shutter switch is turned on, and the first shutter switch signal SW1 is sent to the system control unit 118.

  In response to the first shutter switch signal SW1, the system control unit 118 starts AF (autofocus) processing, AE (automatic exposure) processing, AWB (auto white balance) processing, EF (flash preflash) processing, and the like. To do.

  When the operation of the shutter button is completed, that is, in the so-called fully depressed state (shooting instruction), the second shutter switch is turned on, and the second shutter switch signal SW2 is sent to the system control unit 118.

  In response to the second shutter switch signal SW2, the system control unit 118 starts a series of shooting processes (main shooting) from reading signals in the image sensors 104 and 110 to writing image data in the recording medium 120.

  By the way, by selecting and operating various function icons displayed on the display unit 115, functions are appropriately assigned to the operation unit 119 for each scene (shooting scene), and the buttons function as various function buttons. Examples of the function buttons include an end button, a return button, an image advance button, a jump button, a narrowing button, and an attribute change button. For example, when a menu button is operated, a menu screen on which various settings can be made is displayed on the display unit 115. The user can make various settings intuitively by using the menu screen displayed on the display unit 115 and the up / down / left / right four-way buttons and the SET button provided on the operation unit 119.

  The power supply unit 121 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, and an AC adapter. The recording medium I / F 122 is an interface with the recording medium 120 such as a memory card or a hard disk. An image obtained as a result of shooting is recorded on the recording medium 120, and is composed of, for example, a semiconductor memory or a magnetic disk.

  The above-described camera 201 can perform photographing using so-called center single point AF or face AF. In the central one-point AF, AF is performed on one central position on the shooting screen. In face AF, AF is performed on the face area on the shooting screen detected by face detection.

  Here, face detection in the camera 201 will be described. In the face detection, when detecting the face area that is the first part of the main image data, the image data to be detected by the face is sent from the system control unit 118 to the image processing unit 106. Similarly, when detecting the face area which is the second part of the in-image data, the image data to be detected by the face is sent from the system control unit 118 to the image processing unit 112. Since the face detection processing in the image processing units 106 and 112 is the same, here, the face detection processing will be described by paying attention to the image processing unit 106.

  As described above, at the time of face detection, the system control unit 118 sends the image data to be detected to the image processing unit 106. Under the control of the system control unit 118, the image processing unit 106 performs horizontal bandpass filter processing on the image data. Then, the image processing unit 106 performs vertical bandpass filter processing on the image data that has been subjected to horizontal bandpass filter processing. The edge component of the image data is detected by these horizontal and vertical band pass filter processes.

  Thereafter, the system control unit 118 performs a pattern matching process on the detected edge component to extract a candidate group of eyes, nose, mouth, and ears. Then, the system control unit 118 determines an eye pair that satisfies a preset condition (for example, the distance and inclination of two eyes) from the extracted eye candidate group, and sets the eye pair. Narrow down the candidate group of only those with.

  The system control unit 118 associates the narrowed-down eye candidate group with the other parts (nose, mouth, ears) that form the corresponding face, and performs a preset non-face condition filtering process to determine the face region. To detect.

  The face detection performed by the system control unit 118 is performed not only for one face area but also for a plurality of face areas. The system control unit 118 generates face information indicating the face area according to the face detection result.

  In this way, image data that is displayed in live view or reproduced and displayed is subjected to image analysis to obtain face information that is one piece of subject information indicating the feature amount of the image data. Subject or photographer). Although face information has been described as an example of subject information, the subject information includes various information obtained by red-eye determination, eye detection, eye-brow detection, or smile detection in addition to face information. is there.

  FIG. 3 is a flowchart for explaining an example of the operation of the camera 201 shown in FIG. Note that the processing according to the illustrated flowchart is performed under the control of the system control unit 118.

  Here, it is assumed that the camera 201 operates in any one of the “shooting mode and playback mode”. As described above, in the shooting mode, live view display is performed on the display unit 115, and shooting is performed by operating the shutter button. On the other hand, in the playback mode, captured image data stored in the recording medium 120 is played back and displayed on the display unit 115 as an image for viewing.

  When the camera operation is started, the system control unit 118 determines whether or not the camera 201 is in the shooting mode according to the position of the mode switch (step S301). When the camera 201 is in the shooting mode (YES in step S301), the system control unit 118 performs shooting mode processing described later (step S302).

  On the other hand, if the camera 201 is not in the shooting mode (NO in step S301), the system control unit 118 determines that the camera 201 is in the playback mode. Then, the system control unit 118 performs a playback mode process described later (step S303).

  After the process of step S302 or S303, the system control unit 118 determines whether to shut down the camera operation (step S304). If it is determined that the camera operation is to be shut down (YES in step S304), system control unit 118 ends the camera operation. If it is determined not to shut down the camera operation (NO in step S304), system control unit 118 returns to the process in step S301. For example, when the power switch 206 is operated, the system control unit 118 determines to shut down the camera operation.

  FIG. 4 is a diagram for explaining a state in which an image obtained by photographing with the main camera unit 208 shown in FIG. 1 and an image obtained by photographing with the in-camera unit 207 are displayed on the display unit 202. FIG. 4A is a diagram illustrating an example of a display state, and FIG. 4B is a diagram illustrating another example of the display state.

  4, it is assumed that a screen (also referred to as a main window) 401 is currently displayed on the display unit 202 (the display unit 115 in FIG. 2). The screen 401 displays a main image and an in-image. In the main image, there are human faces 402 and 403 that are main subjects. A sub window 404 is displayed on the screen 401, and the in-image is displayed in the sub window 404. The photographer 405 is present in the in-image.

  As described above, the display unit 202 displays a composite image in which the main image and the in-image are combined.

  As will be described later, when a human face is present in the main image, the system control unit 118 changes the position of the sub window 404 on the screen 401 according to the positions and sizes of the faces 402 and 403, for example.

  In the example shown in FIG. 4A, a sub window 404 is displayed at the left corner of the screen 401 that is a position where the faces 402 and 403 are avoided. On the other hand, in the example shown in FIG. 4B, a sub window 404 is displayed at the right corner of the screen 401 where the faces 402 and 403 are avoided. As described above, the system control unit 118 displays the sub window 404 at a position that does not affect the faces 402 and 403 in accordance with the positions and sizes of the faces 402 and 403 in the main image.

  FIG. 5 is a flowchart for explaining the shooting mode processing shown in FIG.

  When the shooting mode processing is started, the image processing unit 112 performs face detection processing on the in-image under the control of the system control unit 118 (step S501). Then, the system control unit 118 determines whether or not a face has been detected in the in-image according to the face detection result obtained as a result of the face detection process (step S502).

  When a face is detected in the in-image (YES in step S502), the system control unit 118 determines whether or not to perform a zoom operation on the main camera unit 101 (step S503). If the zoom operation is not performed for the main camera unit 101 (NO in step S503), the system control unit 118 performs a size calculation process for calculating the size of the subwindow as described later (step S504).

  Subsequently, the system control unit 118 controls the image processing unit 106 to perform face detection processing on the main image (step S505). Then, the system control unit 118 determines whether a face is detected in the main image according to the face detection result obtained as a result of the face detection process. Thereafter, the system control unit 118 performs area weighting processing on the area of the main image as described later (step S506).

  Subsequently, as will be described later, the system control unit 118 determines a sub-window for determining in which region on the screen (that is, on the main image) the display position of the sub-window displayed on the display unit 115 is to be displayed. Display position determination processing is performed (step S507). Then, the system control unit 118 stores the display position of the sub window obtained by the display position determination process in the memory 114 in association with the main image and the in-image (step S508).

  Note that when the main image and the in-image are stored in the storage medium 120, information indicating the display position of the sub window (referred to as state information) is stored in the storage medium 120.

  Subsequently, the system control unit 118 synthesizes the sub window with the main image according to the display position of the sub window and displays it on the display unit 115 (step S509). Then, the system control unit 118 determines whether or not to end the shooting mode process (step S510).

  If it is determined that the shooting mode process is to be ended (YES in step S510), system control unit 118 ends the shooting mode process. On the other hand, if it is determined to continue the shooting mode process (NO in step S510), system control unit 118 maintains the current display position of the subwindow for a predetermined time (step S511), and returns to the process of S501.

  If no face is detected in the in-image (NO in step S502), system control unit 118 hides the sub-window (step S512). Then, the system control unit 118 stores non-display information indicating non-display of the subwindow in the memory 114 in association with the main image and the in-image (step S513). Thereafter, the system control unit 118 proceeds to the process of step S10.

  Note that when the main image and the in-image are stored in the storage medium 120, non-display information indicating non-display of the subwindow is stored in the storage medium 120.

  When performing a zoom operation on main camera unit 101 (YES in step S503), system control unit 118 determines the size and display position of the subwindow to be a preset size and position (step S514). Then, the system control unit 118 proceeds to the process of step S508.

  FIG. 6 is a flowchart for explaining the sub-window size calculation processing shown in FIG.

  When the sub window size calculation process is started, the system control unit 118 determines whether or not the number of face areas in the in-image is two or more (step S601). If the number of face areas in the in-image is two or more (YES in step S601), system control unit 118 extracts the face area having the largest size among the face areas as an extracted face area (step S602).

  Subsequently, the system control unit 118 calculates a ratio of the extracted face area in the in-image as an occupation ratio (step S603). Then, the system control unit 118 determines the size of the subwindow to a preset size according to the occupation ratio (step S604). Thereafter, the system control unit 118 ends the sub window size calculation process.

  On the other hand, if the number of face areas in the in-image is one (NO in step S601), the system control unit 118 proceeds to the process in step S603 and occupies one face area in the in-image for the in-image. Calculate the percentage.

  FIG. 7 is a flowchart for explaining the area weighting process shown in FIG.

  When the area weighting process is started, the system control unit 118 calculates the size of each face area detected in the main image (step S701). Then, the system control unit 118 determines weighting factors in descending order of the size of the face area (step S702). That is, the system control unit 118 selects a weighting coefficient that is set in advance according to the size of each face area.

  Subsequently, the system control unit 118 determines whether or not there is an overlapping region in which the facial regions at least partially overlap each other in the main image (step S703). If there is an overlapping area (YES in step S703), system control unit 118 determines that the overlapping area belongs to the face area having the largest size in the overlapping face area (step S704).

  Next, the system control unit 118 performs weighting processing by multiplying each of the face regions by the weighting coefficient determined in step S702 (step S705). Then, the system control unit 118 ends the area weighting process. If there is no overlapping area (NO in step S703), system control unit 118 proceeds to the process in step S705.

  FIG. 8 is a flowchart for explaining the sub-window display position determination process shown in FIG.

  When the sub-window display position determination process is started, the system control unit 118 determines whether or not there is an area in which the sub-window can be displayed for an unweighted area in the main image subjected to the area weighting process (step S801). . If there is no area in which the sub-window can be displayed in the unweighted area (NO in step S801), the system control unit 118 determines a preset weighting coefficient according to the size of the sub-window (step S802). Then, the system control unit 118 weights the size of the subwindow with the weighting coefficient.

  Subsequently, the system control unit 118 determines whether or not there is an area whose weight is lower than that of the sub window weighted in step S802 and the sub window can be displayed (step S803). If the weighting is lower than the weighted subwindow or if there is no area in which the subwindow can be displayed (NO in step S803), system control unit 118 increases the weighting coefficient at a predetermined rate. That is, the system control unit 118 increases the weighting coefficient, and weights the size of the subwindow with the weighting coefficient. Then, the system control unit 118 returns to the process of step S803.

  If there is an area where the weight is lower than the weighted subwindow and the subwindow can be displayed (YES in step S803), system control unit 118 determines the area as the display position of the subwindow (step S805). Then, the system control unit 118 ends the sub window display position determination process.

  If there is an area in which the sub window can be displayed in the unweighted area (YES in step S801), the system control unit 118 proceeds to the process in step S805 and determines the area as the display position of the sub window. At this time, when there are a plurality of regions, the system control unit 118 determines the region having the largest area as the display position of the sub window.

  FIG. 9 is a flowchart for explaining the playback mode processing shown in FIG.

  When the reproduction mode process is started, the system control unit 118 determines whether or not the sub window status information is recorded in association with the image recorded in the storage medium 120 (step S901). When the sub window status information is recorded (Yes in step S901), the system control unit 118 reads the main image and the in-image from the storage medium 120 by the memory control unit 113. Then, the system control unit 118 displays the main image on the display unit 115, displays the sub window on the main image according to the state information of the sub window, and displays the in-image on the sub window (step S902). Thereafter, the system control unit 118 ends the playback mode process.

  If the sub window status information is not recorded (NO in step S901), the system control unit 118 reads the main image and the in-image from the storage medium 120. Then, the system control unit 118 performs processing similar to the shooting mode processing described with reference to FIG. 5, and displays a sub window on the main image (step S903). Thereafter, the system control unit 118 ends the playback mode process.

  As described above, in the first embodiment of the present invention, when a plurality of faces exist in the main image, the face and the sub window in the first image are weighted. That is, priority is given to the face and the subwindow in the first image, and the subwindow is displayed in the area of the main image. As a result, the sub-window can be displayed in an area having the least influence in the main image.

[Second Embodiment]
Next, an example of a camera according to the second embodiment of the present invention will be described. The configuration of the camera according to the second embodiment is the same as that of the camera shown in FIGS. The camera according to the second embodiment performs the camera operation as described in FIG. 3 in the first embodiment. However, only the area weighting process is different from the first embodiment in the second embodiment.

  FIG. 10 is a flowchart for explaining region weighting processing performed in the second embodiment of the present invention. In the illustrated flowchart, the same steps as those in the flowchart shown in FIG.

  When the area weighting process is started, the system control unit 118 performs the processes of steps S701 to S705 described with reference to FIG. After the process of step S705, under the control of the system control unit 118, the image processing unit 106 performs smile detection on the main image and obtains a smile detection result. The system control unit 118 determines whether a smile is detected according to the smile detection result (step S1001).

  If a smile is not detected (NO in step S1001), system control unit 118 ends the area weighting process. On the other hand, when a smile is detected (YES in step S1001), system control unit 118 further performs a predetermined weighting process on the area including the face area where the smile is detected (step S1002). Then, the system control unit 118 ends the area weighting process.

  Thus, when a smile is detected in the second embodiment of the present invention. Increase the priority of smiles. As a result, even if the size of the smile is small, it is possible to avoid that the smile is affected by the display of the subwindow.

  As is clear from the above description, in the example shown in FIG. 2, the image processing units 106 and 112 function as detection means, and the system control unit 118 functions as control means. The image processing unit 106 and the system control unit 118 function as a determination unit, and the system control unit 118 functions as a zoom unit.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to these embodiment, Various forms of the range which does not deviate from the summary of this invention are also contained in this invention. .

  For example, the function of the above embodiment may be used as a control method, and this control method may be executed by the imaging apparatus. Further, a program having the functions of the above-described embodiments may be used as a control program, and the control program may be executed by a computer included in the imaging apparatus. The control program is recorded on a computer-readable recording medium, for example.

  Each of the above control method and control program has at least a detection step and a control step.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various recording media, and the computer (or CPU, MPU, etc.) of the system or apparatus reads the program. To be executed.

DESCRIPTION OF SYMBOLS 101 Main camera part 104,110 Image pick-up element 105,111 A / D converter 106,112 Image processing part 107 In-camera part 113 Memory control part 114 Memory 115 Display part 118 System control part 120 Storage medium

Claims (13)

A first imaging unit that captures a subject and obtains a first image; and a second imaging unit that captures a photographer other than the subject and obtains a second image, and is displayed on a display unit. An imaging device that displays the second image superimposed on a first image,
Detecting means for detecting a predetermined part in the first image as the first part;
Control means for controlling a position at which the second image is superimposed on the first image according to the position of the first part,
When the plurality of first parts are detected in the first image by the detection means, the control means displays the second image in the first image according to the priority of the plurality of first parts. An image pickup apparatus that controls a position to be superimposed on one image.   The imaging apparatus according to claim 1, wherein the control unit controls a position at which the second image is superimposed on the first image according to a position and a size of the first part. The detecting means detects a predetermined part in the first image as a first part and detects a predetermined part in the second image as a second part;
The control means displays the second image according to the position and size of the first part detected by the detection means and the size of the second part detected by the detection means. The imaging apparatus according to claim 1, wherein a position to be superimposed on an image is controlled.   When a plurality of the first parts are detected in the first image by the detection means, the control means gives priority to the first part having a larger size among the plurality of first parts, The imaging apparatus according to claim 3, wherein a position at which the second image is superimposed on the first image is controlled according to the priority.   The control unit controls the size of a window displayed when the second image is superimposed on the first image, according to the size of the second part detected by the detection unit. The imaging apparatus according to claim 3 or 4. The control means determines the size of a window displayed when the second image is superimposed on the first image, according to the size of the second part detected by the detection means,
When the detection unit detects a plurality of the first portions in the first image, the control unit gives priority to a larger size of the size of each of the first portions and the size of the window. The imaging apparatus according to claim 3, wherein the position of the window is controlled based on the priority.   When the plurality of first parts are detected in the first image by the detection means, the control means is configured to select a first part having the largest size among the plurality of first parts. The imaging apparatus according to claim 6, wherein a size of the window is controlled.   The imaging apparatus according to claim 3, wherein each of the first part and the second part is a face region. The first part is a face region;
Determining means for determining whether or not the first part is a smile;
The imaging device according to claim 1, wherein the control unit increases the priority of the first part determined to be a smile by the determination unit. Zoom means for zooming the first imaging means;
When the zoom operation is being performed, the control means sets the size and position of the window displayed when the second image is superimposed on the first image to a predetermined size and position. The imaging apparatus according to any one of claims 1 to 9, wherein   The control means hides a window displayed when the second image is superimposed on the first image when the second part is not detected by the detection means. The imaging device according to any one of 3 to 8. A first imaging unit that captures a subject and obtains a first image; and a second imaging unit that captures a photographer other than the subject and obtains a second image, and is displayed on a display unit. A method for controlling an imaging apparatus that displays a second image superimposed on a first image, the method comprising:
A detecting step of detecting a predetermined part in the first image as the first part;
And a control step for controlling a position at which the second image is superimposed on the first image according to the position of the first part,
In the control step, when a plurality of the first parts are detected in the first image by the detection step, the second image is converted into the first image according to the priority of the plurality of first parts. A control method characterized by controlling a position to be superimposed on one image. A first imaging unit that captures a subject and obtains a first image; and a second imaging unit that captures a photographer other than the subject and obtains a second image, and is displayed on a display unit. A control program used in an imaging apparatus that displays the second image superimposed on a first image,
In the computer provided in the imaging device,
A detecting step of detecting a predetermined part in the first image as the first part;
And a control step for controlling a position at which the second image is superimposed on the first image according to the position of the first part,
In the control step, when a plurality of the first parts are detected in the first image by the detection step, the second image is converted into the first image according to the priority of the plurality of first parts. A control program for controlling a position to be superimposed on one image.

Images