JP6289037B2 - IMAGING DEVICE AND IMAGING DEVICE CONTROL METHOD - Google Patents

Description

The present invention relates to an imaging apparatus and a method for controlling the imaging apparatus , and more particularly, to a technique suitable for combining image data captured by both an out-camera and an in-camera.

  2. Description of the Related Art Conventionally, an imaging apparatus is an apparatus for a photographer to operate a subject to photograph the subject and create photographing data of the subject. However, in recent years, in order to reflect not only the image of the subject but also the state of the photographer in the image, an imaging device that includes a rear imaging unit, and that combines the image captured by the front imaging unit and the image captured by the rear imaging unit Is known (see, for example, Patent Document 1). This makes it possible to further improve the enjoyment of the viewer by recording actions such as the photographer's facial expression and gesture when shooting at the same time in the shooting data and reproducing it during viewing.

JP 2010-3201 JP

  However, in the related art disclosed in the above-mentioned Patent Document 1, when shooting is performed without the photographer being within the angle of view of the rear imaging unit, the photographer is not recorded in the shooting data, and the synthesis process is performed as it is. In this case, a wasteful part occurs in the photographing data.

This is because, for example, when the photographer raises the image pickup apparatus upward and takes a picture from above, or when taking the picture while holding the image pickup apparatus downward, the photographer is not recorded in the shooting data.
The present invention has been made in view of the above-described problems, and an object of the present invention is to prevent a shooting failure in a rear imaging unit when shooting both shooting data using a front imaging unit and a rear imaging unit.

An imaging apparatus according to the present invention is an imaging apparatus including a first imaging unit for photographing a subject side and a second imaging unit for photographing a photographer side , wherein the second imaging unit A face detection unit that performs face detection on the captured image data, image data captured by the first image capturing unit, and image data captured by the second image capturing unit are combined. a synthesis processing unit, when the face Ri by said face detecting means for capturing image data is not detected by the second imaging means, and warning means for performing warning display to the photographer, the second imaging Selecting means capable of selecting whether or not to execute the combining process when performing a photographing operation when no face is detected in the image data photographed by the means .

  According to the present invention, when the face of the rear imaging unit is not detected, the photographer is urged to warn, so that it is possible to prevent a shooting failure by the rear imaging unit.

It is a figure which shows the whole imaging device. It is a block diagram explaining the structural example of a digital camera. It is a flowchart explaining the imaging | photography procedure of the composite image processing mode of 1st Embodiment. It is a figure explaining the composite image process of embodiment, and is a figure explaining the example in case a photographer's face is detectable in the image data of a back imaging part. It is a figure explaining the composite image process of embodiment, and is a figure explaining the example when a photographer's face cannot be detected in the image data of a back imaging part. It is a figure explaining the composite image process of embodiment, and is a figure explaining the example which prevents the failure of imaging | photography by a back imaging part by alerting a photographer. It is a flowchart explaining the imaging | photography procedure of the composite image processing mode of 2nd Embodiment. It is a figure explaining the composite image process of 2nd Embodiment, and is a figure which shows a mode that it deviated from the angle of view and face detection changed from the detection state to the non-detection state. 10 is a flowchart illustrating a shooting procedure in a composite image processing mode according to the third embodiment. It is a flowchart explaining the imaging | photography procedure of the composite image processing mode of 4th Embodiment.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
<First Embodiment>
Hereinafter, a first embodiment of the present invention will be described with reference to FIGS. Here, a digital camera will be described as an example of an imaging apparatus. FIG. 1 is a diagram illustrating the entire imaging apparatus.
In FIG. 1, reference numeral 1 denotes a digital camera. 10 is a front imaging unit, and 15 is a rear imaging unit. The front imaging unit 10 is an imaging unit that captures a subject intended by the photographer, and the rear imaging unit 15 is an imaging unit that captures the photographer.

  Reference numeral 2 denotes a power button. The power button 2 is used to operate the imaging apparatus body (digital camera) 1 to be turned on and off. In the front imaging unit 10, the lens barrel 12 is stored in the front cover 8 when the digital camera 1 is powered off. When the power of the digital camera 1 is turned on, the lens barrel portion 12 is drawn out by a driving unit (not shown) and protrudes (the state shown in FIG. 1), and is ready for photographing.

  3 is a release button, and 4 is a zoom lever. In the photographing enabled state, the angle of view of the photographing data is determined by operating the telephoto and wide angle of the lens barrel 12 with the zoom lever 4, and the data is recorded by pressing the release button 3. Reference numeral 6 denotes an operation button, and each setting of the digital camera 1 is operated by the operation button 6. Reference numeral 5 denotes a display unit that displays shooting data picked up by the front image pickup unit 10 and the rear image pickup unit 15 in a shooting enabled state, and in a playback mode, a recording medium in a card slot 7 provided in the digital camera 1 described later. The image data photographed in 9 is reproduced.

Hereinafter, the captured image processing of the digital camera 1 of the present embodiment will be described with reference to FIGS.
FIG. 2 is a block diagram illustrating a configuration example of the digital camera 1. The front imaging unit 10 and the rear imaging unit 15 are provided with a first AF unit 11 and a second AF unit 16, respectively. By pressing the release button 3 halfway, the first AF unit 11 and the second AF unit 16 are driven by a driving device (not shown), and each subject is brought into focus.

  Each image data before being photographed by the front imaging unit 10 and the rear imaging unit 15 is always displayed as a live video on the display unit 5, and each image data is stored in the CPU 20 provided in the digital camera 1. Sent.

  The CPU 20 includes an image processing unit 21. The image data is sent to the image data acquisition unit 30, and whether there is a human face on the image data captured by the front imaging unit 10 and the rear imaging unit 15. Sent to the face detection unit 31 for determining whether or not. The CPU 20 includes a ROM and a RAM (not shown), and a program stored in the ROM is expanded in the RAM and executed, thereby realizing the processing of the flowchart of FIG. 3 to be described later.

  In the face detection unit 31, the data for which face detection is completed is sent to the determination unit 32. Details of the determination unit 32 will be described later. Shooting is performed by pressing the release button 3 described above from this state, and the image composition processing unit 33 performs image composition processing of the front image capturing unit 10 and the rear image capturing unit 15 to record in the card slot 7. Image data is recorded on the medium 9.

FIG. 3 is a flowchart for explaining a photographing procedure of the composite image processing mode photographing.
First, after starting the composite image mode for synthesizing the images of the front imaging unit 10 and the rear imaging unit 15 (S301), the process proceeds to the rear imaging unit face detection (S302). Here, the face detection unit 31 detects the photographer's face.

  Next, the flow proceeds to S303. In S303, it is determined whether or not the photographer's face can be detected in the image data of the rear imaging unit 15. When the determination unit 32 determines in S303 that the photographer's face can be detected in the image data of the rear imaging unit 15 (the state in FIG. 4A), the process proceeds to the shooting (S304) flow, and the front Image data of the imaging unit 10 and the rear imaging unit 15 is captured. Thereafter, the process proceeds to composite image data creation (S309), and the image composition processing unit 33 performs image data composition processing of the front imaging unit 10 and the rear imaging unit 15.

  The image data synthesized by the image synthesis processing unit 33 is displayed on the display unit 5 by the display image data generation unit 35 (state shown in FIG. 4B). At the same time, the image data synthesized by the image synthesis processing unit 33 is supplied to the recording image data generation unit 34 and recorded on the recording medium 9 in the card slot 7.

Next, the case where the rear imaging unit face detection is not detected in S303 will be described.
When the determination unit 32 determines that the photographer's face detection is not detected in the image data of the rear imaging unit 15 (the state in FIG. 5A), the process proceeds to S305. Here, a warning display is generated by the warning image data generation unit 36 and displayed on the display unit 5 (the state shown in FIG. 5B).

  Next, the process proceeds to S306 from this state, and it is determined whether or not the release button 3 has been pressed. If the release button 3 is not pushed, the process proceeds to S302 again, and the face detection of the rear imaging unit 15 is continued. Further, when the release button 3 is pressed in the state of S306 and the photographing operation is executed, the image data of the front imaging unit 10 and the rear imaging unit 15 is captured (S307).

  Next, the process proceeds to S308, where it is possible to select whether or not to perform composite image processing (the state of FIG. 5C). Here, when the photographer selects to perform the composite image processing, the process proceeds to S309, and the image composition processing unit 33 performs composition processing of the image data of the front imaging unit 10 and the rear imaging unit 15 (in FIG. 6A). State). The contents of the composite image data creation performed in S309 are as described above.

If it is selected not to perform the composite image processing in S308, the image data captured by the rear imaging unit 15 is discarded, and only the image data of the front imaging unit 10 is recorded (state in FIG. 6B).
As described above, when it is determined that the photographer's face detection result is not detected in the image data of the rear imaging unit 15, the warning image data generation unit 36 generates a warning display and prompts the photographer to give a warning. As a result, it is possible to prevent a shooting failure by the rear imaging unit 15.

<Second Embodiment>
Hereinafter, a second embodiment of the present invention will be described with reference to FIGS. 4, 7, and 8.
FIG. 7 is a flowchart for describing a photographing procedure of the composite image processing mode photographing according to the second embodiment. In the flowchart of FIG. 7, steps that perform the same processing as the steps of the flowchart of FIG. 3 described above are denoted by the same step numbers as the step numbers given in the flowchart of FIG. The CPU 20 includes a ROM and a RAM (not shown), and can be realized by developing a program stored in the ROM and executing the program.

  After starting the composite image mode for synthesizing the images of the front imaging unit 10 and the rear imaging unit 15 (S301), the process proceeds to the rear imaging unit face detection (S302). Here, the face detection unit 31 detects the photographer's face by the rear imaging unit 15.

  Next, the flow proceeds to S303. In S303, it is determined whether or not the photographer's face can be detected in the image data of the rear imaging unit 15. In S303, when the determination unit 32 determines that the photographer's face can be detected in the image data of the rear imaging unit 15 (the state in FIG. 4A), the process proceeds to S701.

(A) in FIG. 8 shows that the photographer's face has been detected, but the photographer's face has moved in the direction of arrow A, and is out of the angle of view of the rear imaging unit 15, and the face detection is not detected. It shows how it has reached the state.
In S701, it is determined whether or not the detection state is changed to the non-detection state. When it is determined that the face detection of the rear imaging unit 15 has shifted from the detection state to the non-detection state, the process proceeds to S702, and a warning is displayed on the display unit 5 so as not to deviate from the angle of view (FIG. 8 ( b)). In S304 to S309, the same processing as that in the flowchart of FIG.
In this way, it is possible to prevent failure of photographing by the rear imaging unit 15 by urging the photographer to warn.

<Third Embodiment>
Hereinafter, a third embodiment of the present invention will be described with reference to FIGS. 5, 6, and 9.
FIG. 9 is a flowchart for describing a photographing procedure in the composite image processing mode according to the third embodiment. In the flowchart of FIG. 9, steps that perform the same processing as the steps of the flowchart of FIG. 3 described above are denoted by the same step numbers as the step numbers given in the flowchart of FIG.
After starting the composite image mode for synthesizing the images of the front imaging unit 10 and the rear imaging unit 15 (S301), the process proceeds to the rear imaging unit face detection (S302). Here, the face detection unit 31 detects the photographer's face.

Next, the flow proceeds to S303. In S303, it is determined whether or not the photographer's face can be detected in the image data of the rear imaging unit 15.
When the determination unit 32 determines that the photographer's face detection is not detected in the image data of the rear imaging unit 15 in S303 (the state in FIG. 5A), the process proceeds to S305. Here, a warning display is generated by the warning image data generation unit 36 and displayed on the display unit 5 (the state shown in FIG. 5B).

  Next, the process proceeds to S306 from this state, and if the release button 3 is not pressed, the process proceeds to S302 again and the face detection of the rear imaging unit 15 is continued. Further, when the release button 3 is pressed in the state of S306, image data of the front imaging unit 10 and the rear imaging unit 15 is captured (S307).

When shooting is completed, the composite image processing mode is automatically canceled, and the image data composition processing by the image composition processing unit 33 is not executed (S901). In this case, the image data captured by the rear imaging unit 15 is discarded, and the recorded image data generation unit 34 records only the image data of the front imaging unit 10 on the recording medium 9 (state shown in FIG. 6B).
In this way, it is possible to prevent the failure of the composite image recorded on the recording medium 9 by automatically canceling the composite image mode when the photographer's face is not detected.

  In the embodiment described above, the image composition processing unit 33 performs image composition processing at the same time as the image data photographed by the front imaging unit 10 and the rear imaging unit 15 are photographed. However, the present invention is achieved. For example, there is no problem even if image data captured by the front imaging unit 10 is temporarily recorded in a memory in the digital camera 1 and image synthesis processing is performed using the image data captured by the rear imaging unit 15 later.

  In the above-described embodiment, the warning is given by the display unit 5. However, an operation other than the display unit 5 may prompt the photographer to give a warning. For example, the present invention can be achieved even if the photographer is urged to warn by lighting the light emitter or generating a warning sound by a sounding body.

<Fourth Embodiment>
Hereinafter, the fourth embodiment of the present invention will be described with reference to FIGS. 1, 5, 6, and 10. FIG.
FIG. 10 is a flowchart for describing a photographing procedure of the composite image processing mode photographing according to the fourth embodiment. In the flowchart of FIG. 10, steps that perform the same processing as the steps of the flowchart of FIG. 3 described above are denoted by the same step numbers as the step numbers given in the flowchart of FIG.
After starting the composite image mode for synthesizing the images of the front imaging unit 10 and the rear imaging unit 15 (S301), the process proceeds to the rear imaging unit face detection (S302). Here, the face detection unit 31 detects the photographer's face by the rear imaging unit 15.

Next, the flow proceeds to S303. In S303, it is determined whether or not the photographer's face can be detected in the image data of the rear imaging unit 15.
When the determination unit 32 determines that the photographer's face detection is not detected in the image data of the rear imaging unit 15 (the state of FIG. 5A), the process proceeds to S1001.
In S1001, it is determined whether or not the rear imaging unit 15 is in the wide-angle end state. When it is determined that the rear imaging unit 15 is in the wide-angle end state, the process proceeds to a flow of S305 described later. When it is determined that the rear imaging unit 15 is not in the wide-angle end state, the flow proceeds to S1002.
In S1002, the rear imaging unit 15 is driven to the wide-angle side by a drive unit (not shown), and the process proceeds to wide-angle imaging where the shootable field angle of the rear imaging unit 15 is widened.

After the rear imaging unit 15 is driven to the wide angle side, face detection is performed again in the rear imaging unit 15 (S1003). Next, the flow proceeds to S1004.
In S1004, it is determined again whether or not the photographer's face can be detected in the image data of the rear imaging unit 15. If the determination unit 32 determines that the detection of the photographer's face is not detected again in the image data of the rear imaging unit 15 (the state shown in FIG. 5A), the process proceeds to S305. Here, a warning display is generated by the warning image data generation unit 36 and displayed on the display unit 5 (the state shown in FIG. 5B).

  Next, the process proceeds to S306 from this state, and if the release button 3 is not pressed, the process proceeds to S302 again and the face detection of the rear imaging unit 15 is continued. In addition, when the release button 3 is pressed in the state of S306, the image data of the front imaging unit 10 and the rear imaging unit 15 are captured (S307).

  Next, the process proceeds to S308, where it is selected whether or not to perform composite image processing (state shown in FIG. 5C). Here, if the composite image processing is selected, the process proceeds to S309, where the image composition processing unit 33 performs composition processing on the image data of the front imaging unit 10 and the rear imaging unit 15 (state in FIG. 6A).

If it is selected not to perform the composite image processing in S308, the image data captured by the rear imaging unit 15 is discarded, and only the image data of the front imaging unit 10 is recorded (state in FIG. 6B).
In this way, it is possible to prevent failure of photographing by the rear imaging unit 15 by urging the photographer to warn.

(Other embodiments)
The present invention can also be realized by executing the following processing. That is, software (computer program) that implements the functions of the above-described embodiments is supplied to a system or apparatus via a network or various computer-readable storage media. The system (or CPU or MPU) of the system or apparatus reads out the program and executes various controls.

Claims (8)

An imaging apparatus comprising a first imaging means for photographing the subject side and a second imaging means for photographing the photographer side ,
Face detection means for performing face detection on image data captured by the second imaging means ;
Combining processing means for executing combining processing for combining image data photographed by the first imaging means and image data photographed by the second imaging means;
When the face Ri by said face detecting means for capturing image data is not detected by the second imaging means, and warning means for performing warning display to the photographer,
Selection means capable of selecting whether or not to execute the synthesis process when performing a photographing operation when no face is detected in the image data photographed by the second imaging means;
An imaging device comprising: A display unit for displaying the captured image data ;
The imaging apparatus according to claim 1, wherein the warning unit displays a warning on the display unit. An imaging apparatus comprising a first imaging means for photographing the subject side and a second imaging means for photographing the photographer side ,
Face detection means for performing face detection on image data captured by the second imaging means ;
Image composition processing means operating in a composite image processing mode for combining image data photographed by the first imaging means and image data photographed by the second imaging means ;
In the transition state before Symbol synthesized image processing mode, when face detection is Ru is executed captured when the non-detection by the face detecting means for the image data captured by the second imaging means, the composite image Control means for canceling the processing mode ;
An imaging device comprising: In a control method of an imaging apparatus including a first imaging means for photographing a subject side and a second imaging means for photographing a photographer side ,
A face detection step of performing face detection on the image data photographed by the second imaging means ;
When a face is not detected for the image data captured by said have you the face detection process the second imaging means, and a warning step of warning display to the photographer,
A selection step for selecting whether or not to execute composite image processing when performing a shooting operation when a face is not detected for image data captured by the second imaging means;
A method for controlling an imaging apparatus, comprising: In a control method of an imaging apparatus including a first imaging means for photographing a subject side and a second imaging means for photographing a photographer side ,
A face detection step of performing face detection on the image data photographed by the second imaging means ;
And image data captured by the first imaging means, and the image synthesis processing step of operating in the composite image processing mode for synthesizing the image data captured by the second imaging means,
In a state where the shift to before Symbol synthesized image processing mode, when the face detection process by the face detecting Ru is executed captured when undetected for captured image data by the second imaging means, the composite image A release step for releasing the processing mode ;
A method for controlling an imaging apparatus, comprising: A program for causing a computer to execute a control method of an imaging apparatus including a first imaging means for photographing a subject side and a second imaging means for photographing a photographer side ,
A face detection step of performing face detection on the image data photographed by the second imaging means ;
When a face is not detected for the image data captured by said have you the face detection process the second imaging means, and a warning step of warning display to the photographer,
A selection step for selecting whether or not to execute composite image processing when performing a shooting operation when a face is not detected for image data captured by the second imaging means;
A program that causes a computer to execute . A program for causing a computer to execute a control method of an imaging apparatus including a first imaging means for photographing a subject side and a second imaging means for photographing a photographer side ,
A face detection step of performing face detection on the image data photographed by the second imaging means ;
And image data captured by the first imaging means, and the image synthesis processing step of operating in the composite image processing mode for synthesizing the image data captured by the second imaging means,
In a state where the shift to before Symbol synthesized image processing mode, when the face detection process by the face detecting Ru is executed captured when undetected for captured image data by the second imaging means, the composite image A release step for releasing the processing mode ;
A program that causes a computer to execute . A computer-readable storage medium storing the program according to claim 6 or 7 .

Images