JP6257310B2 - Imaging apparatus, imaging control method, and program - Google Patents

Description

  The present invention relates to a photographing apparatus, a photographing control method, and a program.

2. Description of the Related Art Conventionally, an electronic device including a camera facing inward (hereinafter referred to as an in-camera) in addition to a normal camera (hereinafter referred to as an out-camera) is known, such as a mobile phone or a smartphone. In such an electronic device, the subject can be photographed with the out-camera, the photographer's facial expression with the in-camera, and the photographer's facial expression when the subject is photographed can be left.
An electronic device equipped with an in-camera can simultaneously release the shutters of the out-camera and the in-camera with a single release operation, and can record the images captured by the in-camera and the out-camera in association with each other (see Patent Document 1). .

Japanese Patent Laid-Open No. 2005-94741

  However, the conventional technique has a problem that although the photographer's facial expression at the time of shooting the subject can be photographed, the photographer's facial expression when the photographed image is actually viewed cannot be left.

  The present invention has been made in view of such problems, and an object of the present invention is to record a photographer's facial expression when a photographed image is viewed.

Accordingly, the present invention provides a photographing apparatus, and displays the first imaging means, and instruction means for accepting an imaging instruction of the image by the first imaging means, an image photographed by the first photographing means display Means, a second photographing means for photographing the side provided with the display means, and the display of an image photographed by the first photographing means in response to accepting a photographing instruction by the instruction means And a control unit that controls to display an image by the second imaging unit while the image is displayed .

  According to the present invention, it is possible to record the photographer's facial expression when viewing a photographed image.

It is an external view of a digital camera. It is a block diagram which shows a digital camera. It is a flowchart which shows the process of a digital camera. It is a flowchart which shows the detailed process in imaging | photography mode process. It is a figure which shows an example of a setting screen. It is a figure which shows an example of a setting screen. It is a figure which shows the example of a display of a quick review.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
FIG. 1 is an external view of a digital camera 100 as an example of a photographing apparatus. FIG. 1 shows the back side of the digital camera 100. The digital camera 100 includes an out camera 110 that mainly photographs a subject and an in camera 120 that can photograph a photographer.
The out camera 110 is provided on the first main surface 101 of the digital camera 100. The out camera 110 captures a subject. The in-camera 120 is provided on the second main surface 102 opposite to the first main surface 101. The in-camera 120 can photograph a photographer or the like in a photographing direction opposite to the photographing direction (optical axis) of the out-camera 110. A display unit 130 is provided on the second main surface 102, and the in-camera 120 captures a side on which the display unit 130 is provided. Note that shooting by the out-camera 110 is appropriately referred to as out-camera shooting, and shooting by the in-camera 120 is appropriately referred to as in-camera shooting.

The display unit 130 displays images and various information. The shutter button 132 is an operation unit for issuing a shooting instruction. The mode switch 133 is an operation unit for switching the operation mode of the digital camera 100. The power switch 135 switches the power ON / OFF. The operation unit 136 includes operation members such as various switches and buttons for receiving various operations from the user. The controller wheel 137 is a rotatable operation member included in the operation unit 136.
Reference numeral 138 denotes an eyepiece finder. The eyepiece finder 138 is an optical finder. As another example, the eyepiece finder 138 may be an electronic viewfinder (EVF). The connector 139 is a connector between the connection cable 140 and the digital camera 100. The recording medium 141 is a recording medium such as a memory card or a hard disk. The recording medium 141 records captured images and the like. The recording medium slot 142 is a slot for storing the recording medium 141. The recording medium 141 stored in the recording medium slot 142 can communicate with the digital camera 100. A lid 143 is a lid of the recording medium slot 142.

FIG. 2 is a block diagram showing the digital camera 100. The out camera 110 includes a photographing lens 111, a shutter 112, and an imaging unit 113. The photographing lens 111 is a lens group including a zoom lens and a focus lens. The shutter 112 is a shutter having an aperture function. The imaging unit 113 is an imaging device configured by a CCD, a CMOS device, or the like that converts an optical image into an electrical signal. The barrier 150 covers the imaging system including the imaging lens 111 to prevent the imaging system including the imaging lens 111, the shutter 112, and the imaging unit 113 from being soiled or damaged.
Similar to the out camera 110, the in camera 120 includes a photographing lens 121, a shutter 122, and an imaging unit 123. The photographing lens 121, the shutter 122, and the imaging unit 123 are the same as the photographing lens 111, the shutter 112, and the imaging unit 113, respectively.
The A / D converter 151 converts an analog signal into a digital signal. The A / D converter 151 converts not only the signal output from the imaging unit 113 of the out camera 110 but also the analog signal output from the imaging unit 123 of the in camera 120 into a digital signal at the same time.

The image processing unit 152 performs resize processing such as predetermined pixel interpolation and reduction and color conversion processing on the data received from the A / D converter 151 or the data received from the memory control unit 153. The image processing unit 152 also performs predetermined arithmetic processing on the captured image data.
The result of the arithmetic processing is used by the system control unit 157. That is, the system control unit 157 performs exposure control and distance measurement control based on the calculation result. The system control unit 157 performs, for example, TTL (through-the-lens) AF (autofocus) processing, AE (automatic exposure) processing, EF (flash pre-flash) processing, and AWB (auto white balance) processing.

Output data from the A / D converter 151 is directly written into the memory 154 via the image processing unit 152 and the memory control unit 153 or via the memory control unit 153. The memory 154 stores image data obtained by the imaging units 113 and 123 and converted into digital data by the A / D converter 151 and image data to be displayed on the display unit 130. The memory 154 is assumed to have a storage capacity sufficient to store a predetermined number of still images, a moving image and sound for a predetermined time. The memory 154 also serves as an image display memory (video memory).
The D / A converter 155 converts the image display data stored in the memory 154 into an analog signal and supplies the analog signal to the display unit 130. Thus, the display image data written in the memory 154 is displayed on the display unit 130 via the D / A converter 155.
The display unit 130 performs display according to the analog signal from the D / A converter 155 on a display such as an LCD. The nonvolatile memory 156 is an electrically erasable / recordable memory. As the nonvolatile memory 156, for example, an EEPROM or the like is used. The nonvolatile memory 156 stores operation constants, programs, and the like for the system control unit 157. Here, the program is a program for executing various flowcharts described later in the present embodiment.

The system control unit 157 is a CPU, for example, and controls the entire digital camera 100. The system control unit 157 implements each process of the present embodiment, which will be described later, by executing the program recorded in the nonvolatile memory 156 described above. The system control unit 157 performs shooting control of the out camera 110 and the in camera 120, for example.
The system control unit 157 also performs display control by controlling the memory 154, the D / A converter 155, the display unit 130, and the like. More specifically, the system control unit 157 converts the digital signal once A / D converted by the A / D converter 151 and stored in the memory 154 into an analog signal in the D / A converter 155 and sequentially converts the digital signal to the display unit 130. Transfer and display. Accordingly, the display unit 130 functions as an electronic viewfinder and can display a through image.
In the system memory 158, constants and variables for operation of the system control unit 157, programs read from the nonvolatile memory 156, and the like are expanded. For example, a RAM is used as the system memory 158. The system timer 159 is a time measuring unit that measures the time used for various controls and the time of a built-in clock.

The mode switch 133, the first shutter switch 161, the second shutter switch 162, and the operation unit 136 are operation means for inputting various operation instructions to the system control unit 157. The mode switch 133 switches the operation mode of the system control unit 157 to any one of a still image shooting mode, a moving image shooting mode, and a playback mode. The still image shooting mode is a mode for shooting a still image. The moving image shooting mode is a mode for shooting a moving image.
The still image shooting mode further has a plurality of modes. In the present embodiment, the still image shooting mode includes an auto shooting mode, an auto scene determination mode, a manual mode, various scene modes, a program AE mode, a custom mode, and a simultaneous shooting mode.

Here, the various scene modes are modes in which shooting is performed according to shooting settings for each shooting scene. The simultaneous shooting mode is a mode in which shooting is simultaneously performed by both the out camera 110 and the in camera 120.
The user can input a setting instruction for each mode included in the still image shooting mode by operating the mode switch 133. As another example, the user may switch to the still image shooting mode using the mode switch 133 and further select each mode included in the still image shooting mode using another operation member. Similar to the still image shooting mode, the moving image shooting mode also has a plurality of modes.

The first shutter switch 161 is turned on when the shutter button 132 provided on the digital camera 100 is being operated, so-called half-press (shooting preparation instruction). When the first shutter switch 161 is turned on, the first shutter switch signal SW1 is input to the system control unit 157. When the first shutter switch signal SW1 is input, the system control unit 157 starts shooting preparation processing such as AF processing, AE processing, AWB processing, and EF processing of the out-camera 110.
It is assumed that the operation mode is set to the simultaneous shooting mode when the first shutter switch signal SW1 is input. In this case, the system control unit 157 starts the shooting preparation process for the in-camera 120 in parallel with the process for the out-camera 110.

The second shutter switch 162 is turned on when the operation of the shutter button 132 is completed, that is, when it is fully pressed (shooting instruction), and the second shutter switch signal SW2 is input to the system control unit 157. When the second shutter switch signal SW2 is input, the system control unit 157 performs processing related to shooting by the out-camera 110. Specifically, the system control unit 157 reads a signal from the imaging unit 113 of the out-camera 110 and starts a series of shooting processes from writing image data to the recording medium 141.
It is assumed that the operation mode is set to the simultaneous photographing mode when the second shutter switch signal SW2 is input. In this case, the system control unit 157 performs processing related to shooting by the in-camera 120 in parallel with processing related to shooting by the out-camera 110. Specifically, the system control unit 157 reads a signal from the imaging unit 123 of the in-camera 120 and starts a series of shooting processes from writing image data to the recording medium 141.

Each operation member of the operation unit 136 is associated with various function icons displayed on the display unit 130, and various functions are appropriately assigned for each scene, and function as various function buttons. Examples of the function buttons include an end button, a return button, an image advance button, a jump button, a narrowing button, and an attribute change button.
When the menu button is pressed by the user, the display unit 130 displays a menu screen that can be set. The user can make various settings intuitively using the menu screen displayed on the display unit 130 and the four-way buttons and the SET button.

The controller wheel 137 is a rotatable operation member included in the operation unit 136 and accepts selection of an item by the user together with the direction button. When the rotation operation of the controller wheel 137 by the user is performed, an electrical pulse signal corresponding to the operation amount is input to the system control unit 157.
Based on this pulse signal, the system control unit 157 can determine the angle at which the controller wheel 137 is rotated, how many rotations, and the like. The system control unit 157 controls each unit of the digital camera 100 based on the pulse signal.

The controller wheel 137 may be an operation member capable of detecting a rotation operation, and the specific configuration is not limited to the embodiment. As another example, the controller wheel 137 may be a dial operation member that rotates in response to a user's rotation operation and generates a pulse signal.
As another example, the controller wheel 137 may be a so-called touch wheel. In this case, the controller wheel 137 does not rotate, and detects the rotation operation of the user's finger on the controller wheel 137.

The power supply control unit 164 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches blocks to be energized, and the like. The power control unit 164 detects the presence / absence of a battery, the type of battery, and the remaining battery level. The power supply control unit 164 also controls the DC-DC converter based on the detection result and an instruction from the system control unit 157, and supplies a necessary voltage to each unit including the recording medium 141 for a necessary period.
The power supply unit 165 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, or the like. The recording medium I / F 166 is an interface with the recording medium 141. The recording medium 141 is a memory card or the like for recording a photographed image, and includes a semiconductor memory, a magnetic disk, or the like.

FIG. 3 is a flowchart showing processing after the digital camera 100 is activated. Note that the processing shown in FIG. 3 is realized by the system control unit 157 reading a program stored in the nonvolatile memory 156 or the like and executing the program. When the digital camera 100 is activated, the process shown in FIG. 3 starts. In step S <b> 301, the system control unit 157 determines whether the operation mode is the shooting mode according to the position of the mode switch 133. If the system control unit 157 determines that the operation mode is the shooting mode (Yes in S301), the system control unit 157 performs processing in the shooting mode in S302, and then advances the processing to S303. The process in S302 will be described later.
In step S303, the system control unit 157 confirms whether or not a shutdown instruction has been received. When the system control unit 157 receives a shutdown instruction (Yes in S303), the system control unit 157 ends the process. If the system control unit 157 has not received a shutdown instruction (No in S303), the system control unit 157 advances the process to S301.

On the other hand, when the system control unit 157 determines in S301 that the operation mode is not the shooting mode (No in S301), in S304, the system control unit 157 determines whether or not the operation mode is the reproduction mode. If the system control unit 157 determines that the operation mode is the reproduction mode (Yes in S304), the system control unit 157 performs the process in the reproduction mode in S305, and then advances the process to S303. The processing in the reproduction mode includes image browsing, enlarged display, image deletion, and the like.
If the system control unit 157 determines in S304 that the operation mode is not the reproduction mode (No in S304), the system control unit 157 performs other processing in S306, and then advances the processing to S303. Here, examples of other processing include processing for displaying the current time.

  FIG. 4 is a flowchart showing detailed processing in the shooting mode processing (S302). In step S401, the system control unit 157 determines whether an instruction to change shooting settings such as a menu operation has been received from the user. If the system control unit 157 determines that a change instruction has been received (Yes in S401), the process proceeds to S402. In step S402, the system control unit 157 performs processing according to the change instruction, and ends the processing in step S302. Thereafter, the process proceeds to S303.

5 and 6 are diagrams showing an example of the setting screen displayed in S402. FIG. 5 is a diagram showing a setting screen 500 for setting the timing for shooting with the in-camera 120. On the setting screen 500, the user can set whether or not to perform shooting with the in-camera 120 at the shooting timing with the out-camera 110 (timing when the first shutter switch 161 is pressed). Furthermore, the user can set whether or not to perform shooting by the in-camera 120 at the quick review display timing on the setting screen 500. Here, the quick review is a subject image by the out camera 110 displayed on the display unit 130 immediately after shooting by the out camera 110.
When the user selects “Yes” for in-camera shooting during out-shooting on the setting screen 500, the system control unit 157 accepts a setting instruction for performing in-camera shooting during out-camera shooting. In addition, when the user selects “Yes” for in-camera shooting at the time of quick review display on the setting screen 500, the system control unit 157 causes a setting instruction to perform in-camera shooting at the time of quick review display (during display). Is received (second reception process).

FIG. 6 is a diagram showing a setting screen 600 for setting whether to display a quick review. On the setting screen 600, the user can set whether or not to display the quick review, and if so, the display time of the quick review. In FIG. 6, “OFF” is a button for accepting an instruction not to display the quick review.
When “OFF” is selected by the user on the setting screen 600, the system control unit 157 accepts a setting instruction for not performing the quick review display. In addition, when “2 seconds” or “10 seconds” is selected by the user on the setting screen 600, the system control unit 157 receives a setting instruction for performing a quick review display. Furthermore, the system control unit 157 accepts designation of the quick review display time of “2 seconds” or “10 seconds”, respectively.

Returning to FIG. 4, if the system control unit 157 determines in S401 that a change instruction has not been received (No in S401), the process proceeds to S403. In step S403, the system control unit 157 determines whether the shutter button 132 has been pressed. If the system control unit 157 determines that the shutter button 132 has not been pressed (No in S403), the process of S302 ends. On the other hand, if the system control unit 157 determines that the shutter button 132 has been pressed (Yes in S403), the process proceeds to S404.
In step S404, the system control unit 157 instructs the out camera 110 to start shooting. Then, the system control unit 157 acquires a subject image photographed by the out-camera 110 (acquisition processing) and records it on the recording medium 141 or the like. The out-camera 110 captures a subject image in accordance with an instruction from the system control unit 157 (first imaging process).

In step S <b> 405, the system control unit 157 confirms whether or not a speed priority shooting mode is set for the out camera 110. Here, the speed priority shooting mode is a mode for shooting a fast-moving subject. Examples of the speed priority shooting mode include a continuous shooting mode, a bracket shooting mode, a sports shooting mode, a kids shooting mode, a pet shooting mode, and a kids & pet shooting mode.
In S405, the system control unit 157 ends the process of S302 when the speed-priority shooting mode is set (Yes in S405). On the other hand, if the speed-priority shooting mode is not set (No in S405), the system control unit 157 advances the process to S406.

In step S <b> 406, the system control unit 157 confirms whether or not settings for performing in-camera shooting are performed during out-camera shooting. In the setting screen 500 of FIG. 5, when “Yes” is selected for in-camera shooting at the time of out-camera shooting, and the system control unit 157 receives a setting instruction corresponding thereto, It is determined that the setting is for in-camera shooting. The system control unit 157 advances the process to S407 when the setting for performing the in-camera shooting at the time of the out-camera shooting is made (Yes in S406). If the setting for performing in-camera shooting is not performed during out-camera shooting (No in S406), the system control unit 157 proceeds to S408.
In step S407, the system control unit 157 instructs the in-camera 120 to start shooting. Then, the system control unit 157 acquires a photographer image taken by the in-camera 120 and records it on the recording medium 141 or the like. The in-camera 120 captures a photographer image including a photographer in accordance with an instruction from the system control unit 157.

In step S <b> 408, the system control unit 157 confirms whether the setting for displaying the quick review is made. 6 is a setting for performing a quick review display when “2 seconds” or “10 seconds” is selected and the system control unit 157 accepts a setting instruction corresponding thereto. Judge. In addition, when “OFF” is selected on the setting screen 600 and the system control unit 157 accepts a setting instruction corresponding thereto, it is determined that the setting is not performed for quick review display.
If the setting for displaying the quick review is made (Yes in S408), the system control unit 157 advances the processing to S409. On the other hand, when the setting for not displaying the quick review is made (No in S408), the system control unit 157 ends the process of S302.

In step S409, the system control unit 157 performs a quick review display. Specifically, the system control unit 157 displays the subject captured image obtained by the out-camera 110 obtained in S404 on the display unit 130 (display processing). Next, in S410, the system control unit 157 waits until the standby time elapses from the start of the quick review display, and proceeds to S411 when the standby time elapses. Here, the standby time is, for example, 500 milliseconds or the like, and is set in advance in the nonvolatile memory 156 or the like. The waiting time can be arbitrarily set by the user. Specifically, when the user sets the standby time by operating the operation unit 136 or the like, the system control unit 157 receives the specification of the standby time (first reception process), and stores this in the nonvolatile memory 156 or the like. Store.
Next, in S411, the system control unit 157 confirms whether or not the setting for performing in-camera shooting at the time of quick review display has been made. In the setting screen 500 of FIG. 5, when “Yes” is set for in-camera shooting at the time of quick review display, and the system control unit 157 accepts a setting corresponding to this, the input at the time of quick review display is set. It is determined that the setting is for camera shooting.

If the setting for performing in-camera shooting at the time of quick review display has been made (Yes in S411), the system control unit 157 advances the processing to S412. If the setting is made not to perform in-camera shooting at the time of quick review display (No in S411), the system control unit 157 advances the processing to S414.
In step S412, the system control unit 157 instructs the in-camera 120 to start shooting. Then, the system control unit 157 acquires a photographer image taken by the in-camera 120 and records it on the recording medium 141 or the like. Note that the in-camera 120 captures a photographer image in accordance with an instruction from the system control unit 157 (second capturing process). Here, the process of S412 is an example of a control process for instructing the in-camera 120 to start capturing an image while the standby time has elapsed and the captured image of the out-camera 110 is being displayed.

In step S413, the system control unit 157 superimposes the photographer image obtained in step S412 on the subject image obtained in step S404, and displays this on the display unit 130. Here, the process of S413 is an example of a combining process for combining the subject image and the photographer image.
Next, in S414, the system control unit 157 confirms whether or not the quick review display time has elapsed. The system control unit 157 continues to display the quick review until the display time elapses. When the display time elapses (Yes in S414), the process of S302 ends.
Here, the display time is a value set on the setting screen 600 of FIG. If “2 seconds” is selected, the system control unit 157 continues the quick review display for 2 seconds, and then ends the processing of S302.

FIG. 7 is a diagram illustrating a display example of a quick review. Immediately after the processing of S409, as shown in FIG. 7A, only the subject image is displayed on the display unit 130. Then, after the process of S413, as shown in FIG. 7B, the photographer image is superimposed and displayed on the subject image on the display unit 130.
As described above, the digital camera 100 according to the present embodiment can capture a photographer image by in-camera shooting while the subject image is displayed by the out camera 110. Therefore, the photographer's facial expression when viewing the subject image can be recorded. That is, the digital camera 100 can leave the photographer's expression when viewing the subject image.

  Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. A part of the above-described embodiments may be appropriately combined.

Also, when a software program that realizes the functions of the above-described embodiments is supplied from a recording medium directly to a system or apparatus having a computer that can execute the program using wired / wireless communication, and the program is executed Are also included in the present invention. Accordingly, the program code itself supplied and installed in the computer in order to implement the functional processing of the present invention by the computer also realizes the present invention. That is, the computer program itself for realizing the functional processing of the present invention is also included in the present invention. In this case, the program may be in any form as long as it has a program function, such as an object code, a program executed by an interpreter, or script data supplied to the OS.
As a recording medium for supplying the program, for example, a magnetic recording medium such as a hard disk or a magnetic tape, an optical / magneto-optical storage medium, or a nonvolatile semiconductor memory may be used. As a program supply method, a computer program that forms the present invention is stored in a server on a computer network, and a connected client computer downloads and programs the computer program.

100 digital camera, 110 out camera, 120 in camera, 130 display unit, 157 system control unit

Claims (10)

First imaging means;
Instruction means for receiving an instruction to take an image by the first photographing means;
Display means for displaying an image photographed by the first photographing means;
Second photographing means for photographing the side on which the display means is provided;
An image photographed by the first photographing means is displayed on the display means in response to accepting a photographing instruction by the instruction means, and an image is photographed by the second photographing means while the image is displayed. An imaging apparatus comprising: a control means for controlling.   The photographing of the image by the second photographing means is performed after a predetermined time has elapsed since the image photographed by the first photographing means is displayed on the display means in response to accepting the photographing instruction. The imaging apparatus according to claim 1, wherein:   The image recording apparatus according to claim 1, further comprising: a recording unit configured to record an image photographed by the second photographing unit on a recording medium together with the image photographed by the first photographing unit in response to receiving the photographing instruction. Item 3. The photographing apparatus according to Item 1 or 2. Before SL imaging apparatus according to claims 1 to 3 any one characterized by having a synthesizing means for synthesizing the image photographed by the second photographing means and photographed image by the first imaging means. A first accepting means for accepting designation of the predetermined time;
The imaging apparatus according to claim 2, wherein the control unit controls the second imaging unit to capture an image after a predetermined time received by the first receiving unit has elapsed. A second receiving means for receiving a setting as to whether or not to take an image of the side on which the display means is provided during display of the image taken by the first photographing means;
When the control means receives a setting for taking an image on the side where the display means is provided during display of the image taken by the first photographing means, the control means has taken the image by the first photographing means. The imaging apparatus according to claim 1, wherein control is performed so that an image is captured by the second imaging unit during image display. A third receiving means for receiving a setting of a speed-prioritized shooting mode for the first shooting means;
The second photographing unit controls the second photographing unit to photograph an image while the image photographed by the first photographing unit is being displayed when the speed priority photographing mode is not set. The imaging device according to any one of claims 1 to 6.   The photographing apparatus according to claim 7, wherein the speed-priority photographing modes include a continuous photographing mode, a bracket photographing mode, a sports photographing mode, a kids photographing mode, and a pet photographing mode. A shooting control method for controlling a shooting device,
An instruction step for receiving an instruction to shoot an image by the first imaging means;
Wherein a display step of displaying on the first display means an image photographed by the photographing means, in response to reception of the pre-Symbol shooting instruction, to display the image captured by the first imaging means to said display means, And a control step of controlling the second photographing unit for photographing the side on which the display unit is provided during the display of the image. Computer
Instruction means for accepting an image photographing instruction by the first photographing means;
Display means for displaying an image photographed by the first photographing means;
In response to accepting a photographing instruction by the instruction means, an image photographed by the first photographing means is displayed on the display means, and the side on which the display means is provided is photographed during the display of the image. A program for functioning as a control unit that controls to capture an image by the second imaging unit.

Images