JP2016032193A - Imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To acquire a suitably composed image where a line of sight does not stray off.SOLUTION: An imaging apparatus includes: an imaging device 53 for imaging a subject light; a display section 12 on which a through image is displayed based on image data outputted from the imaging device; a setting section 24 for setting a selfie mode in which an operator images himself/herself while confirming a composition of the through image displayed on the display section; an extraction section 24 for extracting regional image data in a predetermined region from the image data when the selfie mode is set by the setting section; a display control section 24 for displaying a regional image based on the regional image data on the display section; a first instruction section 24 which makes a first instruction; a composition correction section 24 which starts correcting the composition of the regional image when the first instruction is made by the first instruction section; a second instruction section 24 which makes a second instruction; and a storage section 48 for storing the regional image data of the regional image to which the composition has been corrected when the second instruction is made by the second instruction section.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an imaging apparatus capable of taking a selfie.

  2. Description of the Related Art Conventionally, there is an imaging apparatus having a mechanism that aligns the display direction of a display unit with the shooting direction of a shooting lens (for example, see Patent Document 1). According to this imaging apparatus, self-portrait photography can be performed while confirming the composition on the display unit.

JP 2007-116601 A

  However, in the above-described imaging device, there is a problem that an image with a line of sight is acquired because the operator performs shooting while looking at the display unit.

  In addition, when the operator checks the composition on the display unit and moves the line of sight in the direction of the photographic lens, the position of the imaging device is shifted until the line of sight is moved in the direction of the photographic lens. Shooting may not be possible according to the composition. In particular, since the shooting distance is short in self-portrait, the composition may change greatly even if the position of the imaging device is slightly shifted.

  An object of the present invention is to provide an imaging apparatus capable of acquiring an image with an appropriate composition in which the line of sight is not deviated.

  The imaging device of the present invention includes an imaging element that captures subject light, a display unit that displays a through image based on image data output from the imaging element, and an operator that is displayed on the display unit. A setting unit that sets a self-portrait mode in which the user takes a picture while confirming the composition of the through image; and when the self-portrait mode is set by the setting unit, area image data of a predetermined area is extracted from the image data An extraction unit, a display control unit that displays a region image based on the region image data on the display unit, a first instruction unit that issues a first instruction, and the first instruction unit that gives the first instruction The composition correction unit that starts composition correction of the region image, the second instruction unit that performs a second instruction, and the composition correction performed when the second instruction is given by the second instruction unit. The area picture Characterized in that it comprises a storage unit for storing the region image data.

  According to the present invention, it is possible to acquire an image with an appropriate composition in which the line of sight is not deviated.

It is the figure which looked at the digital camera which concerns on embodiment from the front and the back. It is the figure which looked at the state which opened the liquid crystal panel of the digital camera which concerns on embodiment from the front. 1 is a block diagram showing a system configuration of a digital camera according to an embodiment. It is a flowchart which shows the process of the self-portrait mode in the digital camera which concerns on embodiment. It is a figure which shows the extraction area | region of the area | region image data which concerns on embodiment. It is a figure which shows the image in the case of performing composition correction based on the position of the face recognized by the digital camera which concerns on embodiment. It is a figure which shows the case where the extraction area | region of the area | region image data which concerns on embodiment has reached the limit of composition correction. It is a figure which shows the case where the extraction area | region of the area | region image data which concerns on embodiment exceeds the limit of composition correction. It is a figure which shows the image in the case of performing composition correction | amendment based on the movement amount of the digital camera which concerns on embodiment. It is a figure which shows the case where the several face is recognized in the digital camera which concerns on embodiment. It is a figure which shows the face frame displayed on the image by which the face recognition was made | formed in the digital camera which concerns on embodiment.

  Hereinafter, a digital camera according to an embodiment will be described with reference to the drawings. FIG. 1A is a view of the digital camera according to the embodiment as viewed from the front, and FIG. 1B is a view of the digital camera as viewed from the back. The digital camera 2 includes a housing 4 made of metal, plastic, or the like. On the front surface of the housing 4 is a photographing lens 5 that guides subject light to an image sensor 53 (see FIG. 3), and an LED 6 that emits LED light. And a flash window 7 are provided. A power switch 8 and a shutter button 10 are provided on the upper surface of the housing 4.

  In addition, a liquid crystal monitor 13 for displaying an image on the LCD display unit 12 is housed on the back surface of the housing 4. Here, the liquid crystal monitor 13 is rotatably supported from the housing 4 via a biaxial rotation mechanism (not shown). FIG. 1B shows a closed state in which the liquid crystal monitor 13 is folded so that the position of the LCD display unit 12 comes to the back of the housing 4.

  FIG. 2 is a diagram illustrating an open state in which the liquid crystal monitor 13 is raised from the back surface of the housing 4 and the LCD display unit 12 is directed in the shooting direction (the front surface side of the housing 4). As shown in FIG. 2, the operator can take a self-portrait by photographing himself / herself while confirming the composition on the LCD display unit 12 by opening the liquid crystal monitor 13.

  FIG. 3 is a block diagram showing a system configuration of the digital camera 2 according to the embodiment. The digital camera 2 includes a CPU 24. The CPU 24 includes an operation unit 26, a display control unit 30 that performs display control of the LCD display unit 12, a detection unit 33 that detects that the liquid crystal monitor 13 is opened, and a subject. A photographing unit 34 for photographing the image, an image storage unit 36 for temporarily storing image data photographed by the photographing unit 34, an inclination angle sensor 38 for measuring an inclination angle of the digital camera 2 with respect to a horizontal plane, and control of blinking of the LED 6. A lighting control unit 40, a face recognition unit 42 for recognizing a human face from image data, a composition storage unit 44 for storing a composition when the shutter button 10 is half-pressed, a speaker 45 for outputting sound, and image data. A memory card slot 48 into which a memory card 46 to be stored is mounted is connected.

  Here, the operation unit 26 includes a power switch 8, a shutter button 10, a switch S1 (not shown) that is turned on when the shutter button is pressed halfway down, and a switch S2 that is turned on when the shutter button is fully pressed. (Not shown) and the like are included. In addition, the photographing unit 34 includes a lens driving unit 52 that controls driving of the lens 51, an imaging element 53 configured by a CCD or the like, a lens driving unit 52, and a photographing control unit 54 that performs driving control of the imaging element 53. .

  FIG. 4 is a flowchart showing processing in the self-portrait mode in the digital camera 2 according to the embodiment. First, when the power is turned on, the CPU 24 starts capturing a through image by the image sensor 53 and sequentially stores the image data captured by the image sensor 53 in the image storage unit 36. Next, image data is read from the image storage unit 36, and a through image based on the image data is displayed on the LCD display unit 12 (step S1).

  Here, when the operator turns the liquid crystal monitor 13 to the open state as shown in FIG. 2, the CPU 24 detects that the liquid crystal monitor 13 has been opened by the detecting unit 33 (step). S2) The shooting mode of the digital camera 2 is shifted to the self-shooting mode (step S3).

  When shifting to the self-portrait mode, the CPU 24 uses the photographing control unit 54 to drive the lens driving unit 52 to move the lens 51 in the optical axis direction and adjust the photographing field angle of the photographing unit 34 so that wide-angle photographing can be performed. (Step S4).

  Next, as shown in FIG. 5, the CPU 24 extracts region image data 62 of a predetermined extraction region from the image data 60 sequentially read from the image storage unit 36 (step S <b> 5), and the through image based on the region image data 62. Is enlarged and displayed on the LCD display unit 12. Further, the CPU 24 starts recognizing the face position of the person image included in the area image data 62 by the face recognition unit 42 (step S6).

  Here, the operator adjusts the position and orientation of the digital camera 2 while viewing the through image displayed on the LCD display unit 12. Then, when the user's face is displayed on the LCD display unit 12 with an appropriate composition, the shutter button 10 is half-pressed.

  When the shutter button 10 is half-pressed and the switch S1 is turned on (step S7), the CPU 24 determines the composition of the image based on the face position recognized by the face recognition unit 42 (step S8). The composition is stored in the composition storage unit 44 as a reference composition that serves as a reference for composition correction. Next, the CPU 24 displays a message on the LCD display unit 12 urging the user to move his line of sight to the taking lens 5 such as “Look at the lens and press the shutter”.

  Next, the CPU 24 refers to the reference composition stored in the composition storage unit 44 and corrects the composition so that the composition of the image based on the always-on region image data 62 becomes the same composition as the reference composition (step S9). For example, it is assumed that the digital camera 2 moves due to a shake of the operator's hand and the position of the face in the image data 60 changes. In this case, as shown in FIG. 6, the CPU 24 sets the extraction area of the area image data 62 so that the face position displayed on the LCD display unit 12 as a through image is the same position as the face position in the reference composition. Move.

  As a result, even when the digital camera 2 moves due to shaking of the operator's hand, the composition at the time when the operator half-presses the shutter button 10 is continuously displayed on the LCD display unit 12 as a through image.

  During this time, the operator moves the line of sight of the LCD display unit 12 to the photographing lens 5 and fully presses the shutter button 10 while looking at the photographing lens 5. When the shutter button 10 is fully pressed and the switch S2 is turned on (step S10), the CPU 24 stores the area image data 62 extracted from the image data 60 at this time in the memory card 46 (step S11).

  According to the digital camera 2 according to the present embodiment, since the operator can determine the composition while looking at the LCD display unit 12 and then move the line of sight to the photographing lens 5 to shoot his own image, the line of sight is deviated. An image with no proper composition can be acquired. Further, when the shutter button 10 is half-pressed, the composition at that time is stored and the composition is corrected so that the image displayed on the LCD display unit 12 has the same composition as the stored composition. Even when the operator's hand shakes between halfway pressing and determining the composition until the shutter button 10 is fully pressed and shooting is performed, the framing state of the determined composition can be maintained.

  In the above-described embodiment, if there is a composition change that cannot be corrected by composition correction, a warning to that effect may be given. For example, it is assumed that the operator moves the digital camera 2 to the left and the edge of the area image data 62 is in contact with the edge of the image data 60 as shown in FIG. In this case, as shown in FIG. 7B, the CPU 24 displays the right arrow icon in blue and blinks the LED 6 at 2 Hz to prompt the operator to shift the digital camera 2 to the right.

  Here, when the operator further moves the digital camera 2 in the left direction and the area image data 62 is out of the frame from the image data 60 as shown in FIG. 8A, the CPU 24 displays the image data in FIG. As shown, the right arrow icon is displayed in red and the LED 6 blinks at 8 Hz. In this way, when the composition correction limit is reached and the composition correction limit is exceeded, warning is performed in two stages, so that the operator can move the digital camera 2 beyond the composition correction limit. It can be surely prevented. In the case of a warning, a beep sound may be output from the speaker 45 instead of the blinking of the LED 6 or together with the blinking of the LED 6.

  In the above-described embodiment, composition correction may be performed based on the movement amount of the digital camera 2. For example, when shifting to the self-portrait mode, the CPU 24 starts measuring the tilt angle of the digital camera 2 by the tilt angle sensor 38. Next, when the shutter button 10 is half-pressed, the CPU 24 measures the amount of movement of the digital camera 2 using the detection signal output from the tilt angle sensor 38. Specifically, the movement amount of the movement in the optical axis direction, the short side direction (up and down direction) of the housing 4 and the longitudinal direction (left and right direction) of the housing 4 within a predetermined time is measured.

  Next, the CPU 24 corrects the composition of the image displayed on the LCD display unit 12 based on the measured movement amount. For example, as shown in FIG. 9A, it is assumed that the operator moves the digital camera 2 in a predetermined distance and the range captured by the imaging unit 34 changes as the digital camera 2 moves. In this case, as shown in FIG. 9B, the CPU 24 opposes the extraction area of the area image data 62 extracted from the image data 60 by the distance corresponding to the movement amount of the digital camera 2. Move in the direction.

  The composition correction based on the movement amount of the digital camera 2 may be performed together with the composition correction based on the face position. Further, instead of measuring the movement amount of the digital camera 2, a motion vector may be generated by comparing image data captured by the image sensor 53 at a predetermined time interval. Then, composition correction for moving the extraction region of the region image data 62 based on the motion vector may be performed.

  In the above-described embodiment, region image data of a predetermined extraction region centered on a person's face may be extracted from image data when the mode is shifted to the self-portrait mode. In this case, when the shutter button 10 is half-pressed, the CPU 24 stores the composition centered on the person's face as a reference composition in the composition storage unit 44 and corrects the composition so that the person's face is always centered. Do. Thus, the operator can easily determine the composition without adjusting the position of his / her face displayed in the through image. In addition, it is possible to acquire an image with an appropriate composition in which one's face is located in the center.

  When a plurality of human faces are recognized from the image data, area image data 82 including the center of the plurality of human faces is extracted from the image data 80 as shown in FIG. As shown in FIG. 10B, an image based on the region image data 82 may be displayed on the LCD display unit 12 as a through image.

  In the above-described embodiment, composition correction may be performed based on the size of a person's face. For example, when shifting to the self-portrait mode, the CPU 24 starts recognizing the size of the face included in the area image data by the face recognition unit 42. Here, the operator moves the digital camera 2 in the optical axis direction, and presses the shutter button 10 halfway when his / her face is displayed on the LCD display unit 12 in a desired size.

  When the shutter button 10 is half-pressed, the CPU 24 determines the composition of the image based on the size of the face recognized by the face recognition unit 42, and stores the determined composition as a reference composition that serves as a reference for composition correction. Store in the unit 44. Next, the CPU 24 changes the size of the region image data extraction region so that the size of the face included in the region image data is always the same as the size of the face stored in the composition storage unit 44. Make corrections. Thereby, even when the digital camera 2 moves in the optical axis direction and the size of the face included in the image data 60 captured by the image sensor 53 changes, an image in which the face is displayed with an appropriate size is displayed. Can be acquired.

  As shown in FIGS. 11A and 11B, when the face frame 74 is displayed around the recognized face, the size of the face frame 74 may be changed according to the size of the face. . The composition correction based on the face size may be performed together with the composition correction based on the face position. The composition correction based on the size of the person's face is performed by driving the lens driving unit 52 to move the lens 51 in the optical axis direction and changing the size of the subject image included in the image data 60. Also good.

  Further, in the above-described embodiment, it may be detected whether or not a specific image change has occurred in the person image included in the area image data. For example, it is assumed that the operator gives a V-sign and the person image included in the area image data changes to a person image that gives a V-sign. In this case, the CPU 24 determines the composition by turning on the switch S1 by detecting this change in operation, and stores it in the composition storage unit 44 as a reference composition. Next, the CPU 24 starts detecting whether or not the person image included in the area image data has changed to a person image having a V sign.

  Here, when the operator issues the V sign again and detects that the person image included in the area image data has changed to the person image having the V sign, the CPU 24 turns on the switch S2 and turns on the switch S2. The area image data extracted at this time is stored in the memory card 46. In this way, by turning on the switch S1 and the switch S2 without operating the shutter button 10, it is possible to prevent an image having a composition determined by shaking when the shutter button 10 is operated from being acquired. be able to.

  In this case, the digital camera may further include a timer, and the switch S2 may be turned on when a predetermined time has elapsed since the switch S1 was turned on. If the person image does not change over a predetermined time, it may be assumed that the composition has been determined and the switch S1 is turned on.

  In the above-described embodiment, a person's line of sight may be detected from the region image data using a generally known line-of-sight detection technique. For example, when the switch S1 is turned on, the CPU 24 starts extracting the region image data and detects the line of sight of the person from the region image data. Here, when the line of sight of the person is detected from the area image data and it is confirmed that the line of sight of the person is facing the photographing lens 5, the CPU 24 turns on the switch S2. As a result, photographing is performed at the time when the line of sight of the operator looking at the LCD display unit 12 is moved to the photographing lens 5, so that the operator can surely acquire an image whose line of sight is not deviated.

  In the above-described embodiment, a mode button for setting the self-shooting mode may be provided, and the shooting mode of the digital camera 2 may be shifted to the self-shooting mode when the mode button is operated by the operator.

  In the above-described embodiment, moving image shooting may be started when the switch S2 is turned on. In this case, when the shutter button 10 is fully pressed, the CPU 24 sequentially displays images based on the region image data on the LCD display unit 12 and sequentially displays the region image data displayed on the LCD display unit 12 on the memory card. 46.

  In the above-described embodiment, the case where the digital camera 2 including the biaxial rotation mechanism is used as the imaging device has been described as an example. However, other digital cameras, smartphones, and tablets not including the biaxial rotation mechanism. Also in an imaging device such as a terminal or a mobile phone, region image data is extracted from image data of a through image, composition correction is started when the switch S1 is turned on, and region is displayed when the switch S2 is turned on. The present invention can be applied when a program for storing image data is provided.

  In the above-described embodiment, the liquid crystal monitor 13 may be opened before the power is turned on. In this case, when the power is turned on, the detection unit 33 detects that the liquid crystal monitor 13 is opened, and the photographing mode of the digital camera 2 is shifted to the self-taking mode.

DESCRIPTION OF SYMBOLS 2 ... Digital camera, 6 ... LED, 12 ... LCD display part, 13 ... Liquid crystal monitor, 24 ... CPU, 26 ... Operation part, 33 ... Detection part, 38 ... Inclination angle sensor, 42 ... Face recognition part, 44 ... Composition memory 45, speaker, 53 ... imaging device

Claims (11)

An image sensor for imaging subject light;
A display unit for displaying a through image based on image data output from the image sensor;
A setting unit for setting a self-portrait mode in which an operator shoots himself while confirming the composition of the through image displayed on the display unit;
An extraction unit that extracts region image data of a predetermined region from the image data when the selfie mode is set by the setting unit;
A display control unit for displaying a region image based on the region image data on the display unit;
A first instruction unit for giving a first instruction;
A composition correction unit that starts composition correction of the region image when the first instruction is given by the first instruction unit;
A second instruction unit for giving a second instruction;
An image pickup apparatus comprising: a storage unit that stores the region image data of the region image that has undergone the composition correction when the second instruction is given by the second instruction unit. A face recognition unit for recognizing at least one of the position and size of a human face from the region image data;
A determination unit that determines a reference composition that serves as a reference for composition correction based on at least one of the position and size of the face of the person recognized by the face recognition unit when the first instruction is given; ,
The composition correction unit changes at least one of the position and the size of the predetermined region of the region image data extracted by the extraction unit so that the composition of the region image becomes the same composition as the reference composition. The imaging apparatus according to claim 1, wherein: A movement detection unit for detecting the movement amount of the imaging device;
The composition correction unit changes the predetermined region of the region image data extracted by the extraction unit based on a movement amount detected by the movement detection unit. Imaging device.   The imaging apparatus according to claim 2, wherein the extraction unit extracts the area image data of an area centered on a human face from the image data. A support unit that rotatably supports the display unit in a closed state in which the display unit is housed in the back surface of the imaging apparatus or an open state in which the display surface of the display unit is directed in the shooting direction;
The imaging device according to claim 1, wherein the setting unit sets the self-portrait mode when a display surface of the display unit is in an open state.   The first instruction unit performs the first instruction when the shutter button is half-pressed, and the second instruction unit performs the second instruction when the shutter button is fully pressed. An imaging apparatus according to any one of claims 1 to 5, wherein A motion detection unit that detects that a specific motion change has occurred in the human image included in the region image data;
The first instruction unit performs the first instruction when it is detected by the motion detection unit that the specific motion change has occurred in the person image included in the region image data,
The second instruction unit is configured to detect that the specific motion change is detected by the motion detection unit when the motion detection unit detects that the human image included in the region image data has the specific motion change. The imaging apparatus according to any one of claims 1 to 5, wherein the second instruction is performed when a predetermined time has elapsed since it was detected. A line-of-sight detection unit that detects the line of sight of a person from the area image data;
6. The imaging apparatus according to claim 1, wherein the second instruction unit performs the second instruction when a line of sight of a person is detected by the line-of-sight detection unit.   The imaging apparatus according to any one of claims 2 to 8, further comprising a notifying unit that notifies that it is difficult to change the predetermined area by the composition correcting unit.   It is difficult for the notification unit to change the predetermined region when the edge of the region image data is in contact with the edge of the image data and when the region image data is out of frame from the image data. The image pickup apparatus according to claim 9, wherein the fact that the change has occurred is notified.   The imaging device according to claim 9 or 10, wherein the notification unit includes at least one of a speaker that outputs a warning sound and a light emitting unit that emits predetermined light.

Images