JP2013009204A - Imaging device, imaging method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device that can subsidiarily present an image in which a composition desired by a photographer is fixed even under a condition where a subject moves around, and an imaging method and a program therefor.SOLUTION: The imaging device includes a main subject candidate detection unit 103 for detecting a moving subject that moves in a screen with elapse of time as a main subject candidate being a candidate of a main subject determined according to the moving direction on the basis of change of image information respectively contained in a plurality of pieces of image data generated consecutively; a main subject setting unit 104 that sets the main subject candidate as the main subject if the main subject candidate detected by the main subject candidate detection unit 103 moves in a moving direction determined by the moving direction determination unit 102; and an image detection unit 105 that detects an image in which the main subject set by the main subject setting unit 104 is present in a prescribed area from among a temporarily stored image group.

Description

  The present invention relates to an imaging apparatus, an imaging method, and a program that generate electronic image data by imaging a subject and performing photoelectric conversion.

  2. Description of the Related Art In recent years, there has been known a technique capable of automatically taking an image when an object has a specific expression or pose in an imaging apparatus such as a digital camera or a digital video camera (see Patent Document 1). In this technique, a subject's face is extracted from a live view image sequentially generated by an imaging unit, and photographing is performed when the extracted subject's face matches a specific pattern.

JP 2004-294498 A

  However, in the above-described technique, when the subject moves around during shooting, the position of the subject's face and the shooting composition change in the live view image each time, so the face extracted from the live view image The composition when matching with a specific pattern changes, and the main subject cannot always be imaged with a predetermined composition.

  The present invention has been made in view of the above, and captures an image in which a main subject is captured with a predetermined composition even under a situation in which a main subject to be photographed moves during shooting. It is an object to provide an imaging apparatus, an imaging method, and a program capable of performing the above.

  In order to solve the above-described problems and achieve the object, an imaging device according to the present invention includes an imaging unit that images a subject and continuously generates image data of the subject, and the image generated by the imaging unit. An imaging apparatus comprising: a display unit that displays images corresponding to data in the order of generation; and a temporary storage unit that temporarily stores the image data generated by the imaging unit in the order of generation. A moving direction determining unit that determines a direction, and a moving subject that moves within the screen with the passage of time in the moving direction based on a change in image information included in each of the plurality of image data that are continuously generated. A main subject candidate detection unit that detects a main subject candidate that is a candidate for a main subject that is determined in response to the main subject candidate that is detected by the main subject candidate detection unit. A main subject setting unit that sets the main subject candidate as the main subject, and an image in which the main subject set by the main subject setting unit is located in a predetermined area. And an image detection unit that detects from the image group temporarily stored in the temporary storage unit.

  In the imaging device according to the aspect of the invention, in the above invention, the main subject setting unit may be configured such that the moving direction in which the main subject candidate moves matches the moving direction determined by the moving direction determination unit a plurality of times. The main subject candidate is set as the main subject.

  In the imaging device according to the present invention, in the above invention, the predetermined region is a substantially central portion of the image, and the main subject is included in the image data corresponding to the image detected by the image detection unit. And an information adding unit for adding information indicating that the image is a central image located in the central part.

  According to the imaging device of the present invention, in the above invention, when the release switch receives an input of an instruction signal instructing the imaging device to shoot, and when the release switch receives the input of the instruction signal, the imaging unit A shooting control unit that acquires the image data to be generated, and a captured image corresponding to the image data acquired by the shooting control unit are displayed on the display unit, and are included in the image data group that is temporarily stored in the temporary storage unit And a display control unit that displays at least a part of the plurality of images on the display unit.

  Moreover, the imaging device according to the present invention is characterized in that, in the above invention, the display control unit causes the display unit to display the central image to which the information adding unit has added the information in a display mode in which the information can be identified. To do.

  In the imaging device according to the present invention as set forth in the invention described above, the display control unit causes the display unit to display the central image and the captured image side by side.

  Moreover, in the imaging device according to the present invention, in the above invention, the display control unit displays a plurality of images included in the image data group on the display unit while sliding the display screen of the display unit in the order of generation. It is characterized by that.

In the imaging device according to the present invention, in the above invention, an input unit that receives an input of a selection signal for selecting an image from at least some of the plurality of images displayed by the display unit;
And an image data storage unit that stores image data corresponding to an image corresponding to the selection signal received by the input unit.

  The imaging apparatus according to the present invention further includes an acceleration detection unit that detects an acceleration of the imaging apparatus according to the above invention, and the movement direction determination unit is configured to perform the movement direction based on a detection result of the acceleration detection unit. It is characterized by determining.

  In the imaging device according to the present invention, in the above invention, the moving direction determination unit determines that the imaging device is in a moving state when the acceleration detected by the acceleration detection unit changes substantially periodically. It is characterized by that.

  The imaging apparatus according to the present invention further includes an orientation detection unit that detects an orientation when the optical axis of the imaging unit is used as a reference in the above invention, and the movement direction determination unit is detected by the orientation detection unit. The moving direction is determined based on the result.

  In the imaging device according to the present invention, in the above invention, the moving direction determination unit determines that the imaging device is in a moving state when a detection result detected by the azimuth detecting unit changes substantially periodically. It is characterized by that.

  The imaging apparatus according to the present invention further includes a contrast detection unit that detects a contrast based on the image, and the moving direction determination unit is based on a change in contrast detected by the contrast detection unit. Then, the moving direction is determined.

  In addition, the imaging method according to the present invention is executed by an imaging device that captures an image of a subject, continuously generates image data of the subject, displays images corresponding to the image data in the order of generation, and temporarily stores the image. An imaging method, wherein a moving direction determination step for determining a moving direction in which the imaging apparatus moves and a change in image information included in each of the plurality of image data generated in succession over time A main subject candidate detecting step for detecting a moving subject moving in the screen as a main subject candidate that is a candidate for a main subject determined according to the moving direction, and the main subject candidate detected by the main subject candidate detecting step is When moving in the moving direction determined by the moving direction determining unit, the main subject candidate is set as the main subject. A main object setting step, the image which the said main subject main subject setting step has set is positioned in a predetermined area, characterized in that it comprises an image detection step of detecting the temporary stored images, the.

  The program according to the present invention is a program for capturing an image of a subject, continuously generating image data of the subject, displaying images corresponding to the image data in the order of generation, and causing the image capturing apparatus capable of temporary storage to execute the program. And a moving direction determining step for determining a moving direction in which the imaging apparatus moves, and a change in image information included in each of the plurality of image data generated in succession. A main subject candidate detecting step for detecting a moving subject that moves in a main subject candidate that is a main subject candidate determined according to the moving direction, and the main subject candidate detected by the main subject candidate detecting step is the moving direction. When moving in the movement direction determined by the determination unit, the main subject candidate is set as the main subject. A main subject setting step, and an image detection step of detecting, from a temporarily stored image group, an image in which the main subject set by the main subject setting step is located in a predetermined region. .

  According to the present invention, if the main subject candidate detected by the main subject detection unit is moving in the moving direction of the imaging apparatus determined by the moving direction determination unit, the main subject setting unit selects the main subject candidate as the main subject. The image detection unit detects an image in which the main subject set by the main subject setting unit is located in a predetermined area from the image group temporarily stored in the temporary storage unit. Thus, even when the main subject to be photographed by the photographer moves during photographing, an image obtained by capturing the main subject with a predetermined composition can be extracted.

FIG. 1 is a diagram illustrating a configuration of a side facing a subject of the imaging apparatus according to the first embodiment of the present invention. FIG. 2 is a diagram illustrating a configuration on the side facing the photographer of the imaging apparatus according to the first embodiment of the present invention. FIG. 3 is a block diagram illustrating a configuration of the imaging apparatus according to the first embodiment of the present invention. FIG. 4 is a flowchart illustrating an outline of processing performed by the imaging apparatus according to the first embodiment of the present invention. FIG. 5 is a diagram illustrating a situation when the photographer photographs using the imaging device. FIG. 6 is a flowchart showing an outline of the main subject candidate determination process of FIG. FIG. 7 is a diagram schematically illustrating a situation when the main subject determination unit determines the main subject. FIG. 8 is a diagram illustrating an example of an image corresponding to image data generated by the imaging unit under the situation illustrated in FIG. FIG. 9 is a diagram illustrating the relationship between the subject and the imaging region of the imaging device under the situation illustrated in FIG. FIG. 10 is a flowchart showing an outline of the slide image display process shown in FIG. FIG. 11 is a diagram illustrating an example of an image displayed on the display unit. FIG. 12 is a block diagram illustrating a configuration of the imaging apparatus according to the second embodiment of the present invention. FIG. 13 is a flowchart illustrating an outline of main subject candidate determination processing performed by the imaging apparatus according to the second embodiment of the present invention. FIG. 14 is a diagram schematically illustrating a situation when the movement direction determination unit determines the movement state of the imaging apparatus. FIG. 15 is a top view in the direction of arrow A in FIG. 16 is a side view in the direction of arrow B in FIG. FIG. 17 is a diagram schematically illustrating the relationship between the speed of the imaging device and the acceleration detected by the acceleration detection unit when the photographer moves the imaging device. FIG. 18 is a diagram schematically illustrating a situation when the movement direction determination unit determines the movement state of the imaging apparatus. FIG. 19 is a diagram schematically illustrating the relationship between the speed of the imaging device and the detection result detected by the azimuth detecting unit when the photographer moves the imaging device. FIG. 20 is a diagram schematically illustrating a situation when the moving direction determination unit determines the moving state of the imaging apparatus. FIG. 21 is a diagram schematically illustrating the relationship between the gravitational accelerations in the optical axis direction and the vertical direction in the imaging apparatus when the photographer moves the imaging apparatus. FIG. 22 is a block diagram illustrating a configuration of the imaging apparatus according to the third embodiment of the present invention. FIG. 23 is a flowchart illustrating an outline of an operation performed by the imaging apparatus according to the third embodiment of the present invention. FIG. 24 is a diagram schematically illustrating a situation when the contrast detection unit detects the contrast of the image data generated by the imaging unit. FIG. 25 is a diagram illustrating the relationship between the contrast of the image data detected by the contrast detection unit and the shooting distance from the imaging device to the subject under the situation illustrated in FIG. FIG. 26 is a flowchart showing an outline of the main subject candidate determination process of FIG.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings. The present invention is not limited to the embodiments described below. In the description of the drawings, the same parts are denoted by the same reference numerals.

(Embodiment 1)
FIG. 1 is a diagram illustrating a configuration on the side facing the subject (front side) of the imaging apparatus 1 according to the first embodiment of the present invention. FIG. 2 is a diagram illustrating a configuration of a side (back side) facing the photographer of the imaging apparatus 1 according to the first embodiment of the present invention. FIG. 3 is a block diagram illustrating a configuration of the imaging apparatus 1 according to the first embodiment of the present invention.

  As shown in FIGS. 1 to 3, the imaging apparatus 1 includes an imaging unit 2, an acceleration detection unit 3, a timer 4, a light emitting unit 5, an operation input unit 6, a display unit 7, a touch panel 8, A storage unit 9 and a control unit 10 are provided.

  The imaging unit 2 captures a predetermined visual field and generates image data. The imaging unit 2 includes a lens unit 21, a lens driving unit 22, a diaphragm 23, a diaphragm driving unit 24, a shutter 25, a shutter driving unit 26, an imaging element 27, an imaging driving unit 28, and a signal processing unit. 29.

  The lens unit 21 includes a plurality of lens groups that can be focused and zoomed, and collects light from a predetermined field of view. The lens driving unit 22 is configured using a stepping mode or a DC motor, and changes the focus position, focal length, and the like of the lens unit 21 by moving the lens group of the lens unit 21 along the optical axis O1. .

  The diaphragm 23 adjusts exposure by limiting the amount of incident light collected by the lens unit 21. The aperture drive unit 24 is configured by a stepping motor or the like, and drives the aperture 23.

  The shutter 25 sets the state of the image sensor 27 to an exposure state or a light shielding state. The shutter drive unit 26 is configured by a stepping motor or the like, and drives the shutter 25 according to a release signal.

  The image sensor 27 is configured by a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The image sensor 27 receives light collected by the lens unit 21 and performs photoelectric conversion to convert the light into an electrical signal (analog signal). The imaging drive unit 28 generates a timing pulse for driving the imaging device 27 and causes the signal processing unit 29 to output an electrical signal photoelectrically converted by the imaging device 27.

  The signal processing unit 29 is configured by an analog amplifier, an A / D converter, or the like. The signal processing unit 29 performs signal processing such as amplification (gain adjustment) on the electrical signal output from the image sensor 27, and then converts the electrical signal into digital front image data by performing A / D conversion. Output to.

  The acceleration detection unit 3 is configured using a capacitance type acceleration sensor formed by a MEMS (Micro Electro Mechanical Systems) process. The acceleration detection unit 3 includes three acceleration sensors whose acceleration detection directions are orthogonal to each other. Specifically, as a coordinate system unique to the imaging device 1, the x axis parallel to the width direction of the imaging device 1, the y axis parallel to the vertical direction of the imaging device 1, and the optical axis O 1 of the imaging unit 2 are parallel. Three acceleration sensors that take the z axis and detect acceleration components in the respective axial directions are attached to predetermined positions of the imaging apparatus 1. According to the acceleration detection unit 3 having such a configuration, when the photographer moves the imaging apparatus 1 toward the subject side (z direction), the horizontal direction (x direction), and the vertical direction (y direction), Acceleration caused by movement can be accurately detected. The acceleration detection unit 3 detects the acceleration in each direction of the imaging device 1 when the horizontal direction of the image displayed on the display unit 7 and the horizontal direction of the imaging device 1 are substantially equal. According to the acceleration detection unit 3 having such a configuration, when the user moves the imaging apparatus 1 toward the subject side (z direction), the acceleration generated by this movement can be accurately detected.

  The timer 4 has a timekeeping function and a shooting date / time determination function. The timer 4 outputs date / time data to the control unit 10 in order to add date / time data to the captured image data.

  The light emitting unit 5 is configured using a xenon lamp, an LED (Light Emitting Diode), or the like. The light emitting unit 5 irradiates strobe light that is auxiliary light toward a visual field region that is imaged by the imaging device 1.

  The operation input unit 6 includes a power switch 61 that switches the power state of the imaging apparatus 1 to an on state or an off state, a release switch 62 that receives an input of a release signal that gives a shooting instruction, and various shootings that are set in the imaging apparatus 1. A shooting mode changeover switch 63 for switching modes and a menu switch 64 for setting various parameters of the image pickup apparatus 1 are provided.

  The display unit 7 is realized using a display panel made of liquid crystal, organic EL (Electro Luminescence), or the like. The display unit 7 displays an image corresponding to the image data. The display unit 7 displays information related to operation instructions of the imaging apparatus 1 and shooting information related to shooting.

  The touch panel 8 is provided on the display screen of the display unit 7. The touch panel 8 detects a position touched (touched) by the user based on information displayed on the display unit 7 and receives an input of an instruction signal corresponding to the detected contact position. In general, the touch panel includes a resistance film method, a capacitance method, an optical method, and the like. In the first embodiment, any type of touch panel is applicable. In the first embodiment, the touch panel 8 functions as an input unit.

  The storage unit 9 is realized using a semiconductor memory such as a flash memory or a DRAM (Dynamic Random Access Memory) that is fixedly provided inside the imaging apparatus 1. The storage unit 9 includes an image data storage unit 91 that stores image data, various programs executed by the imaging apparatus 1, a program storage unit 92 that stores various data and parameters used during the execution of the program, and an imaging unit 2 has a temporary storage unit 93 that temporarily stores a plurality of image data continuously generated and various contents being processed. The storage unit 9 may include a computer-readable storage medium such as a memory card mounted from the outside.

  The control unit 10 is configured using a CPU (Central Processing Unit) or the like. The control unit 10 comprehensively controls the operation of the imaging apparatus 1 by performing instructions and data transfer corresponding to each part of the imaging apparatus 1 according to an instruction signal, a switching signal, and the like from the operation input unit 6 and the touch panel 8. To control.

  A detailed configuration of the control unit 10 will be described. The control unit 10 includes an image processing unit 101, a moving direction determination unit 102, a main subject candidate detection unit 103, a main subject setting unit 104, an image detection unit 105, an information addition unit 106, and a shooting control unit 107. And a display control unit 108.

  The image processing unit 101 performs various types of image processing on the image data. Specifically, the image processing unit 101 performs image processing including edge enhancement processing, white balance processing, and γ correction processing on the image data. The image processing unit 101 performs image data compression processing and decompression processing based on a JPEG (Joint Photographic Experts Group) method or the like.

  The movement direction determination unit 102 determines the movement direction in which the imaging apparatus 1 moves based on the detection result of the acceleration detection unit 3. Specifically, the movement direction determination unit 102 determines whether or not the imaging device 1 is moving in the horizontal direction based on the change in the horizontal acceleration detected by the acceleration detection unit 3.

  The main subject candidate detection unit 103 determines a moving subject that moves in the screen over time based on a change in image information included in each of a plurality of pieces of image data generated in succession according to a moving direction. It is detected as a main subject candidate that is a subject candidate. Here, the image information is edge information, color information, luminance information, and shading information. The main subject candidate detection unit 103 performs predetermined processing, such as edge detection processing and binarization processing, on each of a plurality of continuously generated image data, and moves within the screen over time. The moving subject is detected as a main subject candidate which is a main subject candidate determined according to the moving direction. Specifically, the main subject detection unit 103 detects a moving subject that moves within the screen with the passage of time, based on the position or distance at which the image information of each pixel, for example, the color information has moved with the passage of time. Note that the main subject candidate detection unit 103 may detect a moving subject that moves by pattern matching or other known techniques as a main subject candidate.

  The main subject setting unit 104 sets the main subject candidate as the main subject when the main subject candidate detected by the main subject candidate detection unit 103 is moving in the movement direction of the imaging apparatus 1 determined by the movement direction determination unit 102. To do.

  The image detection unit 105 detects an image in which the main subject set by the main subject setting unit 104 is located in a predetermined area from the image group temporarily stored in the temporary storage unit 93. Specifically, the image detection unit 105 detects an image in which the main subject set by the main subject setting unit 104 is located in a predetermined area, for example, a substantially central portion, from the image group stored in the temporary storage unit 93.

  The information adding unit 106 adds a tag as information indicating that the image is the central image to the image data corresponding to the central image detected by the image detecting unit 105.

  When a release signal is input, the shooting control unit 107 performs control for starting a shooting operation in the imaging apparatus 1. Here, the imaging operation in the imaging apparatus 1 refers to an operation in which the signal processing unit 29 and the image processing unit 101 perform predetermined processing on the image data output from the imaging element 27 by driving the imaging driving unit 28. The image data processed in this way is stored in the image data storage unit 91 under the control of the photographing control unit 107. Further, when no release signal is input via the release switch 62, the imaging control unit 107 stores the image data continuously output by the imaging unit 2 in the temporary storage unit 93 in the order of output.

  The display control unit 108 causes the display unit 7 to display an image corresponding to the image data generated by the imaging unit 2. The display control unit 108 causes the display unit 7 to display a captured image corresponding to the captured image data, and sequentially displays at least some of the plurality of images included in the image data group stored in the temporary storage unit 93 on the display unit 7. Display.

  A communication unit capable of bidirectional communication with an external processing device (not shown) such as a personal computer via the Internet via the voice input / output function, a removable electronic viewfinder (EVF), and the Internet. Etc. may be provided.

  Next, processing performed by the imaging apparatus 1 according to the first embodiment will be described. FIG. 4 is a flowchart illustrating an outline of processing performed by the imaging apparatus 1.

  In FIG. 4, the case where the imaging device 1 is set to the shooting mode (step S101: Yes) will be described. In this case, under the control of the imaging control unit 107, the imaging device 1 causes the imaging unit 2 to image a predetermined visual field region to generate image data (step S102), and the generated image data is stored in the temporary storage unit 93. Temporary storage is performed (step S103).

  Subsequently, the display control unit 108 causes the display unit 7 to display a live view image corresponding to the image data generated by the imaging unit 2 (step S104).

  FIG. 5 is a diagram illustrating a situation when the photographer photographs using the imaging apparatus 1. As shown in FIG. 5, the photographer K1 determines a composition for photographing the subject A1 (flower) while viewing a live view image displayed on the display unit 7, for example.

  After step S104, the movement direction determination unit 102 determines whether or not the imaging device 1 is moving (step S105). Specifically, the movement direction determination unit 102 is based on the movement of the apparatus by the photographer other than the constant gravitational acceleration among the accelerations in the vertical direction (y-axis direction) and the horizontal direction (x-axis direction). When the acceleration change is detected, it is determined that the imaging device 1 is moving. When the moving direction determination unit 102 determines that the imaging device 1 is moving (step S105: Yes), the imaging device 1 proceeds to step S106 described later. On the other hand, when the movement direction determination unit 102 determines that the imaging device 1 has not moved (step S105: No), the imaging device 1 proceeds to step S111 described below.

  In step S <b> 106, in step S <b> 106, the imaging device 1 detects a main subject candidate, and executes main subject candidate determination processing for determining characteristics related to movement of the detected candidate.

  FIG. 6 is a flowchart showing an outline of main subject candidate determination processing in step S106 of FIG.

  As illustrated in FIG. 6, the moving direction determination unit 102 determines the moving direction from the change in acceleration generated in the imaging device 1 based on the detection result detected by the acceleration detection unit 3 (step S201), and the imaging device. It is determined whether 1 is moving in the horizontal direction (step S202). Specifically, the movement direction determination unit 102 determines whether or not the acceleration detection unit 3 has detected acceleration in the horizontal direction. When the movement direction determination unit 102 determines that the imaging device 1 is moving in the horizontal direction (step S202: Yes), the imaging device 1 proceeds to step S203 described later. On the other hand, when the movement direction determination unit 102 determines that the imaging device 1 has not moved in the horizontal direction (step S202: No), the imaging device 1 returns to the main routine illustrated in FIG.

  In step S203, the main subject candidate detection unit 103 detects a moving subject that moves in the live view image displayed by the display unit 7 as a main subject candidate. Specifically, the main subject candidate detection unit 103 detects, as a moving subject region, a region that changes approximately periodically between successive images based on changes in image information included in each successive live view image. For example, the main subject candidate detection unit 103 divides the live view image into predetermined regions (for example, nine divisions), and detects regions in which the image information changes in a predetermined frequency band in the divided regions as moving subject regions. To do. This predetermined frequency band is 2 Hz to 5 Hz.

  Subsequently, the main subject setting unit 104 determines whether or not the main subject candidate detected by the main subject candidate detection unit 103 is moving in the moving direction of the imaging apparatus 1 determined by the moving direction determination unit 102. (Step S204). When the main subject candidate is moving in the moving direction of the imaging apparatus 1 determined by the moving direction determination unit 102 (step S204: Yes), the main subject setting unit 104 stores the characteristics of the main subject candidate in the temporary storage unit. 93 is temporarily stored (step S205). Thereafter, the imaging apparatus 1 returns to the main routine of FIG. On the other hand, when the main subject candidate has not moved in the moving direction of the imaging apparatus 1 determined by the moving direction determination unit 102 (step S204: No), the imaging apparatus 1 returns to the main routine of FIG.

FIG. 7 is a diagram schematically illustrating a situation when the main subject setting unit 104 determines the main subject. FIG. 8 is a diagram illustrating an example of an image corresponding to the image data generated by the imaging unit 2 under the situation illustrated in FIG. FIG. 9 is a diagram illustrating a relationship between the subject A1 and the imaging region of the imaging device 1 under the situation illustrated in FIG. In FIG. 7, the imaging region of the imaging device 1 is indicated by a one-dot chain line. In FIG. 9, the horizontal axis t represents time, and the vertical axis D represents the displacement moved from the position where the subject A1 and the imaging device 1 are stationary. Furthermore, in FIG. 9, the displacement D when moving in the right direction shown in FIG. 7 is positive. In FIG. 9, the curve L ₁ indicates the displacement of the center position of the subject A 1, and the curve L ₂ indicates the displacement of the center position of the imaging region of the imaging device 1.

  As shown in FIG. 7, when the photographer K1 is about to photograph the subject A1 as the main subject (FIG. 7A), when the gust blows in the right direction (arrow Y1), the subject A1 Shake while tilting in the direction (FIG. 7B). At this time, the photographer K1 moves the position of the imaging device 1 (panning operation) in accordance with the movement of the subject A1 in order to photograph the subject A1 at substantially the center of the photographing region. As a result, the shooting area of the imaging apparatus 1 changes from the shooting area F1 to the shooting area F2.

  Thereafter, since the gust of wind stops, the subject A1 moves leftward (arrow Y2) and tries to return to the original state (FIG. 7C), so that the photographer K1 moves the position of the imaging device 1 in the opposite direction ( Move left). As a result, the shooting area of the imaging apparatus 1 changes from the shooting area F2 to the shooting area F3.

  Subsequently, the subject A1 moves further leftward (arrow Y2) from the original position due to inertia (FIG. 7D). For this reason, since the photographer K1 further moves the position of the imaging apparatus 1, the imaging area of the imaging apparatus 1 changes from the imaging area F3 to the imaging area F4.

By such an operation of shooting while following the subject A1 by the photographer K1, there is a time difference until the photographer K1 performs a shooting operation while viewing the live view image displayed on the display unit 7. Specifically, as shown in FIG. 9, the photographer K1 has a time delay from the movement of the subject A1 to the movement of the imaging device 1 (time T _{1 in} FIG. 9). Furthermore, it is difficult for the photographer K1 to follow the subject A1 moving in response to the wind while being fixed at the center of the photographing region, and as a result, the time to reach the maximum displacement is delayed (T _{2 in} FIG. 9). For example, as shown in FIGS. 8A and 8B, since the subject A1 moves in the right direction (image W ₁ → image W ₂ ), the photographer K1 follows the movement of the subject A1. The imaging region is moved by moving the imaging device 1 (time t _{1 to} t _{2 in} FIG. 9).

Thereafter, as shown in FIGS. 8B and 8C, when the gust stops and the subject A1 moves leftward to return to the original state (time t _{2 to} t _{3 in} FIG. 9). When the displacement of the photographing area of the imaging device 1 that the photographer K1 is moving in the right direction matches the displacement of the subject A1 (the traveling directions are opposite to each other), the image of the subject A1 is located at substantially the center (image W ₃₎ to become.

Subsequently, as shown in FIGS. 8D to 8E, the subject A1 further moves leftward (arrow b2) and moves rightward (image W ₃ → image W ₄ → image W). _5), the photographer K1 moves the imaging region by moving the imaging apparatus 1 to follow the movement of the subject A1 (time t ₃ ~t ₆ in FIG. 9). At this time, by the position of the center of the imaging area of the central position and the imaging device 1 of the object A1 intersect again (time t ₆ in FIG. 9), the image object A1 is positioned substantially at the center (image W ₅₎ Is photographed (see FIG. 8E). Further, the displacement of the subject A1 and the displacement of the photographing region when the photographer K1 moves the imaging device 1 are substantially periodic. Here, “substantially periodic” generally indicates that the displacement reciprocates between positive and negative.

  As described above, when the photographer K1 moves the imaging device 1 in the horizontal direction and reciprocates with a predetermined width, the main subject setting unit 104 has a subject A1 that moves in the moving direction of the imaging device 1. The photographer K1 is set as a main subject desired to be photographed. Thus, the main subject setting unit 104 determines the follow-up action of the photographer K1 even when the subject A1 moves violently due to wind or the like and the composition of the photographing is not fixed, and the photographer The main subject desired by K1 can be set as an object to be tracked by shooting.

  Returning to FIG. 4, the description of step S107 and subsequent steps will be continued. In step S107, the main subject setting unit 104 determines whether the main subject candidates detected by the main subject candidate detection unit 103 are the same multiple times. When the main subject candidates detected by the main subject candidate detection unit 103 are the same multiple times (step S107: Yes), the main subject setting unit 104 uses the main subject candidate detected by the main subject candidate detection unit 103 as the main subject. Setting is made (step S108).

  Subsequently, the image detection unit 105 determines whether or not the main subject is reflected in the central area of the live view image (step S109). When the image detection unit 105 determines that the main subject is reflected in the center area of the live view image (step S109: Yes), the information addition unit 106 corresponds to the live view image currently displayed on the display unit 7. A tag is added to the image data as information that can be distinguished from other image data groups stored in the temporary storage unit 93 (step S110). Thereafter, the imaging apparatus 1 proceeds to step S111 described later. On the other hand, when the image detection unit 105 determines that the main subject is not captured in the central region of the live view image (step S109: No), the imaging device 1 proceeds to step S111 described later.

  Subsequently, when a release signal is input by operating the release switch 62 (step S111: Yes), the imaging device 1 performs shooting under the control of the shooting control unit 107 (step S112). The image data generated by the imaging unit 2 is stored in the image data storage unit 91 (step S113).

  Thereafter, the control unit 10 determines whether there is image data in the temporary storage unit 93 (step S114). When the control unit 10 determines that there is image data in the temporary storage unit 93 (step S114: Yes), the imaging device 1 proceeds to step S115 described later. On the other hand, when the control unit 10 determines that there is no image data in the temporary storage unit 93 (step S114: No), the imaging device 1 proceeds to step S118 described later.

  In step S <b> 115, the control unit 10 determines whether there is image data to which a tag is added in the image data group stored in the temporary storage unit 93. When the control unit 10 determines that there is image data to which a tag is added in the image data group stored in the temporary storage unit 93 (step S115: Yes), the imaging device 1 is stored in the temporary storage unit 93. A slide image display process is performed for sliding the image data group on the display screen of the display unit 7 while sequentially displaying the image data group on the display unit 7 (step S116). Details of the slide image display process will be described later. After step S116, the imaging apparatus 1 proceeds to step S117.

  Subsequently, the control unit 10 determines whether or not the power supply of the imaging apparatus 1 is in an off state by operating the power switch 61 (step S117). When the control unit 10 determines that the power of the imaging device 1 is off (step S117: Yes), the imaging device 1 ends this process. On the other hand, when the control unit 10 determines that the power supply of the imaging device 1 is not in the off state (step S117: No), the imaging device 1 returns to step S101.

  When the control unit 10 determines that there is no image data temporarily stored in the temporary storage unit 93 in step S114 (step S114: No), and in the image data group stored in the temporary storage unit 93 in step S115. A case where the control unit 10 determines that there is no image data to which a tag is added (step S115: No) will be described. In this case, the display control unit 108 causes the display unit 7 to display an image corresponding to the captured image data for a predetermined time (for example, 2 seconds) (step S118). Thereafter, the imaging apparatus 1 proceeds to step S117.

  In step S111, when a release signal is not input via the release switch 62 (step S111: No), the imaging device 1 proceeds to step S117.

  In step S107, when the main subject setting unit 104 determines that the main subject candidates detected by the main subject candidate detection unit 103 are not the same multiple times (step S107: No), the imaging apparatus 1 proceeds to step S111.

  Next, the case where the imaging apparatus 1 is not set to the shooting mode (step S101: No) and is set to the reproduction mode (step S119: Yes) will be described. In this case, the display control unit 108 causes the display unit 7 to display a list of reduced images (thumbnail images) obtained by reducing the images corresponding to the image data stored in the image data storage unit 91 (step S120).

  Subsequently, when an image to be enlarged and displayed via the operation input unit 6 or the touch panel 8 is selected from the list of reduced images (step S121: Yes), the display control unit 108 displays the selected image on the display unit 7. Is displayed on the full screen (step S122).

  Thereafter, when an image switching operation is performed via the operation input unit 6 or the touch panel 8 (step S123: Yes), the imaging device 1 returns to step S120. On the other hand, when the image switching operation is not performed via the operation input unit 6 or the touch panel 8 (step S123: No), the imaging apparatus 1 returns to step S122.

  A case will be described in which the image is enlarged through the operation input unit 6 or the touch panel 8 and the image is not selected from the list of reduced images in step S121 (step S121: No). In this case, the control unit 10 determines whether or not a predetermined time (for example, 3 seconds) has elapsed since the display unit 7 displayed the list of reduced images (step S124). When the control unit 10 determines that a predetermined time has elapsed since the display unit 7 displayed the list of reduced images (step S124: Yes), the imaging device 1 proceeds to step S117. On the other hand, when the control unit 10 determines that the predetermined time has not elapsed since the display unit 7 displayed the list of reduced images (step S124: No), the imaging device 1 returns to step S120.

  In step S119, when the imaging device 1 is not set to the reproduction mode (step S119: No), the imaging device 1 proceeds to step S117.

  Next, an outline of the slide image display process in step S116 of FIG. 4 will be described. FIG. 10 is a flowchart showing an outline of the slide image display process.

As illustrated in FIG. 10, the display control unit 108 causes the display unit 7 to display the captured image corresponding to the captured image data on the rec view (step S <b> 301). Specifically, as illustrated in FIG. 11A, the display control unit 108 causes the captured image W ₁₁ to be displayed in a rec view on the right area of the display unit 7.

Subsequently, the display control unit 108 starts displaying an image group corresponding to each of the image data groups temporarily stored in the temporary storage unit 93 (step S302). Specifically, as shown in FIG. 11 (b) and FIG. 11 (c), the display control unit 108, the temporary storage unit from the left side of the lower area display unit 7 is displaying quickview the captured image W ₁₁ The image W _n (n = natural number) corresponding to each image data temporarily stored in the image 93 is sequentially displayed on the display unit 7 while sliding (arrow (a)) (image W _n → image W _{n + 1} → image W _{n + 2} →... → image W _{n + 3} ).

Thereafter, the control unit 10 determines whether or not the tagged image to which the information adding unit 106 has added a tag in the image group displayed on the display unit 7 is displayed as a slide (step S303). When the control unit 10 determines that the tagged image to which the information adding unit 106 has added a tag in the image group displayed on the display unit 7 is slide-displayed (step S303: Yes), the display control unit 108 Causes the tagged image to be highlighted on the display unit 7 (step S304). Display Specifically, as shown in FIG. 11 (d), the display control unit 108 enlarges the display area of the upper part of the display unit 7 as a tagged image Wn ₊₃ can be compared with the captured image W ₁₁ Let Thus, the photographer K1 includes an image W _{n + 3} obtained by photographing the object A1 at a substantially central region of the image, photographer K1 is confirmed by comparing the captured image W ₁₁ taken by performing photographing operation be able to. After step S304, the imaging apparatus 1 proceeds to step S305 described later.

  In step S303, when the control unit 10 determines that the tagged image to which the information adding unit 106 has added a tag is not slide-displayed in the image group displayed on the display unit 7 (step S303: No). The imaging apparatus 1 proceeds to step S305 described later.

In step S <b> 305, the control unit 10 determines whether or not a selection operation for selecting an image to be stored in the image data storage unit 91 has been performed on the image group that the display unit 7 is slidingly displaying. Specifically, the control unit 10 determines whether a selection signal for selecting an image input from the menu switch 64 or the touch panel 8 is input. When the control unit 10 determines that a selection operation has been performed on the image group that the display unit 7 displays as a slide (step S305: Yes), the control unit 10 selects the selected image, for example, the image W _{n +.} The image data ₃ is stored in the image data storage unit 91 (step S306). Thereafter, the imaging apparatus 1 proceeds to step S307 described later.

  In step S305, if the selection operation is not performed on the image group that the display unit 7 slides and displays within a predetermined time (for example, 5 seconds) via the menu switch 64 or the touch panel 8, the control unit 10 When the determination is made (step S305: No), the imaging apparatus 1 proceeds to step S307 described later.

  In step S307, the control unit 10 determines whether or not the display of the image data group temporarily stored in the temporary storage unit 93 has been completed. When the control unit 10 determines that the display of all image data groups temporarily stored in the temporary storage unit 93 has been completed (step S307: Yes), the control unit 10 deletes all image data groups stored in the temporary storage unit 93. (Step S308). Thereafter, the imaging apparatus 1 returns to the main routine of FIG.

  In step S307, when the control unit 10 determines that the display of the image data group temporarily stored in the temporary storage unit 93 has not been completed (step S307: No), the imaging device 1 returns to step S303.

  According to the first embodiment of the present invention described above, the main subject setting unit 104 has the moving direction of the imaging apparatus 1 in which the main subject candidate detected by the main subject candidate detecting unit 103 is determined by the moving direction determining unit 102. The main subject candidate is set as a main subject, and the image detection unit 105 stores an image in which the main subject set by the main subject setting unit 104 is located in a predetermined area in the temporary storage unit 93. Detect from image group. As a result, an image obtained by capturing the main subject with a predetermined composition can be extracted even in a situation where the main subject to be photographed moves during the photographing.

  Furthermore, according to the first embodiment of the present invention, the display control unit 108 displays the captured image on the display unit 7 and displays an image corresponding to the image data group stored in the temporary storage unit 93 on the display unit 7. Let Thereby, the image before and after imaging | photography can be shown to a photographer.

  Further, according to Embodiment 1 of the present invention, the display control unit 108 sequentially displays on the display unit 7 in a display mode in which a center image in which the main subject to which the tag is added by the information adding unit 106 is captured can be identified. Display. Thereby, an image obtained by capturing the main subject with a predetermined composition desired by the photographer can be presented.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. The imaging apparatus according to the second embodiment of the present invention further includes an orientation detection unit that detects an orientation. Furthermore, the operation performed by the imaging apparatus according to the second embodiment of the present invention is different from the first embodiment described above in the main subject candidate determination process. Therefore, in the following, after describing the configuration of the azimuth detecting unit, the main subject candidate determination process of the operation performed by the imaging apparatus according to the second embodiment of the present invention will be described. In the description of the drawings, the same portions are denoted by the same reference numerals.

  FIG. 12 is a block diagram illustrating a configuration of the imaging apparatus 100 according to the second embodiment of the present invention. As illustrated in FIG. 12, the imaging apparatus 100 includes an imaging unit 2, an acceleration detection unit 3, a timer 4, a light emitting unit 5, an operation input unit 6, a display unit 7, a touch panel 8, and a storage unit 9. And a control unit 10 and an orientation detection unit 110.

  The direction detection unit 110 is configured by a geomagnetic sensor. The direction detection unit 110 detects a designated direction preset in the imaging apparatus 100. Specifically, the azimuth detecting unit 110 detects components of the vertical direction and the horizontal direction of the geomagnetism when the horizontal direction of the image displayed on the display unit 7 and the horizontal direction of the imaging device 100 are substantially equal, The azimuth of the imaging apparatus 100 when the optical axis O1 of the imaging unit 2 is set as a reference azimuth is detected.

  Next, a main subject candidate determination process performed by the imaging apparatus 100 according to the second embodiment will be described. FIG. 13 is a flowchart illustrating an outline of main subject candidate determination processing (step S106 in FIG. 4) performed by the imaging apparatus 100 according to the second embodiment.

  As illustrated in FIG. 13, the moving direction determination unit 102 determines the acceleration generated in the imaging device 100 based on the detection result detected by the acceleration detection unit 3 (step S401). When there is no acceleration in the z direction (optical axis O1 direction) (step S402: Yes), and the movement direction determination unit 102 determines that the acceleration in the y direction (vertical direction) is larger than the acceleration in the x direction (horizontal direction) (step) When the movement direction determination unit 102 determines that the detection result of the acceleration in the x direction or the y direction is periodically changed in S403 (Yes) (Step S404: Yes), the main subject candidate detection unit 103 displays A moving subject that moves in the live view image displayed by the unit 7 is detected as a subject candidate (step S405).

FIG. 14 is a diagram schematically illustrating a situation when the movement direction determination unit 102 determines the movement state of the imaging device 100. FIG. 15 is a top view of the subject viewed from the direction of arrow A in FIG. FIG. 16 is a side view of the subject viewed from the direction of arrow B in FIG. FIG. 17 is a diagram schematically illustrating the relationship between the speed of the imaging device 100 and the acceleration detected by the acceleration detection unit 3 when the photographer K1 moves the imaging device 100. In FIG. 17 (a), the horizontal axis t indicates time and the vertical axis v represents the speed of the imaging apparatus 100, the curve L ₁₁ indicates a change in the speed of the imaging apparatus 100. In FIG. 17B, the horizontal axis t represents time, and the vertical axis a represents acceleration. Further, in FIG. 17B, the curve L _x1 represents the horizontal acceleration of the imaging apparatus 100, the curve L _y1 represents the vertical acceleration of the imaging apparatus 100, and the curve L _z1 represents the optical axis direction of the imaging apparatus 100. Indicates the acceleration. In FIGS. 14 and 15, the case where the imaging apparatus 100 is moved in the right direction is considered as positive, and the case where it is moved in the left direction is considered as negative.

As shown in FIGS. 14 to 16, when the subject A1 moves irregularly, the photographer K1 follows the subject A1 while viewing the live view image displayed on the display unit 7, and thus the horizontal generated in the imaging device 1. The acceleration in the vertical direction is larger than the acceleration in the direction. Specifically, as shown in FIG. 17, when the photographer K1 moves the imaging device 1 in accordance with the movement of the subject A1 (time t _{1 to} t ₂ , time t _{5 to} t ₆ ), the acceleration detection unit 3 Detects the acceleration in the horizontal direction and the vertical direction, and detects a value in which the acceleration in the vertical direction is larger than the acceleration in the horizontal direction. Further, when the photographer K1 has stopped movement of the imaging device 100 (time t ₃ ~t _4, time t ₇ ~t _8), the acceleration detection unit 3 detects the acceleration in the horizontal direction and the vertical direction, horizontal A value in which the acceleration in the vertical direction is larger than the acceleration in the direction is detected. Furthermore, when the photographer K1 moves the imaging device 100 according to the substantially periodic movement of the subject A1, the horizontal and vertical accelerations detected by the acceleration detector 3 periodically change.

  As described above, when there is no acceleration in the direction of the optical axis O1 and the acceleration in the vertical direction is larger than the acceleration in the horizontal direction, the main subject setting unit 104 has periodic detection results of the horizontal and vertical accelerations. At this time, the main subject candidate detected by the main subject candidate detection unit 103 in the live view image displayed on the display unit 7 is set as the main subject.

  After step S405, step S406 and step S407 perform the same processing as step S204 and step S205 described above, and a description thereof will be omitted. After step S407, the imaging apparatus 100 returns to the main routine shown in FIG.

  A case will be described in which the moving direction determination unit 102 determines that the detection result of the acceleration in the x direction or the y direction of the imaging apparatus 100 is not periodic in step S404 (step S404: No). In this case, the movement direction determination unit 102 determines whether or not the detection result of the direction detection unit 110 is periodic (step S408). When the movement direction determination unit 102 determines that the detection result of the azimuth detection unit 110 is periodic (step S408: Yes), the imaging device 100 proceeds to step S405. On the other hand, when the movement direction determination unit 102 determines that the detection result of the azimuth detection unit 110 is not periodic (step S408: No), the imaging apparatus 100 returns to the main routine illustrated in FIG.

FIG. 18 is a diagram schematically illustrating a situation when the movement direction determination unit 102 determines the movement state of the imaging apparatus 100. FIG. 19 is a diagram schematically illustrating the relationship between the speed of the imaging device 100 and the detection result detected by the azimuth detecting unit 110 when the photographer K1 moves the imaging device 100. In FIG. 19 (a), the horizontal axis t indicates time and the vertical axis θ represents the detection result of the direction detection unit 110, the curve L ₁₁ indicates a change in the speed of the imaging apparatus 100. Further, in FIG. 19 (b), the horizontal axis represents time and the vertical axis represents the detection result of the direction detection unit 110, the curve L ₁₂ indicates a change in the detection result of the direction detection unit 110. In FIG. 18, the case where the imaging apparatus 100 is moved in the right direction is considered as positive.

As shown in FIGS. 18 and 19, when the subject A1 moves substantially periodically, the photographer K1 follows the subject A1 while viewing the live view image displayed on the display unit 7, and thus the direction detection unit 110 detects the subject A1. The detection result to be performed is substantially periodic. Specifically, as shown in FIG. 19, when the photographer K1 moves the imaging device 100 substantially periodically according to the movement of the subject A1 (time t _{1 to} t ₂ , time t _{5 to} t ₆ ), The numerical value detected by the azimuth detecting unit 110 changes approximately periodically.

  As described above, the main subject setting unit 104 displays the display when the detection result of the azimuth detection unit 110 changes substantially periodically when the detection result of the acceleration in the x direction or y direction of the imaging device 100 is not substantially periodic. The main subject candidate detected by the main subject candidate detection unit 103 in the live view image displayed by the unit 7 is set as the main subject.

  When the movement direction determination unit 102 determines that there is no change in acceleration in the z direction detected by the acceleration detection unit 3 in step S402 (step S402: No), the acceleration in the x direction detected by the acceleration detection unit 3 in step S403. A case where the movement direction determination unit 102 determines that the acceleration in the y-axis direction is not large (step S403: No) will be described. In this case, the imaging apparatus 100 returns to the main routine of FIG.

  According to the second embodiment of the present invention described above, the main subject setting unit 104 has the moving direction of the imaging apparatus 100 in which the main subject candidate detected by the main subject candidate detecting unit 103 is determined by the moving direction determining unit 102. If the main subject candidate is set as a main subject to be tracked by shooting, an image group in which the temporary storage unit 93 stores an image in which the main subject set by the main subject setting unit 104 is located in a predetermined area. Detect from. As a result, an image obtained by capturing the main subject with a predetermined composition can be extracted even in a situation where the main subject to be photographed moves during the photographing.

  Furthermore, according to Embodiment 2 of the present invention, when the detection result of acceleration in the horizontal direction or the vertical direction is not periodic, the main subject setting unit 104 periodically changes the detection result of the azimuth detection unit 110. The main subject candidate detected by the main subject candidate detection unit 103 in the live view image displayed on the display unit 7 is set as the main subject, and the main subject set by the main subject setting unit 104 is located in a predetermined area. Is detected from the image group stored in the temporary storage unit 93. As a result, it is possible to reliably acquire an image in which the photographing composition desired by the photographer is determined.

(Modification 1 of Embodiment 2)
In the second embodiment described above, the photographer K1 moves the imaging device 100 in parallel in the horizontal direction and the vertical direction. For example, the imaging device K1 does not change the way the arms are stretched, and the imaging device is on an arc. The present invention can also be applied when 100 is moved periodically.

FIG. 20 is a diagram schematically illustrating a situation when the movement direction determination unit 102 determines the movement state of the imaging apparatus 100. In FIG. 20, the X-axis is taken in the horizontal direction, the Y-axis (vertical down is positive) in the vertical direction, and the Z-axis in the direction orthogonal to the horizontal direction as the coordinate axes unique to the earth. FIG. 21 is a diagram schematically illustrating the relationship between the acceleration in the optical axis O1 direction and the vertical direction in the imaging apparatus 100 when the photographer K1 moves the imaging apparatus 100. In FIG. 21, the horizontal axis t indicates time, and the vertical axis a indicates the acceleration of the imaging apparatus 100. Further, the curve L _Y2 indicates the acceleration in the vertical direction with reference to the unique coordinate axis of the earth, and the curve L _Z2 indicates the acceleration in the optical axis O1 direction with reference to the unique coordinate axis of the earth.

  As shown in FIGS. 20 and 21, when the subject A1 moves at a constant height in the vertical direction substantially periodically, the photographer K1 follows the subject A1 while viewing the live view image displayed on the display unit 7. Therefore, since the imaging device 1 is moved up and down, the acceleration in the optical axis O1 direction and the vertical direction changes periodically.

  Thus, the main subject candidate detection unit 104 detects the main subject candidate detected by the main subject candidate detection unit 103 in the live view image displayed on the display unit 7 when the acceleration in the optical axis O1 direction and the vertical direction change periodically. Is set as the main subject.

  According to the modification of the second embodiment of the present invention described above, the live view displayed on the display unit 7 when the main subject setting unit 104 periodically changes the detection result of the acceleration in the optical axis direction or the vertical direction. An image group in which the main subject candidate detected by the main subject candidate detection unit 103 in the image is set as a main subject, and the temporary storage unit 93 stores an image in which the main subject set by the main subject setting unit 104 is located in a predetermined area. Detect from. As a result, it is possible to reliably acquire an image in which the photographing composition desired by the photographer is determined.

(Embodiment 3)
Next, a third embodiment of the present invention will be described. The imaging apparatus according to the third embodiment of the present invention is different from the imaging apparatus described above in the configuration of the storage unit and the control unit. Furthermore, the operation performed by the imaging apparatus according to the third embodiment of the present invention is different from the above-described embodiment. Therefore, in the following, after describing a configuration different from the above-described embodiment, the operation of the imaging apparatus according to the third embodiment of the present invention will be described. In the description of the drawings, the same portions are denoted by the same reference numerals.

  FIG. 22 is a block diagram illustrating a configuration of the imaging apparatus 200 according to the third embodiment of the present invention. As illustrated in FIG. 22, the storage unit 209 includes an image data storage unit 91, a program storage unit 92, a temporary storage unit 93, and a contrast storage unit 94.

  The contrast storage unit 94 stores an AF evaluation value indicating the focus position of the imaging unit 2 in which the contrast of image data detected by the contrast detection unit 211 described later is associated with each moving distance that the imaging device 200 moves. Here, the AF evaluation value is obtained by associating the maximum contrast value of the image data generated by the imaging unit 2 with the focus position of the imaging unit 2.

  The control unit 210 includes an image processing unit 101, a moving direction determination unit 102, a main subject candidate detection unit 103, a main subject setting unit 104, an image detection unit 105, an information addition unit 106, and a shooting control unit 107. The display control unit 108 and the contrast detection unit 211 are included.

  The contrast detection unit 211 detects the contrast of image data generated by the imaging unit 2 every time the imaging apparatus 200 moves. Specifically, the contrast detection unit 211 detects the contrast of the image data generated by the imaging unit 2 every time the imaging device 200 moves at a constant periodic interval (60 fps). The contrast detection unit 211 outputs the detected contrast of the image data to the contrast storage unit 94.

  An operation performed by the imaging apparatus 200 having the above configuration will be described. FIG. 23 is a flowchart illustrating an outline of operations performed by the imaging apparatus 200 according to the third embodiment of the present invention.

  Steps S501 to S505 correspond to steps S101 to S105 shown in FIG.

  In step S506, the movement direction determination unit 102 determines whether or not the imaging apparatus 200 is moving in the direction of the optical axis O1. Specifically, the movement direction determination unit 102 determines whether or not the acceleration detection unit 3 has detected acceleration in the direction of the optical axis O1. When the movement direction determination unit 102 determines that the imaging apparatus 200 is moving in the optical axis O1 direction (step S506: Yes), the imaging apparatus 200 proceeds to step S507 described later. On the other hand, when the movement direction determination unit 102 determines that the imaging apparatus 200 has not moved in the optical axis O1 direction (step S506: No), the imaging apparatus 200 proceeds to step S514 described later.

  In step S507, the contrast detection unit 211 detects the contrast of the image data generated by the imaging unit 2, and stores the detected contrast in the contrast storage unit 94 (step S508).

FIG. 24 is a diagram schematically illustrating a situation when the contrast detection unit 211 detects the contrast of the image data generated by the imaging unit 2. FIG. 25 is a diagram illustrating the relationship between the contrast of image data detected by the contrast detection unit 211 under the situation illustrated in FIG. 24 and the shooting distance from the imaging apparatus 200 to the subject A2. In FIG. 24, it is assumed that the focus lens included in the lens unit 21 of the imaging unit 2 is stopped (fixed) at a predetermined position on the optical axis O1 of the imaging unit 2, for example, the closest side position. In FIG. 25, the horizontal axis d indicates the shooting distance between the imaging device 200 and the subject A2, and the vertical axis c indicates the contrast. Further, the curve L ₂₁ shows the contrast.

In a situation shown in FIG. 24, by bringing the imaging apparatus 200 by the photographer K1 is fixed by the focal length D ₂ of the image pickup unit 2 with respect to the object A2 (FIG. 24 (a) ~ FIG 24 (c)), The contrast detected by the contrast detection unit 211 changes as indicated by a curve L ₂₁ shown in FIG. Specifically, as shown in FIG. 25, the contrast of the image data detected by the contrast detection unit 211 at the shooting distance D ₂ between the imaging device 200 and the subject A2 has a peak C ₂ at a point P ₂ . By imaging apparatus 200 in this peak C ₂ to shoot, it is possible to obtain the image data in focus on the subject A2. That is, in a state where the lens unit 21 is fixed on the optical axis O1 of the image pickup unit 2, the photographer K1 simply takes the image pickup apparatus 200 close to or away from the subject A2, and takes in-focus image data. can do.

Further, every time the imaging apparatus 200 moves in the direction of the optical axis O1, the imaging control unit 107 compares the contrast of the image data detected by the contrast detection unit 211 with the contrast stored by the contrast storage unit 94, and continuously. When the contrast of the image data decreases, the position immediately before the contrast of the image data decreases is determined as the contrast peak of the image data. Specifically, in FIG. 25, the imaging control unit 107 indicates that the contrast is detected at the points P ₂ (contrast C ₂ ) and P ₃ (contrast C ₃ ) at which the contrast detection unit 211 detects the contrast following the point P _1. In the case of the decrease, the point P ₂ is determined as the contrast peak of the image data.

  In step S509, the imaging control unit 107 determines whether the contrast detected by the contrast detection unit 211 is a peak (maximum value). If the imaging control unit 107 determines that the contrast detected by the contrast detection unit 211 is a peak (step S509: Yes), the imaging control unit 107 stores the contrast peak in the contrast storage unit 94 (step S510). Thereafter, the imaging apparatus 200 proceeds to step S511 described later. On the other hand, when the imaging control unit 107 determines that the contrast detected by the contrast detection unit 211 is not a peak (step S509: No), the imaging apparatus 200 proceeds to step S514 described later.

  In step S511, the imaging apparatus 200 executes main subject candidate determination processing for determining a candidate for a main subject that is a main subject in a shooting composition set by the photographer.

  FIG. 26 is a flowchart showing an outline of main subject candidate determination processing in step S511 of FIG.

  As illustrated in FIG. 26, the moving direction determination unit 102 determines whether or not the imaging device 200 is moving in the direction of the optical axis O1 based on the acceleration change detected by the acceleration detection unit 3 (step S601). When the movement direction determination unit 102 determines that the imaging apparatus 200 is moving in the optical axis O1 direction (step S601: Yes), the imaging apparatus 200 proceeds to step S602 described later. On the other hand, when the movement direction determination unit 102 determines that the imaging apparatus 200 has not moved in the optical axis O1 direction (step S601: No), the imaging apparatus 200 returns to the main routine of FIG.

  In step S602, the main subject candidate detection unit 103 detects a subject whose region changes in the live view image displayed by the display unit 7 as a main subject candidate. Specifically, the main subject candidate detection unit 103 detects, as subject candidates, subjects whose subject areas that appear in successive live view images are reduced or enlarged.

  Subsequently, the main subject setting unit 104 determines whether or not the main subject candidate detected by the main subject candidate detection unit 103 is changing toward the moving direction of the imaging apparatus 200 determined by the moving direction determination unit 102. (Step S603). When the main subject candidate detected by the main subject candidate detection unit 103 is changing toward the moving direction of the imaging apparatus 200 determined by the moving direction determination unit 102 (step S603: Yes), the main subject setting unit 104 The characteristics of the main subject candidate are stored in the temporary storage unit 93 (step S604). Thereafter, the imaging apparatus 1 returns to the main routine of FIG. On the other hand, when the main subject candidate detected by the main subject candidate detection unit 103 does not change toward the moving direction of the imaging device 200 determined by the moving direction determination unit 102 (step S603: No), the imaging device 200 Returning to the main routine of FIG.

  Returning to FIG. 23, the description from step S512 is continued. In step S512, the imaging control unit 107 matches the feature of the main subject set by the main subject setting unit 104 a plurality of times, with the live view image displayed by the display unit 7 being image data near the peak of contrast. If yes (step S512: Yes), the image data of the live view image displayed on the display unit 7 is stored in the image data storage unit 91 (step S513). Thereafter, the imaging apparatus 200 proceeds to step S514 described later. On the other hand, when the live view image displayed by the display unit 7 is image data in the vicinity of the contrast peak and does not coincide with the characteristics of the main subject set by the main subject setting unit 104 a plurality of times (step S512: No). The imaging apparatus 200 proceeds to step S514 described later.

  Steps S514 to S518 correspond to steps S111 to S113, S117, and step S118, respectively, shown in FIG.

  Next, the case where the imaging apparatus 200 is not set to the shooting mode (step S501: No) and is set to the reproduction mode (step S519: Yes) will be described. In this case, the imaging device 200 executes Steps S520 to S524. Steps S520 to S524 correspond to steps S120 to S124 shown in FIG.

  A case where the imaging apparatus 200 is not set to the reproduction mode in step S519 (step S519: No) will be described. In this case, the imaging device 200 proceeds to step S518.

  According to the third embodiment of the present invention described above, when the main subject setting unit 104 detects a contrast peak detected by the contrast detection unit 211, main subject candidate detection is performed in the live view image displayed on the display unit 7. The main subject candidate detected by the unit 103 is set as a main subject, and an image in which the main subject set by the main subject setting unit 104 is located in a predetermined area is detected from an image group stored in the temporary storage unit 93. As a result, it is possible to reliably acquire an image with a predetermined shooting composition desired by the photographer and to acquire an image focused on the main subject.

(Other embodiments)

  Further, in the above-described embodiment, even if the operation flow in the claims, the description, and the drawings is described using “first”, “next”, and the like for the sake of convenience, they should be performed in this order. Does not mean that is essential.

  In the above-described embodiment, the digital camera is described as the imaging device. However, for example, a digital single-lens reflex camera, a digital video camera, and an electronic device such as a mobile phone or a tablet-type mobile device having two shooting functions. Can be applied.

DESCRIPTION OF SYMBOLS 1,100,200 Imaging device 2 Imaging part 3 Acceleration detection part 4 Timer 5 Light emission part 6 Operation input part 7 Display part 8 Touch panel 9,209 Storage part 10,210 Control part 21 Lens part 22 Lens drive part 23 Diaphragm 24 Diaphragm drive Section 25 Shutter 26 Shutter drive section 27 Image sensor 28 Imaging drive section 29 Signal processing section 61 Power switch 62 Release switch 63 Shooting mode switch 64 Menu switch 91 Image data storage section 92 Program storage section 93 Temporary storage section 94 Contrast storage section 101 Image processing unit 102 Moving direction determination unit 103 Main subject candidate detection unit 104 Main subject setting unit 105 Image detection unit 106 Information addition unit 107 Shooting control unit 108 Display control unit 110 Orientation detection unit 211 Contrast detection unit

Claims (15)

An imaging unit that captures an image of a subject and continuously generates image data of the subject, a display unit that displays an image corresponding to the image data generated by the imaging unit in the order of generation, and the image generated by the imaging unit A temporary storage unit that temporarily stores data in the order of generation;
A moving direction determination unit that determines a moving direction in which the imaging apparatus moves;
Based on a change in image information included in each of a plurality of image data generated in succession, a moving subject that moves within the screen over time is a main subject candidate that is determined according to the moving direction. A main subject candidate detection unit for detecting as a subject candidate;
A main subject setting unit configured to set the main subject candidate as the main subject when the main subject candidate detected by the main subject candidate detection unit is moving in the movement direction determined by the movement direction determination unit;
An image detection unit for detecting an image in which the main subject set by the main subject setting unit is located in a predetermined area from an image group temporarily stored by the temporary storage unit;
An imaging apparatus comprising:   The main subject setting unit sets the main subject candidate as the main subject when the moving direction in which the main subject candidate moves matches the moving direction determined by the moving direction determination unit a plurality of times. The imaging apparatus according to claim 1, wherein the imaging apparatus is characterized. The predetermined region is a substantially central portion of the image;
An information adding unit for adding information indicating that the main subject is a central image located in the substantially central part to image data corresponding to the image detected by the image detecting unit;
The imaging apparatus according to claim 1, further comprising: A release switch for accepting an input of an instruction signal for instructing the imaging device to shoot;
A shooting control unit that acquires the image data generated by the imaging unit when the release switch receives an input of the instruction signal;
The captured image corresponding to the image data acquired by the imaging control unit is displayed on the display unit, and at least some of the plurality of images included in the image data group temporarily stored in the temporary storage unit are displayed on the display unit. A display control unit to display;
The imaging apparatus according to claim 3, further comprising:   The imaging apparatus according to claim 4, wherein the display control unit causes the display unit to display the central image to which the information addition unit has added the information in a display mode that can be identified.   The imaging apparatus according to claim 4, wherein the display control unit causes the display unit to display the central image and the captured image side by side.   The display control unit displays a plurality of images included in the image data group on the display unit while sliding on the display screen of the display unit in the order of generation. The imaging device described in one. An input unit for receiving an input of a selection signal for selecting an image from at least some of the plurality of images displayed by the display unit;
An image data storage unit that stores image data corresponding to an image corresponding to the selection signal received by the input unit;
The imaging apparatus according to claim 4, further comprising: An acceleration detection unit for detecting the acceleration of the imaging apparatus;
The imaging apparatus according to claim 1, wherein the movement direction determination unit determines the movement direction based on a detection result of the acceleration detection unit.   The imaging apparatus according to claim 9, wherein the moving direction determination unit determines that the imaging apparatus is in a moving state when the acceleration detected by the acceleration detection unit changes substantially periodically. An azimuth detector that detects an azimuth when the optical axis of the imaging unit is used as a reference;
The imaging apparatus according to claim 1, wherein the movement direction determination unit determines the movement direction based on a detection result of the azimuth detection unit.   The imaging apparatus according to claim 11, wherein the moving direction determination unit determines that the imaging apparatus is in a moving state when a detection result detected by the azimuth detection unit changes substantially periodically. A contrast detector for detecting contrast based on the image;
The imaging apparatus according to claim 1, wherein the movement direction determination unit determines the movement direction based on a change in contrast detected by the contrast detection unit. An imaging method executed by an imaging apparatus capable of imaging a subject, continuously generating image data of the subject, displaying images corresponding to the image data in the generation order, and capable of temporary storage,
A moving direction determination step for determining a moving direction in which the imaging apparatus moves; and
Based on a change in image information included in each of a plurality of image data generated in succession, a moving subject that moves within the screen over time is a main subject candidate that is determined according to the moving direction. A main subject candidate detection step for detecting as a subject candidate;
A main subject setting step for setting the main subject candidate as the main subject when the main subject candidate detected by the main subject candidate detection step is moving in the movement direction determined by the movement direction determination unit;
An image detection step of detecting an image in which the main subject set in the main subject setting step is located in a predetermined area from a temporarily stored image group;
An imaging method comprising: A program for imaging an object, continuously generating image data of the object, displaying an image corresponding to the image data in the generation order, and causing an imaging apparatus capable of temporary storage to execute the program,
A moving direction determination step for determining a moving direction in which the imaging apparatus moves; and
Based on a change in image information included in each of a plurality of image data generated in succession, a moving subject that moves within the screen over time is a main subject candidate that is determined according to the moving direction. A main subject candidate detection step for detecting as a subject candidate;
A main subject setting step for setting the main subject candidate as the main subject when the main subject candidate detected by the main subject candidate detection step is moving in the movement direction determined by the movement direction determination unit;
An image detection step of detecting an image in which the main subject set in the main subject setting step is located in a predetermined area from a temporarily stored image group;
A program characterized by having executed.

Images