JP2015119400A - Imaging apparatus, method for controlling the same, and control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily recognize the position of a main object, when the main object is out of an imaging field angle, even in such a state that the main object can be specified only at a high magnification, because the main object is extremely small.SOLUTION: A calculation part 114 acquires the relative position and relative size of a second image obtained after zoom-up with respect to a first image obtained before the zoom-up of a zoom lens. A control part 108 displays a first zoom frame 204 indicating the position of the second image in the first image on the first image, based on the relative position and the relative size. When the main object is out of the field angle of the second image, after the main object is selected in the second image, the control part displays a second zoom frame 209 corresponding to the first zoom frame just before the main object is out of the field angle of the second image on the first image.

Description

  The present invention relates to an imaging apparatus, a control method thereof, and a control program, and more particularly to an imaging apparatus having a zoom function.

  2. Description of the Related Art In recent years, an imaging apparatus including a high-power lens having a long focal length is known as an imaging apparatus such as a digital camera. By using this imaging apparatus, it is possible to project a distant subject greatly on a display screen such as an LCD. However, during high-power zooming, a situation in which the main subject is often lost due to a slight shift in the angle of view of the image capture often occurs.

  Furthermore, once the main subject is missed from the imaging field angle, it is difficult to recognize which range is displayed in the high-power zoom with respect to the imaging field angle at the wide end. As a result, in order to search for the main subject again, the user needs to temporarily return the focal length of the imaging lens to the wide end side to widen the imaging field angle.

  In order to avoid such a re-search, there is an image pickup apparatus that displays an image captured at the wide end immediately before zooming up on a LCD as a sub image (see Patent Document 1). In this imaging apparatus, a zoom frame indicating which range of the sub-image corresponds to the current imaging angle of view (that is, after zooming up) is displayed superimposed on the sub-image.

  As a result, in the imaging apparatus described in Patent Document 1, even if the main subject deviates from the imaging angle of view during zooming up, the user is present where the main subject exists according to the positional relationship of the zoom frames in the sub-image. Can be confirmed.

  Furthermore, there exists an imaging device provided with a 1st imaging part and a 2nd imaging part (refer patent document 2). In this imaging apparatus, the first imaging unit images the subject, and the second imaging unit images the main subject at a wider angle than the first imaging unit. When the main subject deviates from the imaging angle of view of the first imaging unit, based on the imaging result of the second imaging unit, the main subject is in accordance with the positional relationship between the imaging angle of view of the first imaging unit and the main subject. Notification. Thereby, in the imaging device described in Patent Literature 2, the user can easily grasp the positional relationship between the imaging field angle of the first imaging unit and the main subject.

JP 2011-135599 A JP 2012-29245 A

  By the way, in the imaging device described in Patent Document 1, it is necessary to specify the position of the main subject in advance at the wide end before zooming up. If the position of the main subject cannot be specified at the wide end, it is difficult to superimpose on the sub image a zoom frame indicating which range of the sub image the imaged angle of view after zooming up corresponds to.

  On the other hand, in the imaging apparatus described in Patent Document 2, when the main subject can be specified only at a high magnification, that is, when the main subject is extremely small, the second imaging unit that performs imaging at a wide angle performs the main subject. It becomes impossible to recognize.

  Therefore, an object of the present invention is to easily grasp the position of the main subject when the main subject deviates from the imaging angle of view even when the main subject is extremely small and can be specified only at a high magnification. An imaging apparatus, a control method thereof, and a control program are provided.

  In order to achieve the above object, an image pickup apparatus according to the present invention is an image pickup apparatus having an image pickup unit that includes a zoom lens movable between a wide end and a zoom end and picks up an image of a subject. A first image is obtained by the imaging means before zooming up to move in the direction of the zoom end, and a second image is obtained by the imaging means after the zooming up, and the first image is obtained with respect to the first image. Calculating means for calculating a relative position and a relative size of the second image; and generating a first zoom frame indicating the position of the second image in the first image based on the relative position and the relative size. First display control means for displaying the first zoom frame on the first image, and after the main subject is selected in the second image, the angle of view of the second image When the main subject is detached, a second zoom frame corresponding to the first zoom frame immediately before the main subject deviates from the angle of view of the second image is displayed on the first image. And a control means.

  A control method according to the present invention is a control method of an imaging apparatus having an imaging unit that includes a zoom lens movable between a wide end and a zoom end, and has an imaging means for imaging a subject, and the zoom lens is directed toward the zoom end. A first image is obtained by the imaging means before zooming up to be moved, and a second image is obtained by the imaging means after the zoom-up, and the second image relative to the first image is obtained. Calculating a relative position and a relative size; generating a first zoom frame indicating a position of the second image in the first image based on the relative position and the relative size; and A first display control step for displaying the first zoom frame on the image; and after the main subject is selected in the second image, the main image is determined from the angle of view of the second image. Second display control for displaying, on the first image, a second zoom frame corresponding to the first zoom frame immediately before the main subject deviates from the angle of view of the second image when the subject is removed. And a step.

  A control program according to the present invention is a control program used in an imaging apparatus having an imaging unit that includes a zoom lens that can move between a wide end and a zoom end and that captures an image of a subject. A first image is obtained by the imaging means before zooming up to move the zoom lens in the direction of the zoom end, and a second image is obtained by the imaging means after the zooming up, A calculation step for obtaining a relative position and a relative size of the second image with respect to one image; and a first zoom indicating a position of the second image in the first image based on the relative position and the relative size A first display control step of generating a frame and displaying the first zoom frame on the first image; and After the main subject is selected, when the main subject deviates from the angle of view of the second image, the main subject corresponds to the first zoom frame immediately before deviating from the angle of view of the second image. And a second display control step of displaying a second zoom frame on the first image.

  According to the present invention, when the main subject deviates from the angle of view of the second image, the second zoom frame corresponding to the first zoom frame immediately before the main subject deviates from the angle of view of the second image is changed to the first zoom frame. Since the image is displayed in one image, even when the main subject is extremely small and can be specified only at a high magnification, the position of the main subject can be easily grasped when the main subject deviates from the imaging angle of view. be able to.

1 is a block diagram illustrating a configuration of an example of an imaging apparatus according to a first embodiment of the present invention. FIG. 4 is a diagram for explaining an example of a transition of a screen displayed on a display unit during an imaging operation in the camera illustrated in FIG. 1, and (a) is a diagram illustrating a display screen immediately after a still image imaging mode is set. (B) is a figure which shows the display screen after zooming in from a wide end, (c) is a figure which shows the display screen at the time of selecting a main subject, (d) is tracking the selected main subject. The figure which shows the display screen in the last time at the time, (e) is a figure which shows the display screen after predetermined time passes, after the main subject became unable to track. FIG. 3 is a flowchart for explaining display control of a sub image, a first zoom frame, and a second zoom frame performed by the camera shown in FIG. 1 (No. 1). FIG. 8 is a flowchart for explaining display control of a sub image, a first zoom frame, and a second zoom frame performed by the camera shown in FIG. 1 (part 2). It is a flowchart for demonstrating the display control of the sub image performed with the camera by the 2nd Embodiment of this invention, a 1st zoom frame, and a 2nd zoom frame (the 1). It is a flowchart for demonstrating the display control of the sub image performed by the camera by the 2nd Embodiment of this invention, a 1st zoom frame, and a 2nd zoom frame (the 2).

  Hereinafter, an example of an imaging apparatus according to an embodiment of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram showing the configuration of an example of an imaging apparatus according to the first embodiment of the present invention.

  The illustrated imaging apparatus is, for example, a digital camera (hereinafter simply referred to as a camera) 100 and includes a lens barrel 101. The lens barrel 101 holds a lens group. In the illustrated example, the lens barrel 101 includes at least a zoom lens 102 and a focus lens 103.

  The zoom lens 102 is driven and controlled by the zoom lens drive control unit 112 and optically changes the angle of view by adjusting the focal length (that is, the zoom lens 102 is movable between the wide end and the zoom end). . The focus lens 103 is driven and controlled by the focus lens drive control unit 113 to perform focus adjustment.

  An imaging element 104 such as a CCD or CMOS image sensor is disposed at the rear stage of the lens barrel 101. An optical image (subject image) is formed on the image sensor 104 via the lens barrel 101. The image sensor 104 outputs an electrical signal (analog signal, that is, an image signal) corresponding to the optical image.

  The imaging signal processing unit 105 receives an imaging signal that is an output of the imaging element 104, A / D-converts the imaging signal, performs predetermined signal processing, and outputs it as a video signal (image data). The video signal processing unit 106 performs image processing such as pixel interpolation processing, color conversion processing, and resizing processing on the video signal that is the output of the imaging signal processing unit 105. Then, the video signal processing unit 106 outputs the display image signal to the display unit 107.

  Furthermore, the video signal processing unit 106 performs display processing for adding a later-described sub image and first and second zoom frames to the display image signal (that is, the display image). Then, the video signal processing unit 106 outputs a display image signal to which the sub image and the first and second zoom frames are added to the display unit 107.

  The display unit 107 is, for example, a TFT type LCD, and displays an image corresponding to the display image signal output from the video signal processing unit 106 on the screen. The control unit 108 controls the entire camera 100, and is configured by an arithmetic device such as a CPU, for example. The control unit 108 controls the camera 100 according to various control programs recorded in the ROM 109.

  In the storage unit 110, a video signal (image data) that is an output of the imaging signal processing unit 105 is recorded, and a display image signal that is an output of the video signal processing unit 106 is stored. The zoom switch 111 is used when operating the zoom lens 102. The zoom lens drive control unit 112 drives and controls the zoom lens 102 under the control of the control unit 108 according to the operation of the zoom switch 111 by the user. The focus lens drive control unit 113 controls the drive of the focus lens 103 under the control of the control unit 108.

  The calculation unit 114 calculates the relative field angle size and position of a live view image that is currently captured with respect to a sub-image described later. The subject selection unit 115 is used when selecting a main subject. The subject selection unit 115 includes physical buttons such as a direction key and a determination key and a touch panel arranged on the entire surface of the display unit 107 in order to select an arbitrary region of the image displayed on the display unit 107. Yes.

  The tracking unit 116 performs processing for tracking the subject area selected as the main subject by the operation of the subject selection unit 115. The operation unit 117 includes a power switch for supplying a power supply voltage to the camera 100, a release switch for instructing start of imaging, a mode switch, and the like. Then, an operation signal corresponding to the operation of the operation unit 117 is sent to the control unit 108. Angular velocity sensor 118 detects the angular velocity applied to camera 100.

  FIG. 2 is a diagram for explaining an example of transition of the screen displayed on the display unit 107 during the imaging operation of the camera 100 shown in FIG. FIG. 2A is a diagram showing a display screen immediately after the still image capturing mode is set, and FIG. 2B is a diagram showing the display screen after zooming in from the wide end. FIG. 2C is a diagram showing a display screen when the main subject is selected, and FIG. 2D is a diagram showing a display screen at the last time point when the selected main subject is tracked. . Further, FIG. 2 (e) is a diagram showing a display screen after a predetermined time has elapsed after the main subject becomes unable to be tracked.

  Now, in the camera 100, it is assumed that a mode switching switch provided in the operation unit 117 is operated and an imaging mode (still image imaging mode) capable of capturing a still image is set. Immediately after setting the still image capturing mode, the live view image 201 (first image) is displayed on the screen of the display unit 107 (see FIG. 2A).

  The illustrated live view image 201 is an image when the zoom lens 102 is positioned at the wide end. After the live view image 201 is displayed on the display unit 201, when the zoom lens 102 is zoomed up from the wide end by the zoom switch 111, the image illustrated in FIG. 2B is displayed on the display unit 107.

  In FIG. 2B, the live view image 203 (second image) after zooming up is displayed on the display unit 107. Then, the live view image 201 obtained at the wide end before zooming up is superimposed on the live view image 203 and displayed on the display unit 107 as a sub image 202 (first image). Further, the first zoom frame 204 representing the angle of view of the live view image 203 with respect to the angle of view of the sub image 202 is superimposed and displayed on the sub image 202.

  In displaying the sub image 202, the calculation unit 114 calculates the relative field angle size and position of the live view image 203 with respect to the sub image 202.

  Subsequently, when zooming up is further performed, a live view image 205 (second image) shown in FIG. 2C is displayed on the display unit 107. Also at this time, the live view image 201 obtained at the wide end before zooming up is superimposed on the live view image 205 as a sub image 202 and displayed on the display unit 107. Further, a first zoom frame 204 representing the angle of view of the live view image 205 with respect to the angle of view of the sub image 202 is superimposed on the sub image 202.

  Here, it is assumed that the user selects the subject 206 as the main subject by the subject selection unit 115. When the main subject 206 is selected, the tracking unit 116 tracks the main subject under the control of the control unit 108 while zooming in is continued. Then, a state immediately before the main subject 206 is detached from the live view image 207 by zooming up is set (see FIG. 2D). Here, the live view image 207 (second image) is displayed on the display unit 107, and the sub image 202 is displayed superimposed on the live view image 207. Further, the first zoom frame 204 is displayed so as to be superimposed on the sub image 202.

  In FIG. 2D, the live view image 207 at the last time point when the main subject 206 was trackable is displayed, and when a predetermined time elapses after the main subject 206 becomes untrackable. The screen shown in FIG. 2E is displayed on the display unit 107.

  On the screen shown in FIG. 2E, the live view image 208 (second image) after zooming up is displayed, and the sub image 202 is displayed superimposed on the live view image. Furthermore, a first zoom frame 204 representing the angle of view of the live view image 208 with respect to the angle of view of the sub image 202 is superimposed on the sub image 202.

  In addition, the sub image 202 includes a second zoom frame representing the angle of view of the live view image 207 with respect to the angle of view of the sub image 202 at the last time point when the main subject 206 is within the angle of view of the live view image 207. 209 is superimposed and displayed. That is, the second zoom frame 209 shown in FIG. 2 (e) corresponds to the first zoom frame 204 in FIG. 2 (d).

  Here, regarding the display control of the sub image, the first zoom frame, and the second zoom frame when the still image capturing mode is set by the operation of the mode changeover switch provided in the operation unit 117 and the zoom up is performed. explain.

  3A and 3B are flowcharts for explaining display control of the sub image, the first zoom frame, and the second zoom frame performed by the camera shown in FIG. Note that the processing according to the illustrated flowchart is performed under the control of the control unit 108.

  When display control is started, under the control of the control unit 108, the video signal processing unit 106 performs pixel interpolation processing, color conversion processing, and video signal (image data) output from the imaging signal processing unit 105, and A display image signal (that is, a live view image) is generated by performing resizing processing or the like. Then, the video signal processing unit 106 displays the live view image on the display unit 107 via the storage unit 110 (step S301). For example, in step S301, the live view image 201 shown in FIG.

  Subsequently, the control unit 108 determines whether or not a zoom operation has been performed by the zoom switch 111 (step S302). If the zoom operation is not performed by the zoom switch 111 (NO in step S302), the control unit 108 stands by. On the other hand, when the zoom operation is performed by the zoom switch 111 (YES in step S302), the control unit 108 detects the zoom operation amount and the zoom operation direction in the zoom switch 111 (step S303).

  Subsequently, the control unit 108 determines whether or not the zoom operation is zooming up based on the detected zoom operation direction (step S304). If the zoom operation is zooming up (YES in step S304), control unit 108 determines whether or not the current position of zoom lens 102 is the wide end (step S305).

  If the zoom operation is not zoom up (NO in step S304), that is, if it is zoom out, the control unit 108 controls the zoom lens drive control unit 112 based on the detected zoom operation amount and zoom operation direction. The zoom lens 102 is driven (step S306). And the control part 108 returns to the process of step S302.

  If the current position of the zoom lens 102 is not the wide end (NO in step S305), the control unit 108 proceeds to the process of step S306. On the other hand, when the current position of zoom lens 102 is at the wide end (YES in step S305), video signal processing unit 106 performs pixel interpolation processing, color conversion processing, and resizing on the image data under the control of control unit 108. A sub-image is generated by performing processing or the like (step S307). Then, the video signal processing unit 106 stores the sub image in the sub image area of the storage unit 110.

  The sub image is an image obtained by resizing the live view image (live view image before zoom-up, that is, current image data). In the resize process, the resize process is more than the resize process performed in step S301. Increase the reduction ratio and resize the live view image.

  Subsequently, the control unit 108 superimposes the sub image stored in the sub image area on the live view image and displays it on the display unit 107 (step S308). Then, the control unit 108 controls the zoom lens drive control unit 112 based on the detected zoom operation amount and zoom operation direction to drive the zoom lens 102 (step S309).

  Next, under the control of the control unit 108, the calculation unit 114 calculates the size (relative size) of the first zoom frame based on the zoom operation amount and the zoom operation direction detected in step S303 (step S310). . Note that the calculation of the size of the first zoom frame is performed sequentially.

  Subsequently, the calculation unit 114 calculates the relative position of the live view image with respect to the sub image (step S311). Note that the calculation of the relative position of the live view image with respect to the sub image is performed sequentially.

  In calculating the relative position, the calculation unit 114 obtains the movement amount of the camera 100 from the time when the sub image is stored until the present time, according to the angular velocity of the camera 100 obtained by the angular velocity sensor 118. Then, the calculation unit 114 calculates the relative position of the live view image with respect to the sub image according to the movement amount. When calculating the relative position, the relative position may be calculated by comparing the sub-image and the live view image by image processing without using the angular velocity sensor 118.

  Subsequently, the control unit 108 controls the video signal processing unit 106 according to the size and relative position of the first zoom frame, and displays the first zoom frame on the display unit 107 (step S312). Note that the display of the first zoom frame is sequentially updated in accordance with the update of the size and relative position of the first zoom frame.

  In step S <b> 312, for example, the live view image 203 illustrated in FIG. 2B is displayed on the display unit 107 and the sub image 202 is displayed so as to be superimposed on the live view image 203. Further, the first zoom frame 204 is displayed so as to be superimposed on the sub image 202.

  Next, the control unit 108 determines whether or not a main subject has been selected by an operation of the subject selection unit 115 (step S313). When selecting the main subject, for example, a screen shown in FIG. 2C is displayed on the display unit 107.

  If the main subject is not selected (NO in step S313), control unit 108 waits. Note that when the main subject is selected, the control unit 108 may select the main subject by a recognition process or the like regardless of the operation of the subject selection unit 115 by the user.

  When the main subject is selected (YES in step S313), the control unit 108 tracks the selected main subject using the tracking unit 116 (step S314). At this time, the tracking unit 116 determines the RGB signal, the luminance signal, the aspect ratio of the circumscribed rectangle, and the like in the main subject area as the feature amount of the main subject, and stores the feature amount in the storage unit 110. The tracking unit 116 then tracks the main subject by detecting a region most similar to the feature amount in the image data sequentially obtained as a result of imaging in accordance with the feature amount stored in the storage unit 110. Note that the main subject tracking method is not limited to the above-described method, and other methods may be used as long as the main subject is tracked.

  Subsequently, the control unit 108 starts storing the size of the first zoom frame and the relative position of the live view image with respect to the sub image in the specific area of the storage unit 110 (step S315). Then, the control unit 108 determines whether or not the tracking of the main subject is disabled in the tracking unit 116 (step S316). That is, the control unit 108 determines whether or not the main subject has deviated from the angle of view of the live view image.

  If tracking of the main subject by the tracking unit 116 is not disabled (NO in step S316), that is, as long as the main subject can be tracked, the control unit 108 stands by. On the other hand, when tracking of the main subject by tracking unit 116 becomes impossible (YES in step S316), control unit 108 determines the size of the first zoom frame to the specific area of storage unit 110 and the live view image for the sub image. The storage of the relative position is terminated (step S317).

  Here, the live view image at the last time when the main subject 206 could be tracked is displayed on the display unit 107. For example, the live view image 207 shown in FIG. 2D is displayed on the display unit 107 and the sub image 202 is displayed superimposed on the live view image 203. Further, the first zoom frame 204 is displayed so as to be superimposed on the sub image 202.

  Assume that immediately after the live view image 207 shown in FIG. 2D is displayed on the display unit 107, the main subject 206 deviates from the angle of view of the live view image 207 and tracking becomes impossible. In this case, the size of the first zoom frame used for display of the first zoom frame 204 shown in FIG. 2D and the relative position of the live view image 207 with respect to the sub image 202 are specified areas in the storage unit 110. It was finally memorized.

  Subsequently, after determining that tracking is impossible, the control unit 108 determines whether a predetermined time set in advance has elapsed (step S318). If the predetermined time has not elapsed (NO in step S318), control unit 108 determines whether or not the main subject that has become untrackable can be re-recognized by tracking unit 116 (step S319).

  When the main subject can be re-recognized (YES in step S319), control unit 108 returns to the process in step S314, and tracking unit 116 starts tracking the main subject. If re-recognition of the main subject is impossible (NO in step S319), control unit 108 determines whether or not the main subject is re-selected by subject selection unit 115 (step S320).

  If the main subject is not reselected (NO in step S320), control unit 108 returns to the process in step S318 and determines whether or not a predetermined time has passed since the tracking became impossible. . When the main subject is reselected (YES in step S320), control unit 108 returns to the process in step S314, and tracking unit 116 starts tracking the main subject.

  In this way, the processing from step S318 to step S320 is performed until the main subject becomes re-recognizable or the trackable subject is reselected as the main subject.

  When the predetermined time has elapsed (YES in step S318), control unit 108 refers to the size of the first zoom frame stored last in the specific area of storage unit 110 and the relative position of the live view image to the sub image. Then, the second zoom frame is displayed on the display unit 107 (step S321). By the processing in step S321, for example, as shown in FIG. 2E, the sub image 202 is superimposed on the live view image 208 and displayed on the display unit 107. Further, the first zoom frame 204 and the second zoom frame 209 are superimposed and displayed on the sub image 202. As described above, the second zoom frame 209 shown in FIG. 2 (e) corresponds to the first zoom frame 204 in FIG. 2 (d), and has the same size and the same position as the first zoom frame 204. Is displayed.

  Subsequently, the control unit 108 determines whether or not a main subject that cannot be tracked can be re-recognized by the tracking unit 116 (step S322). If the main subject that cannot be tracked is not re-recognizable (NO in step S322), control unit 108 determines whether or not the main subject is reselected by subject selection unit 115 (step S323).

  If the main subject is not reselected (NO in step S323), the control unit 108 returns to the process in step S322 and determines whether or not the main subject that cannot be tracked can be re-recognized. When the main subject is reselected (YES in step S323), the control unit 108 ends the display of the second zoom frame (step S324), returns to the process in step S314, and is performed by the tracking unit 116. Start tracking the subject. Similarly, when the main subject that cannot be tracked can be re-recognized (YES in step S322), control unit 108 proceeds to the process of step S324 and ends the display of the second zoom frame.

  In this way, the processing from step S322 to step S323 is performed until the main subject becomes re-recognizable or another subject that can be tracked is selected again as the main subject.

  In the above example, the image data at the wide end immediately before zooming up is used as the sub image 202 displayed on the display unit 107, but image data other than the image data at the wide end may be used. . For example, when the angle of view of the live view image has not been changed for a predetermined time under a condition of a predetermined zoom magnification or less, the video signal processing unit 106 is input when the predetermined time has elapsed. A sub image may be generated using image data. At this time, the sub-image and the first zoom frame are updated after the next zoom-in operation instruction is performed.

  Further, in the above step S321, the second zoom frame is displayed using the size of the first zoom frame stored last in the specific area of the storage unit 110 and the relative position of the live view image with respect to the sub image. However, for example, the size and relative position of the first zoom frame initially stored in the storage unit 110 may be used. In this case, in FIG. 2E, the second zoom frame 209 is displayed at the same size and the same size as the first zoom frame 204 in FIG.

  Further, when displaying the second zoom frame, the size of the first zoom frame immediately before displaying the second zoom frame and the size of the first zoom frame stored in the specific area of the storage unit 110 are displayed. And the most similar size of the first zoom frame may be used. As a result, the size of the first zoom frame and the size of the second zoom frame are similar, so that the first zoom frame can be easily adjusted to the second zoom frame. That is, the user can easily put the main subject in the angle of view of the live view image again.

  In addition, the size and relative position of the first zoom frame at the time point when the position of the main subject is closest to the center position in the angle of view of the live view image is sequentially detected at the angle of view of the live view image. May be used to display the second zoom frame. Then, if the size and relative position of the first zoom frame obtained during the period in which the main subject exists at the angle of view of the live view image, the size and relative position of any first zoom frame are used. Also good.

  In the above example, the main subject is selected after zooming in from the wide end, but the main subject may be selected before zooming in from the wide end. In this case, after the process of step S312 is complete | finished, the process of step S313 and step S314 is abbreviate | omitted and it progresses to the process of step S315.

  In the above example, the sub-image is displayed superimposed on the live view image. You may make it display, without superimposing a sub image on the display area different from a live view image. In this case, the size of the display area of the live view image may be changed, and the sub image is displayed on a display unit for a sub image incorporated or externally provided separately from the display unit 107. May be.

  As described above, in the first embodiment of the present invention, when the main subject deviates from the angle of view of the current live view image, the current live view image is displayed on the sub image corresponding to the live view image obtained at the wide end or the like. A first zoom frame indicating the position of is displayed. Further, a second zoom frame indicating the position of the main subject is displayed on the sub-image. As a result, even when the main subject deviates from the imaging angle of view, the user can easily grasp the position of the main subject.

[Second Embodiment]
Next, an example of a camera according to the second embodiment of the present invention will be described. The configuration of the camera according to the second embodiment is the same as that of the camera shown in FIG.

  In the first embodiment described above, when the zoom-up operation is performed from the wide end, the sub image and the first zoom frame are always displayed on the display unit 107. However, when the main subject exists at the angle of view of the live view image and the user recognizes the main subject, the relative position of the current live view image is known in the sub image corresponding to the live view image at the wide end. The need may be low.

  For this reason, in the second embodiment, the sub image and the first zoom frame are not always displayed on the display unit 107, and the sub image and the first zoom frame are displayed when the main subject no longer exists at the angle of view of the live view image. The zoom frame is displayed.

  4A and 4B are flowcharts for explaining display control of the sub-image, the first zoom frame, and the second zoom frame performed by the camera according to the second embodiment of the present invention.

  Note that the processing according to the illustrated flowchart is performed under the control of the control unit 108. 4A and 4B, the same steps as those shown in FIGS. 3A and 3B are denoted by the same reference numerals, and description thereof is omitted.

  After performing the process of step S307 described with reference to FIGS. 3A and 3B, the control unit 108 performs the processes of steps S309 to S311 described with reference to FIGS. 3A and 3B. That is, here, the control unit 108 does not superimpose the live view image and does not display the sub image.

  When the process of step S311 ends, the control unit 108 performs the processes of steps S313 to S317 described with reference to FIGS. 3A and 3B. Here, the control unit 108 does not display the first zoom frame.

  After the process of step S317, the control unit 108 displays the sub-image stored in the sub-image area in step S307 on the display unit 107, and the size and relative size of the first zoom frame obtained in step S310 and step S311. The first zoom frame is displayed superimposed on the sub-image according to the position (step S416). Thereafter, the control unit 108 performs the process of step S318 described with reference to FIGS. 3A and 3B.

  If the predetermined time has not elapsed since the tracking became impossible (NO in step S318), the control unit 108 determines whether or not the main subject that has become untrackable can be re-recognized by the tracking unit 116 (step S318). S418). If re-recognition of the main subject is impossible (NO in step S418), control unit 108 determines whether or not the main subject has been re-selected by subject selection unit 115 (step S419). If the main subject is not reselected (NO in step S419), control unit 108 returns to the process in step S318 and determines whether or not a predetermined time has passed since the tracking became impossible. .

  When the main subject is reselected (YES in step S419), control unit 108 ends the display of the sub image and the first zoom frame (step S420). Then, the control unit 108 returns to the process of step S314 and performs tracking of the main subject by the tracking unit 116. Similarly, when the main subject can be re-recognized (YES in step S418), control unit 108 proceeds to the process of step S420, and ends the display of the sub image and the first zoom frame.

  When a predetermined time has elapsed since tracking became impossible (YES in step S318), control unit 108 performs the processes of steps S321 to S323 described with reference to FIGS. 3A and 3B. When the main subject is re-recognized or the main subject is selected again, the control unit 108 ends the display of the sub image, the first zoom frame, and the second zoom frame (step S424). Thereafter, the control unit 108 returns to the process of step S314, and the tracking unit 116 tracks the main subject.

  Thus, in the second embodiment of the present invention, the sub image and the first zoom frame are displayed on the display unit 107 only when the main subject does not exist at the angle of view of the live view image. As a result, when the sub image is unnecessary, it is possible to prevent a situation in which the visible region of the live view image is limited by the sub image.

  In the above example, when the main subject no longer exists at the angle of view of the live view image, the sub image and the first zoom frame are immediately displayed on the display unit 107. When a predetermined time elapses, the sub image and the first zoom frame may be displayed together with the second zoom frame.

  As is clear from the above description, in the example shown in FIG. 1, the lens barrel 101, the imaging element, and the imaging signal processing unit 105 function as imaging means. The calculation unit 114 and the control unit 118 function as a calculation unit, and the control unit 108 functions as a first display control unit and a second display control unit together with the display unit 107.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to these embodiment, Various forms of the range which does not deviate from the summary of this invention are also contained in this invention. .

  For example, the function of the above embodiment may be used as a control method, and this control method may be executed by the imaging apparatus. Further, a program having the functions of the above-described embodiments may be used as a control program, and the control program may be executed by a computer included in the imaging apparatus. The control program is recorded on a computer-readable recording medium, for example.

  Each of the above control method and control program has at least a calculation step, a first display control step, and a second display control step.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various recording media, and the computer (or CPU, MPU, etc.) of the system or apparatus reads the program. To be executed.

DESCRIPTION OF SYMBOLS 102 Zoom lens 104 Image pick-up element 105 Image pick-up signal processing part 106 Image | video signal processing part 107 Display part 108 Control part 110 Memory | storage part 111 Zoom switch 115 Subject selection part 116 Tracking part

Claims (8)

An image pickup apparatus having an image pickup means for picking up an image of a subject having a zoom lens movable between a wide end and a zoom end,
A first image is obtained by the imaging means before zooming up to move the zoom lens in the direction of the zoom end, and a second image is obtained by the imaging means after the zooming up, Calculating means for calculating a relative position and a relative size of the second image with respect to one image;
A first zoom frame indicating the position of the second image in the first image is generated based on the relative position and the relative size, and the first zoom frame is displayed on the first image. First display control means;
After the main subject is selected in the second image, when the main subject deviates from the angle of view of the second image, the first subject immediately before the main subject deviates from the angle of view of the second image. Second display control means for displaying a second zoom frame corresponding to the zoom frame on the first image;
An imaging device comprising:   2. The imaging apparatus according to claim 1, wherein the first display control unit reduces the first image at a predetermined reduction ratio and displays the first image as a sub-image superimposed on the second image. .   The imaging apparatus according to claim 1, wherein the first display control unit displays the first image and the second image in different display areas in the display unit.   The second display control means displays the second zoom frame on the first image when a predetermined time elapses with the main subject deviating from the angle of view of the second image. The imaging apparatus according to any one of claims 1 to 3, wherein the imaging apparatus is characterized in that   The imaging apparatus according to claim 1, wherein the first image is an image when the zoom lens is positioned at the wide end.   The first display control means displays the first zoom frame on the first image together with the second image when the main subject deviates from the angle of view of the second image. The imaging device according to any one of claims 1 to 5. A method for controlling an imaging apparatus having an imaging unit that includes a zoom lens that is movable between a wide end and a zoom end and that captures an image of a subject,
A first image is obtained by the imaging means before zooming up to move the zoom lens in the direction of the zoom end, and a second image is obtained by the imaging means after the zooming up, Calculating a relative position and a relative size of the second image with respect to one image;
A first zoom frame indicating the position of the second image in the first image is generated based on the relative position and the relative size, and the first zoom frame is displayed on the first image. A first display control step;
After the main subject is selected in the second image, when the main subject deviates from the angle of view of the second image, the first subject immediately before the main subject deviates from the angle of view of the second image. A second display control step of displaying a second zoom frame corresponding to the zoom frame on the first image;
A control method characterized by comprising: A control program used in an image pickup apparatus having an image pickup means for picking up an image of a subject having a zoom lens movable between a wide end and a zoom end,
In the computer provided in the imaging device,
A first image is obtained by the imaging means before zooming up to move the zoom lens in the direction of the zoom end, and a second image is obtained by the imaging means after the zooming up, Calculating a relative position and a relative size of the second image with respect to one image;
A first zoom frame indicating the position of the second image in the first image is generated based on the relative position and the relative size, and the first zoom frame is displayed on the first image. A first display control step;
After the main subject is selected in the second image, when the main subject deviates from the angle of view of the second image, the first subject immediately before the main subject deviates from the angle of view of the second image. A second display control step of displaying a second zoom frame corresponding to the zoom frame on the first image;
A control program characterized by causing

Images