JP2018137797A - Imaging apparatus, imaging method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To attain improvement of user friendliness relating to a digital zoom function.SOLUTION: The present invention relates to an imaging apparatus 200 comprising: a second position setting part 205a for setting a segmentation region at a predetermined position within an imaging range of an imaging part 3; a second display control part 206a for displaying on a display panel 6b an image within the set segmentation region as a live view image; a second displacement part 205c for displacing the position of the segmentation region within the imaging range of the imaging part in such a manner that a movement of a specific subject within the imaging range is followed; a displacement control part 205d by which, until a first operation is performed, the position of the segmentation region within the imaging range is fixed and when the first operation is performed, the second displacement part is caused to displace the position of the segmentation region; and a second recording control part 208 for recording a partial image corresponding to the segmentation region in an entire image when a second operation is performed.SELECTED DRAWING: Figure 6

Description

  The present invention relates to an imaging apparatus, an imaging method, and a program.

  2. Description of the Related Art Conventionally, there has been known an imaging apparatus having a digital zoom function in which a partial area corresponding to a zoom magnification is cut out from a whole image obtained by imaging, enlarged and displayed on a monitor screen, and recorded according to a shooting instruction. In addition, a technique is also known in which a wide-angle image before zooming is combined and displayed on a part of a monitor screen in a reduced state (see, for example, Patent Document 1).

JP 2010-232962 A

  However, as in the above-mentioned Patent Document 1, if the wide-angle image before zooming is simply combined with the telephoto image after zooming and displayed, the movement of the subject cannot be dealt with and the usability is poor. There is a problem.

  The present invention has been made in view of such a problem, and an object of the present invention is to provide an imaging apparatus, an imaging method, and a program capable of improving usability regarding a digital zoom function.

In order to solve the above problems, an imaging apparatus according to the present invention provides:
Live view display control means for sequentially displaying the whole image sequentially captured by the imaging means on the display means as a live view image;
Setting means for setting a cutout region at a predetermined position within the imaging range of the imaging means during display of the entire image as the live view image by the live view display control means;
A displacement means for displacing the position of the cutout area in the imaging range so as to follow the movement of a specific subject within the imaging range of the imaging means;
Until the first operation is performed, the position of the cutout area in the imaging range is fixed, and when the first operation is performed, the position of the cutout area is displaced by the displacement means. Displacement control means for performing
Until the first operation is performed, an image of an area other than the cut-out area in the entire image that is sequentially displayed on the display means as the live view image by the live view display control means is extracted. An area display control means for displaying in a predetermined display mode so as not to be relatively emphasized with respect to the partial image corresponding to the area;
It is characterized by having.

  According to the present invention, it is possible to improve the usability of the digital zoom function.

It is a block diagram which shows schematic structure of the imaging device of Embodiment 1 to which this invention is applied. 3 is a flowchart illustrating an example of an operation related to an imaging process by the imaging apparatus of FIG. 1. It is a figure for demonstrating the imaging | photography process of FIG. It is a figure for demonstrating the imaging | photography process of FIG. It is a figure for demonstrating the imaging | photography process of FIG. It is a block diagram which shows schematic structure of the imaging device of Embodiment 2 to which this invention is applied. 7 is a flowchart illustrating an example of an operation related to imaging processing by the imaging apparatus of FIG. 6. It is a figure for demonstrating the imaging | photography process of FIG. It is a figure for demonstrating the imaging | photography process of FIG. It is a figure for demonstrating the imaging | photography process of FIG.

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

[Embodiment 1]
FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus 100 according to the first embodiment to which the present invention is applied.
As illustrated in FIG. 1, the imaging apparatus 100 according to the first embodiment specifically includes a central control unit 1, a first memory 2, an imaging unit 3, a signal processing unit 4, and a first image processing unit 5. A first display unit 6, an image quality setting unit 7, a first recording control unit 8, a recording unit 9, and an operation input unit 10.
The central control unit 1, the first memory 2, the imaging unit 3, the signal processing unit 4, the first image processing unit 5, the first display unit 6, the image quality setting unit 7, and the first recording control unit 8 include a bus line 11. Connected through.

  The central control unit 1 controls each unit of the imaging device 100. Specifically, although not shown, the central control unit 1 includes a CPU (Central Processing Unit) and the like, and performs various control operations according to various processing programs (not shown) for the imaging apparatus 100.

  The first memory 2 is configured by, for example, a DRAM (Dynamic Random Access Memory) or the like, and temporarily stores data processed by the central control unit 1 or the first image processing unit 5.

  The imaging unit 3 captures a subject at an arbitrary imaging frame rate and generates a frame image. Specifically, the imaging unit 3 includes a lens unit 3a, an electronic imaging unit 3b, and an imaging control unit 3c.

The lens unit 3a includes, for example, a plurality of lenses such as a zoom lens and a focus lens, and a diaphragm for adjusting the amount of light passing through the lens.
The electronic imaging unit 3b is composed of an image sensor (imaging device) such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor). Then, the electronic imaging unit 3b converts the optical image that has passed through the various lenses of the lens unit 3a into a two-dimensional image signal.
For example, the imaging control unit 3c scans and drives the electronic imaging unit 3b with a timing generator or a driver, and converts the optical image that has passed through the lens unit 3a into a two-dimensional image signal at predetermined intervals by the electronic imaging unit 3b. Then, the frame image is read out for each screen from the imaging region of the electronic imaging unit 3b and is output to the signal processing unit 4.
Note that the imaging control unit 3c may perform adjustment control of conditions when imaging a subject such as AF (automatic focusing processing), AE (automatic exposure processing), and AWB (automatic white balance).

  The signal processing unit 4 performs various types of image signal processing on the analog value signal of the frame image transferred from the electronic imaging unit 3b. Specifically, for example, the signal processing unit 4 appropriately adjusts the gain for each RGB color component with respect to the analog value signal of the frame image, and samples and holds it by a sample hold circuit (not shown) to perform A / D conversion. The digital data is converted by a device (not shown), and color processing including pixel interpolation processing and γ correction processing is performed by a color process circuit (not shown) to obtain a luminance signal Y and color difference signals Cb, Cr (YUV) of digital values. Data). In addition, the signal processing unit 4 outputs the generated luminance signal Y and color difference signals Cb and Cr to the first memory 2 used as a buffer memory.

The first image processing unit 5 includes a first cutout unit 5a, a subject position detection unit 5b, a first position setting unit 5c, a first subject movement detection unit 5d, and a first displacement unit 5e. Yes.
In addition, although each part of the 1st image process part 5 is comprised from the predetermined logic circuit, for example, the said structure is an example and is not restricted to this.

The first cutout part 5a cuts out a part of the cutout area A from the entire image Ia (see FIG. 3A).
That is, the first cutout unit 5a acquires the YUV data of the entire image Ia generated by the signal processing unit 4 when the subject is imaged by the imaging unit 3, from the first memory 2, and zooms from the entire image Ia. Image data corresponding to a part of the cutout area A corresponding to the magnification is cut out (see FIG. 3B). Specifically, when a half-pressing operation (first operation) of the shutter button 10a of the operation input unit 10 by the user is performed, the first cutout unit 5a performs zooming that is determined in advance before the half-pressing operation. A part of the cutout area A is cut out from the entire image Ia at the cutout position set by the magnification (for example, double each in the vertical and horizontal directions) and the first position setting unit 5c described later.
Here, the partial cutout area A corresponding to the zoom magnification refers to an area that can be imaged when, for example, a partial area in the entire image Ia is zoomed in by digital zoom or optical zoom. For example, in the case of a zoom magnification in which each of the vertical and horizontal directions is doubled, an area having a size of 1/4 in the area ratio in the entire image Ia becomes the cutout area A. When the partial image Ip of the cutout area A is displayed on the entire display panel 6b of the first display unit 6, the cutout area A is zoomed in and the partial image Ip is enlarged and displayed.
The whole image Ia here is an image that is a base image before cutting out a part of the cutout area corresponding to the zoom magnification, and is not necessarily an image corresponding to all the pixels of the image sensor (imaging device). May be.

It should be noted that after the user performs a half-press operation of the shutter button 10a, the zoom magnification corresponding to a part of the cutout area A cut out by the first cutout section 5a may be changeable. That is, for example, after a part of the cutout area A is cut out from the entire image Ia at a predetermined zoom magnification (for example, double in vertical and horizontal directions) before the half-pressing operation of the shutter button 10a, an operation input by the user is performed. The size of the cutout region A can be changed by adjusting the zoom magnification according to a predetermined operation such as a zoom button (described later) of the unit 10 (see FIGS. 4A and 4B). ).
Here, FIG. 4A schematically shows a state in which the zoom magnification is further increased, that is, a state in which the size of the cutout area A is further reduced, and FIG. A state in which the size is reduced, that is, a state in which the size of the cutout region A is increased is schematically shown.

The subject position detection unit 5b detects the position of a specific subject.
That is, the subject position detection unit 5b detects the position of a specific subject within the angle of view captured by the imaging unit 3. Specifically, for example, feature information for recognition of a specific subject (a face image of a specific subject) is recorded in the recording unit 9 in advance, and the subject position detection unit 5b is captured by the imaging unit 3. A specific subject is detected by performing subject recognition processing for matching with the feature information recorded in the recording unit 9 in the entire image Ia (see FIG. 3B). At this time, a specific subject may be detected from a predetermined range based on a predetermined position (for example, approximately the center) in the entire image Ia (view angle). Further, at a timing designated by the user (for example, when a half-press operation of the shutter button 10a is performed), a predetermined position within the entire image Ia (view angle) (for example, approximately the center) is within a predetermined range. An existing subject may be a specific subject, and an image of this portion may be acquired as feature information and temporarily recorded, and the movement of the temporarily recorded image (feature information) may be detected. In FIGS. 3B and 3C (described later), a face detection frame is superimposed on the detected position of the face of the specific subject. However, this is only an example. It is not limited to this, and whether or not the face detection frame is displayed in a superimposed manner can be arbitrarily changed as appropriate.
When a specific subject is detected by the above-described processing, the subject position detection unit 5b detects the position (for example, XY coordinates) of the specific subject in the entire image Ia.

  Note that the specific subject is not limited to the one detected by the above processing, and may be, for example, the subject having the largest face (subject at the shortest distance) detected by the face detection processing. good.

The first position setting unit 5c sets the cutout position of the cutout area A.
In other words, the first position setting unit 5c cuts out the position of the specific subject detected by the subject position detection unit 5b by the first cutout unit 5a when the user performs a half-pressing operation on the shutter button 10a. Set as the cutout position of region A.
Specifically, for example, when the user performs a half-pressing operation on the shutter button 10a, the subject position detection unit 5b detects a specific subject existing at a predetermined position (for example, approximately the center) within the angle of view. If the specific object is detected from the angle of view by the above-described object recognition processing, the first position setting unit 5c uses the detected position of the specific object as a reference to extract the specific object. The cutout position is set so as to be included in A. For example, the first position setting unit 5c sets the cutout position so that the position of the detected specific subject is located at a predetermined position (for example, approximately the center) of the cutout area A.

The first subject movement detection unit 5d detects the movement of a specific subject.
That is, the first subject movement detection unit 5d detects a relative movement of a specific subject with respect to the angle of view captured by the imaging unit 3. Specifically, the first subject movement detection unit 5d performs, for example, the above-described subject position detection unit 5b on the YUV data of a plurality of frame images captured by the imaging unit 3 and sequentially generated by the signal processing unit 4. By performing subject recognition processing by the camera and moving object tracking processing using information for tracking a specific subject once detected (for example, feature points, luminance information, color information, etc.) By sequentially detecting the subject, for example, the relative movement of the specific subject that occurs with the movement of the main body of the imaging apparatus 100 due to camera shake or the movement of the specific subject itself is detected.
When detecting the relative movement of a specific subject with respect to the angle of view to be shot, for example, if the specific subject is not a moving object, the specific subject is another subject within the angle of view (for example, the entire background). ) Along with the angle of view, the movement of a specific subject may be detected by detecting the movement of another subject (for example, the entire background) within the angle of view to be photographed.

The first displacement unit 5e displaces the cutout position of the cutout area A in the entire image Ia in accordance with the relative movement of the specific subject.
In other words, the first displacement unit 5e performs the first cut-off in accordance with the relative movement of the specific subject detected by the first subject movement detection unit 5d after the user performs a half-press operation of the shutter button 10a. The cutout position of the cutout area A cut out by the protruding portion 5a is displaced. Specifically, the first displacement unit 5e sets the cutout position of the cutout area A in the entire image Ia set with the position of the specific subject as a reference by the first position setting unit 5c. Displace to match the movement. That is, for example, when the cutout position is set by the first position setting unit 5c so that the position of the specific subject is located approximately at the center of the cutout area A, the first subject movement detection unit 5d Even if the relative movement of the specific subject is detected, the first displacement unit 5e displaces the cut-out position of the cut-out area A in accordance with the relative movement of the specific subject. The position of the specific subject in the area A will not change.
For example, when the feature point of a specific subject is tracked by the first subject movement detection unit 5d and the motion vector of the specific subject is calculated, the first displacement unit 5e calculates the movement of the specific subject. Based on the vector, a first operation for displacing the cutout position of the cutout area A is performed (see FIG. 5A). In addition, for example, when subject recognition processing is performed by the first subject movement detection unit 5d, the first displacement unit 5e determines whether or not the cutout area A is based on the movement of the recognized recognition position of the specific subject. A second operation for displacing the cutout position is performed (see FIG. 5B). Further, the first displacement unit 5e is detected by detecting rotation in the pitch direction, yaw direction, and roll direction with reference to the optical axis direction of the lens unit 3a of the imaging device 100 main body by an angular velocity sensor (not shown), for example. A third operation for displacing the cutout position of the cutout area A may be performed based on the rotation direction and the rotation amount.

The first displacement unit 5e can execute the first to third operations described above manually or automatically.
For example, when the first to third operations are automatically switched, the first displacement unit 5e causes the recording unit 9 to store feature information for identifying a specific subject (a face image of a specific subject) in advance in subject recognition processing. Or the like) may be switched between the second operation and the first operation or the third operation on the basis of whether or not the specific subject in which the image is recorded is within the angle of view. Further, for example, the first displacement unit 5e switches between the second operation and the first operation or the third operation based on whether or not the specific subject is a moving object based on the result of the moving object tracking process. Also good. Furthermore, for example, if the first displacement unit 5e detects a speed by which the user displaces the main body of the imaging apparatus 100 from an angular velocity sensor (not shown) or the like, has the detected speed become a predetermined speed or more? Depending on whether or not, the third operation and the first operation or the second operation may be switched.
It should be noted that at least any two of the first to third operations may be combined and the cutout position of the cutout area A may be displaced by complex control.

  The first display unit 6 includes a first display control unit 6a and a display panel 6b.

  Based on the image data of a predetermined size read from the first memory 2 or the recording unit 9 and decoded by the first image processing unit 5, the first display control unit 6a displays a predetermined image in the display area of the display panel 6b. Control the display. Specifically, the first display control unit 6a includes a VRAM (Video Random Access Memory), a VRAM controller, a digital video encoder, and the like. The digital video encoder reads the luminance signal Y and the color difference signals Cb and Cr decoded by the first image processing unit 5 and recorded in the VRAM from the VRAM through the VRAM controller at a predetermined reproduction frame rate, Based on these data, a video signal is generated and output to the display panel 6b. The first image processing unit 5 may be transformed into a predetermined size (for example, full HD size) based on, for example, the display resolution of the display panel 6b.

  In addition, the first display control unit 6a performs live updating while sequentially updating a plurality of frame images related to the entire image Ia sequentially captured by the imaging unit 3 at a predetermined reproduction frame rate in a still image or moving image capturing mode. The view image is displayed on the display panel 6b. Further, when the user performs a half-press operation on the shutter button 10a, the first display control unit 6a cuts out the live view image sequentially displayed on the display panel 6b from the whole image Ia by the first cutout unit 5a. The partial image Ip corresponding to the exit area A is switched and displayed (see FIG. 3C). That is, the first display control unit 6a causes the display panel 6b to sequentially display the partial images Ip corresponding to the cut-out areas A sequentially cut out by the first cut-out unit 5a as live view images.

Furthermore, when the first display control unit 6a sequentially displays the partial image Ip as a live view image on the display panel 6b, the entire image captured by the imaging unit 3 at a predetermined position of the displayed partial image Ip. Ia is successively synthesized and displayed in a reduced state (see FIG. 3C). At this time, the first display control unit 6a includes, for example, a frame indicating a cutout area A cut out by the first cutout unit 5a in the entire image Ia combined with the partial image Ip reduced to a predetermined position. The cutout area A may be displayed in an identifiable manner by displaying W.
FIG. 3C illustrates an example in which the entire image Ia in a reduced state is combined and displayed at the lower right corner of the partial image Ip. However, the combining position of the entire image Ia is merely an example. However, the present invention is not limited to this, and can be arbitrarily changed as appropriate.

  The display panel 6b displays an image captured by the imaging unit 3 in a display area based on the video signal from the first display control unit 6a. Further, when the partial image Ip and the entire image Ia are recorded in association with each other by the first recording control unit 8, the display panel 6b reproduces while switching between the partial image Ip and the entire image Ia. Also good. Here, an effect such as zoom-in / zoom-out generally performed in, for example, a slide show reproduction may be applied in the reproduction that switches between the partial image Ip and the entire image Ia.

  Examples of the display panel 6b include a liquid crystal display panel and an organic EL (Electro-Luminescence) display panel. However, the display panel 6b is an example and is not limited thereto.

The image quality setting unit 7 sets the image quality of the image recorded in the recording unit 9.
For example, when compressing in the JPEG format, the image quality changes according to the compression rate. Therefore, the image quality setting unit 7 determines whether the partial image Ip recorded in the recording unit 9 or the like based on a predetermined operation of the operation input unit 10 by the user. By setting the compression rate (for example, 1/2, 1/4, etc.) of the whole image Ia, the image quality of the partial image Ip and the whole image Ia is set.

The first recording control unit 8 controls reading of data from the recording unit 9 and writing of data to the recording unit 9.
That is, the first recording control unit 8 stores, for example, an image encoded in a predetermined compression format (for example, JPEG format) in the recording unit 9 configured by a nonvolatile memory (flash memory), a recording medium, or the like. Record image data for recording. Specifically, the first recording control unit 8 is cut out by the first cut-out unit 5a when the user performs a full-pressing operation of the shutter button 10a (second operation different from the first operation). The partial image Ip corresponding to the cutout area A is recorded in the recording unit 9. The first recording control unit 8 associates the partial image Ip corresponding to the cutout area A cut out by the first cutout unit 5a with the entire image Ia picked up by the image pickup unit 3 in the recording unit 9. Record (see FIG. 6).

Further, the first recording control unit 8 can select whether to record both the partial image Ip and the entire image Ia, or to record either one, for example, the partial image Ip and the entire image Ia. When a predetermined shooting mode for recording in association is set, the first recording control unit 8 is cut out by the first cut-out unit 5a when the user fully presses the shutter button 10a. The partial image Ip corresponding to the cutout area A and the whole image Ia captured by the imaging unit 3 at the same timing as the cutout of the cutout area A, that is, the whole image Ia in which the partial image Ip has been cut out The recording unit 9 records them in association with each other.
At this time, the first recording control unit 8 individually compresses the partial image Ip and the entire image Ia and causes the recording unit 9 to record them as separate files. That is, the first recording control unit 8 individually processes the partial image Ip and the entire image Ia with a compression rate corresponding to the same image quality set by the image quality setting unit 7 or different compression rates corresponding to different image quality. It compresses and makes the recording part 9 record as a separate file. Here, when the partial image Ip and the entire image Ia have different image quality, the first recording control unit 8 individually uses a compression rate such that the entire image Ia has a lower image quality than the partial image Ip. It is compressed and recorded in the recording unit 9 as separate files.

The operation input unit 10 is for performing a predetermined operation of the imaging apparatus 100. Specifically, the operation input unit 10 is a shutter button 10a that can be operated in two stages, a half-pressing operation (first operation) and a full-pressing operation (second operation), in accordance with a subject shooting instruction. Operation units such as a selection determination button (not shown) related to a selection instruction for a shooting mode and a function, and a zoom button (not shown) related to a zoom amount adjustment instruction are provided.
When various buttons are operated by the user, the operation input unit 10 outputs an operation signal corresponding to the operated button to the central control unit 1. The central control unit 1 causes each unit to execute a predetermined operation (for example, taking a still image) in accordance with an operation instruction output from the operation input unit 10 and input.

<Shooting process>
Next, imaging processing by the imaging apparatus 100 will be described with reference to FIGS.
FIG. 2 is a flowchart illustrating an example of an operation related to the photographing process. FIGS. 3A to 5B are diagrams for explaining the photographing process.

  In the imaging process described below, it is assumed that the compression rate (for example, 1/2, 1/4, etc.) of the partial image Ip and the entire image Ia is set in advance by the image quality setting unit 7. Also, it is assumed that a predetermined shooting mode for recording the partial image Ip and the entire image Ia in association with each other is set.

As shown in FIG. 2, first, the imaging unit 3 starts imaging of a subject, and the first display control unit 6 a is for displaying a plurality of frame images related to the entire image Ia generated by the signal processing unit 4. Based on the image data, a live view image is displayed on the display panel 6b (step S1).
Thereafter, the CPU of the central control unit 1 determines whether or not the user has performed a half-press operation of the shutter button 10a of the operation input unit 10 (step S2).
Here, if it is determined that the half-press operation of the shutter button 10a has not been performed (step S2; NO), the CPU of the central control unit 1 returns the process to step S1 and performs the first display in the same manner as described above. The control unit 6a displays the live view image on the display panel 6b.

On the other hand, if it is determined in step S2 that the half-press operation of the shutter button 10a has been performed (step S2; YES), the subject position detection unit 5b, for example, a specific subject recorded in advance in the recording unit 9 Subject recognition processing is performed using the feature information for recognition, and the position of a specific subject within the angle of view captured by the imaging unit 3 is detected (step S3). Subsequently, the first position setting unit 5c sets the cutout position so that the specific subject is included in the cutout area A with reference to the position of the specific subject detected by the subject position detection unit 5b (Step S1). S4).
Thereafter, the first cutout unit 5a is a whole image generated by the signal processing unit 4 at the cutout position set by the first position setting unit 5c and at a zoom magnification determined in advance before the half-press operation. The image data corresponding to a part of the cutout area A is sequentially cut out from the YUV data of Ia, and the first display control unit 6a displays the partial image Ip corresponding to the cutout area A sequentially cut out by the first cutout part 5a. It is sequentially displayed on the display panel 6b as a view image (step S5). At this time, the first display control unit 6a sequentially synthesizes the entire image Ia captured by the imaging unit 3 at a predetermined position (for example, the lower right corner) of the displayed partial image Ip in a reduced state. It is displayed (see FIG. 3C).

Subsequently, the first subject movement detection unit 5d performs subject recognition processing, moving body tracking processing, and the like, for example, to detect whether a specific subject within the angle of view captured by the imaging unit 3 is detected. Is determined (step S6).
Here, if it is determined that the relative movement of the specific subject is detected (step S6; YES), the first displacement unit 5e detects the movement of the specific subject detected by the first subject movement detection unit 5d. At the same time, specifically, for example, based on the movement vector of the specific subject or the movement of the recognition position of the specific subject, the cutout position of the cutout area A cut out by the first cutout unit 5a is displaced (step S7).

Thereafter, the CPU of the central control unit 1 determines whether or not the user has fully pressed the shutter button 10a of the operation input unit 10 (step S8). Also, when it is determined in step S6 that the relative movement of the specific subject has not been detected (step S6; NO), the CPU of the central control unit 1 performs the process from step S8 onward. Then, it is determined whether or not the shutter button 10a has been fully pressed.
If it is determined that the shutter button 10a has not been fully pressed (step S8; NO), the CPU of the central control unit 1 returns the process to step S6, and similarly to the above, the first subject. The movement detection unit 5d determines whether or not a relative movement of a specific subject has been detected.
If the half-pressing operation of the shutter button 10a is canceled without the shutter button 10a being fully pressed, the CPU of the central control unit 1 returns the process to step S1 and, similarly to the above, The first display control unit 6a displays the live view image on the display panel 6b.

On the other hand, if it is determined in step S8 that the shutter button 10a has been fully pressed (step S8; YES), the first cutout unit 5a performs YUV of the entire image Ia generated by the signal processing unit 4. Image data corresponding to a part of the cutout area A set in the entire image Ia is cut out from the data, and the first recording control unit 8 corresponds to the cutout area A cut out by the first cutout part 5a. The partial image Ip and the entire image Ia from which the cutout area A has been cut out are individually compressed into separate files, and these are associated with each other and recorded in the recording unit 9 (step S9).
Thereby, the photographing process is terminated.

As described above, according to the imaging apparatus 100 of the first embodiment, when the shutter button 10a is half-pressed, a live view image that is sequentially displayed corresponds to a part of the cutout area A from the entire image Ia. After the image Ip is switched and displayed and the shutter button 10a is half-pressed, when the relative movement of the specific subject with respect to the angle of view is detected, the relative movement of the specific subject is adjusted. Thus, when the cutout position of the cutout area A is displaced and the shutter button 10a is fully pressed, the partial image Ip corresponding to the cutout area A is recorded, so that the half of the shutter button 10a is recorded. When the push operation is performed, the partial image Ip corresponding to a part of the cutout area A corresponding to the zoom magnification can be displayed as a live view image and recognized by the user. Instead, the user adjusts the composition even if a specific subject moves within the angle of view by displacing the cutout position of the cutout area A in accordance with the movement of the specific subject within the angle of view. Therefore, it is possible to improve usability regarding the digital zoom function of the imaging apparatus 100.
In addition, before the half-press operation of the shutter button 10a is performed, the user can freely change the specific subject to be cut out by changing the angle of view, and the timing when the half-press operation of the shutter button 10a is performed. The specific subject to be cut out is determined, and after that, while the half-pressed state continues, the specific subject decided to be cut out can be tracked (fixed) even when the angle of view is changed. It becomes possible to easily change, determine, and track (fix) a specific subject to be cut out. When the user wants to record an image in a state where the shutter button 10a is half-pressed by the user, the user may press the shutter button 10a as it is, or a specific subject to be cut out. When the user wants to change, the user only has to release the half-press of the shutter button 10a, so that a quick operation including image recording becomes possible.
Furthermore, for example, when a predetermined shooting mode for recording the partial image Ip and the entire image Ia in association with each other is set, the partial image Ip corresponding to the cutout area A and the cutout of the cutout area A By associating and recording the entire image Ia captured at the same timing, it is possible to more easily grasp the positional relationship of the partial image Ip with respect to the entire image Ia.

  Further, the entire image Ia captured by the imaging unit 3 can be sequentially synthesized and displayed at a predetermined position of the partial image Ip corresponding to the cut-out area A that is sequentially displayed as a live view image. Specifically, the cut-out area A to be cut out can be displayed in an identifiable manner in the entire image Ia synthesized in a reduced state at a predetermined position of the partial image Ip. Thereby, it is possible to more easily grasp the positional relationship of the partial image Ip in the entire image Ia.

Further, when the shutter button 10a is half-pressed, the position of the specific subject detected from within the angle of view is set as the cut-out position of the cut-out area A. Therefore, the cut-out area is determined based on the position of the specific subject. The cutout position of A can be set. For example, when a half-press operation of the shutter button 10a is performed, the cutout region is based on the position of a specific subject existing at a predetermined position within the angle of view or the position of a specific subject recognized within the angle of view. The cutout position of A can be set.
Furthermore, since the cutout position of the set cutout area A is displaced in accordance with the relative movement of the specific subject, even if the relative movement of the specific subject with respect to the angle of view occurs, the cutout area By displacing the cutout position of A, the user does not need to adjust the composition. For example, the cutout position of the cutout region A can be displaced so as to follow the specific subject based on the motion vector of the specific subject or the movement of the recognition position of the specific subject. Further, based on the rotation based on the optical axis direction of the lens unit 3a of the imaging apparatus 100 main body, the cutout position of the cutout area A can be displaced so as to follow the specific subject.

  In addition, the operation of displacing the cut-out position of the cut-out area A can be switched and executed. For example, whether or not a specific subject in which feature information for subject recognition is recorded in advance exists within the angle of view. By displacing the cut-out position of the cut-out area A by a more optimal method based on whether or not the subject is a moving object and the speed at which the user displaces the main body of the imaging apparatus 100 as a reference, Even if the movement of a specific subject occurs, the cut-out position of the cut-out area A can be displaced so as to follow the specific subject.

  Further, since the cutout area A is cut out from the entire image Ia at a predetermined zoom magnification before the half-pressing operation of the shutter button 10a, a special operation for the user can be made unnecessary. Further, since the zoom magnification corresponding to the cutout area A can be changed after the shutter button 10a is half-pressed, for example, the size of the cutout area A is set in consideration of the composition of the partial image Ip. Can be changed.

  Further, since the partial image Ip and the entire image Ia are individually compressed and recorded as separate files, the partial image Ip and the entire image Ia can be managed individually. At this time, the partial image Ip and the entire image Ia are divided into compression rates corresponding to the same image quality set by the image quality setting unit 7 or different compression rates corresponding to different image quality (for example, the entire image rather than the partial image Ip). It is possible to individually compress and record as a separate file at a compression rate such that Ia has a lower image quality.

  Furthermore, since the reproduction is performed while switching between the partial image Ip and the whole image Ia recorded in association with each other, the positional relationship of the partial image Ip in the whole image Ia can be easily grasped, and the image Regeneration can be highly interesting.

  In addition, since it is possible to select whether to record both the partial image Ip and the entire image Ia, or to record either one, it is possible to select the image to be recorded as necessary. Usability can be improved.

[Embodiment 2]
Below, the imaging device 200 of Embodiment 2 is demonstrated with reference to FIGS.
The imaging apparatus 200 according to the second embodiment has substantially the same configuration as that of the imaging apparatus 100 according to the first embodiment except for the details described below, and detailed description thereof is omitted.

FIG. 6 is a block diagram illustrating a schematic configuration of the imaging apparatus 200 according to the second embodiment to which the present invention is applied.
As illustrated in FIG. 6, the imaging apparatus 200 according to the second embodiment specifically includes a central control unit 1, a second memory 202, an imaging unit 3, a signal processing unit 4, and a second image processing unit 205. A second display unit 206, an image quality setting unit 7, a second recording control unit 208, a recording unit 9, and an operation input unit 10.

Similar to the first memory 2 in the first embodiment, the second memory 202 is configured by, for example, a DRAM, and temporarily stores data processed by the central control unit 1, the second image processing unit 205, and the like. To do.
Further, the second memory 202 records a cutout area table T in which a combination of the size (size) and shape of the cutout area A (see FIG. 8A, etc.) is defined. Specifically, the cutout area table T defines a plurality of combinations in which at least one of the size and shape of the cutout area A is different.
The size and shape of the cutout area A are, for example, the vertical and horizontal directions of the area that can be imaged when a part of the entire image Ia (see FIG. 10B) is zoomed in at a predetermined zoom magnification by digital zoom or optical zoom. And the relative ratios of the vertical and horizontal dimensions of the cutout area A with respect to the vertical and horizontal pixel numbers of the entire image Ia are made different. For example, the shape of the cutout region A includes a vertically long shape (see FIG. 8A) and a horizontally long shape (see FIG. 8B). It is defined in the outgoing area table T.
Note that the size and shape of the cutout area A illustrated in FIGS. 8A and 8B are examples, and are not limited to these, and can be arbitrarily changed as appropriate. For example, the shape of the cutout area A may be a circle or an ellipse, may be a polygon other than a rectangle, may be a star or a heart, or may be operated by a user. Any shape that encloses a partial area in the entire image Ia, such as an arbitrary shape designated based on a predetermined operation of the unit 10 or the like, may be used.

The second image processing unit 205 includes a second position setting unit 205a, a second subject movement detection unit 205b, a second displacement unit 205c, a displacement control unit 205d, and a second cutout unit 205e. .
Each unit of the second image processing unit 205 is configured by, for example, a predetermined logic circuit, like the first image processing unit 5 in the first embodiment, but the configuration is an example and is not limited thereto. Is not something

The second position setting unit 205 a sets the cutout area A at a predetermined position within the imaging range of the imaging unit 3.
That is, for example, when a predetermined shooting mode in which the partial image Ip and the entire image Ia are recorded in association with each other is set, the second position is displayed while the entire image Ia as the live view image is displayed on the display panel 6b. The setting unit 205a sets the cutout area A at a predetermined position (for example, approximately the center) within the imaging range (view angle) of the imaging unit 3. Here, the size and shape of the cutout area A may be, for example, the size and shape set as default in the cutout area table T, or the size and shape of the cutout area A set last time. There may be.
The second position setting unit 205a is substantially the same as the first position setting unit 5c in the first embodiment. For example, when a specific subject is detected from within the angle of view by subject recognition processing or the like, the detected specific The cutout area A may be set so that the specific subject is included on the basis of the position of the subject.

The second subject movement detection unit 205b detects the movement of a specific subject.
That is, the second subject movement detection unit 205b detects a relative movement of a specific subject within the cutout area A set by the second position setting unit 205a with respect to the imaging range of the imaging unit 3.
Specifically, the second subject movement detection unit 205b performs, for example, subject recognition processing similar to that in the first embodiment on the cutout area A in the entire image Ia to specify a specific area from the cutout area A. Detect the subject. Then, the second subject movement detection unit 205b has a plurality of frame images related to the live view image (entire image Ia) generated by the signal processing unit 4 in substantially the same manner as the first subject movement detection unit 5d in the first embodiment. By subjecting the YUV data to the subject recognition processing described above and moving object tracking processing using information for tracking a specific subject once detected (eg, feature points, luminance information, color information, etc.) Then, a specific subject is sequentially detected from the cutout area A of each frame image. Accordingly, the second subject movement detection unit 205b sequentially detects relative movement of a specific subject within the cutout area A with respect to the imaging range of the imaging unit 3.

The second displacement unit 205c displaces the position of the cutout area A.
That is, the second displacement unit 205c displaces the position of the cutout region A in the imaging range so as to follow the movement of a specific subject in the imaging range of the imaging unit 3. Specifically, the second displacement unit 205c is substantially the same as the first displacement unit 5e in the first embodiment, and after the user performs a half-pressing operation of the shutter button 10a, the second subject movement detection unit 205b The position of the cutout area A within the imaging range of the imaging unit 3 is displaced in accordance with the relative movement of the specific subject to be detected.

The displacement control unit 205d controls the displacement of the cutout area A.
That is, the displacement control unit 205d is a cut-out area at a predetermined position (for example, approximately the center) within the imaging range of the imaging unit 3 until the user performs a half-pressing operation (first operation) of the shutter button 10a. Control is performed to fix the position of A. Furthermore, until the user presses the shutter button 10a halfway, for example, a size desired by the user from a plurality of combinations of sizes and shapes of the cutout area A defined in the cutout area table T is used. And the combination of the shapes are selected based on a predetermined operation (third operation) of the operation input unit 10 by the user, so that the displacement control unit 205d allows the position of the cutout area A to the imaging range of the imaging unit 3 In a state in which is fixed, at least one of the size and shape of the cutout area A may be controlled to be changeable (see FIGS. 8A and 8B).
In addition, when the user performs a half-pressing operation on the shutter button 10a, the displacement control unit 205d performs control to displace the position of the cutout area A so that the second displacement unit 205c follows the movement of a specific subject. . Furthermore, when the half-pressing operation of the shutter button 10a is performed by the user, the displacement control unit 205d fixes the size and shape of the specified cutout area A until the half-pressing operation of the shutter button 10a is performed. Thus, the second displacement unit 205c may perform control for displacing the position of the cutout area A so as to follow the movement of the specific subject (see FIG. 9B).

The size and shape of the cutout area A can be changed until the user performs a half-press operation on the shutter button 10a. However, the size and shape of the cutout area A are not limited to this example. Even after the half-press operation of 10a is performed, the size and shape of the cutout area A can be changed. For example, when the shutter button is fully pressed (second operation), the cutout area A is changed. The size and shape may be fixed.
That is, when the user half-presses the shutter button 10a, the position of the cutout area A is displaced so as to follow the movement of the specific subject. Is in a state that exists. For this reason, for example, when changing so that the size of the cutout area A is increased, a specific subject always exists in the cutout area A, while the size of the cutout area A is Even if the size is changed to be smaller, at least a part of the specific subject exists in the cutout area A. Similarly, even if the area of the cutout area A is reduced by changing the shape of the cutout area A, at least a part of a specific subject exists in the cutout area A. However, in order to properly perform subject recognition processing, moving body tracking processing, and the like by the second subject movement detection unit 205b, it is necessary to detect a specific subject again from within the cutout area A after the size and shape change.

The second cutout unit 205e cuts out the cutout area A from the entire image Ia.
That is, the second cut-out unit 205e is substantially the same as the first cut-out unit 5a in the first embodiment, and when the full-press operation is performed following the half-press operation of the shutter button 10a by the user, the signal processing unit 4 The YUV data of the whole image Ia generated by the above is acquired from the second memory 202, and the image data of the partial image Ip corresponding to the cut-out area A in the whole image Ia is cut out (see FIG. 10A). That is, after the user performs a half-press operation on the shutter button 10a, the displacement control unit 205d displaces the position of the cutout area A so that the second displacement unit 205c follows the movement of the specific subject. When the user fully presses the shutter button 10a, the second cutout unit 205e cuts out the entire image Ia at the position of the cutout region A within the image pickup range of the image pickup unit 3 at that time. A partial image Ip corresponding to A is cut out.

  The second display unit 206 includes a second display control unit 206a and a display panel 6b.

  Similarly to the first display control unit 6a in the first embodiment, the second display control unit 206a reads image data of a predetermined size read from the second memory 202 or the recording unit 9 and decoded by the second image processing unit 205. Based on the above, control is performed to display a predetermined image in the display area of the display panel 6b. That is, the second display control unit 206a performs live updating while sequentially updating a plurality of frame images related to the entire image Ia sequentially captured by the imaging unit 3 at a predetermined reproduction frame rate in the still image or moving image capturing mode. It is displayed on the display panel 6b as a view image.

In addition, the second display control unit 206a causes the display panel 6b to display the image in the cutout area A set by the second position setting unit 205a as a live view image.
Here, the second display control unit 206a identifies the cutout area A by displaying a frame W indicating the cutout area A in the entire image Ia sequentially displayed on the display panel 6b as a live view image. Display as possible. Specifically, for example, the extraction specified in the extraction area table T until the user half-presses the shutter button 10a, that is, until the size and shape of the extraction area A are fixed. When a combination of the size and shape desired by the user is selected from a plurality of combinations of the size and shape of the region A based on a predetermined operation (third operation) of the operation input unit 10 by the user, The 2 display control unit 206a displays the frame W indicating the cutout area A having the size and shape corresponding to the selected combination, so that the cutout area A can be displayed in the entire image Ia.

Furthermore, the second display control unit 206a performs mask processing on an area other than the cutout area A in the entire image Ia that is sequentially displayed on the display panel 6b until the user presses the shutter button 10a halfway. Thus, an image of an area other than the cutout area A is displayed in a semi-transparent display state (see FIG. 8A and the like). As a result, the second display control unit 206a causes the partial image Ip corresponding to the cutout area A to be displayed in a predetermined display manner that makes the image of the area other than the cutout area A relatively inconspicuous. It is like that.
Then, when the size and shape of the cutout area A are fixed by performing a half-press operation of the shutter button 10a by the user, the second display control unit 206a transmits the image of the area other than the cutout area A semi-transparently. The display in the display state is canceled (see FIG. 9A). As a result, the second display control unit 206a displays a frame W indicating the cutout area A with a fixed size and shape in the entire image Ia as the live view image.

  Note that, as a predetermined display mode in which an image in an area other than the cutout area A is relatively inconspicuous, a semi-transparent display state of an image in an area other than the cutout area A is illustrated as an example. However, the present invention is not limited to this, and can be arbitrarily changed as appropriate. For example, the second display control unit 206a may change the brightness, saturation, hue, and the like of the image in the area other than the cutout area A, and mosaic processing and blurring processing on the image in the area other than the cutout area A. The region other than the cutout region A may be completely covered with the mask image.

The second display control unit 206a, like the first display control unit 6a in the first embodiment, displays a live view image that is sequentially displayed on the display panel 6b when the user performs a half-pressing operation on the shutter button 10a. May be displayed by switching from the entire image Ia to the partial image Ip corresponding to the cutout area A cut out by the second cutout unit 205e.
Furthermore, as with the first display control unit 6a in the first embodiment, the second display control unit 206a displays the partial image Ip displayed when the partial image Ip is sequentially displayed on the display panel 6b as a live view image. The entire image Ia picked up by the image pickup unit 3 may be sequentially combined and displayed at a predetermined position of the image capturing unit 3 or may be displayed in the entire image Ia combined with the partial image Ip reduced to a predetermined position. In addition, a frame W indicating the position and size of the cutout area A cut out by the second cutout portion 205e may be displayed.

Similar to the first recording control unit 8 in the first embodiment, the second recording control unit 208 performs a full pressing operation (second operation) after a half pressing operation (first operation) of the shutter button 10a by the user. Then, the recording unit 9 records the partial image Ip (see FIG. 10A) corresponding to the cut-out area A cut out by the second cut-out unit 205e in the entire image Ia picked up by the image pickup unit 3. .
Further, for example, when a predetermined shooting mode for recording the partial image Ip and the entire image Ia (see FIG. 10B) in association with each other is set, the second recording control unit 208 performs the second cut-off. The recording unit 9 records the partial image Ip corresponding to the cut-out area A cut out by the output unit 205e and the entire image Ia picked up by the image pickup unit 3 in association with each other. Specifically, the second recording control unit 208 compresses the partial image Ip and the entire image Ia individually and records them as separate files on the recording unit 9 so that they can be reproduced and deleted independently. However, by making the partial image Ip and the entire image Ia have the same file name, the partial image Ip and the entire image Ia are associated with each other.

  When moving image information (not shown) with a visual effect that dynamically switches from the partial image Ip to the entire image Ia is generated, the second recording control unit 208 converts the moving image information to the partial image Ip. Alternatively, it may be recorded in the recording unit 9 in association with the entire image Ia. That is, the second recording control unit 208 causes the recording unit 9 to record the moving image information as a file different from the partial image Ip and the entire image Ia, and the file name of the moving image information is the same file as the partial image Ip and the entire image Ia. By using the name, the moving image information, the partial image Ip, and the entire image Ia are associated with each other.

<Shooting process>
Next, imaging processing by the imaging apparatus 200 will be described with reference to FIGS. 7 to 10B.
FIG. 7 is a flowchart illustrating an example of an operation related to the imaging process. FIGS. 8A to 10B are diagrams for explaining the photographing process.

  In the imaging process described below, the compression rate (for example, 1/2, 1/4, etc.) of the partial image Ip and the entire image Ia is previously set by the image quality setting unit 7 as in the imaging process of the first embodiment. It is assumed that it is set. Also, it is assumed that a predetermined shooting mode for recording the partial image Ip and the entire image Ia in association with each other is set.

As shown in FIG. 7, first, the imaging unit 3 starts imaging of a subject, and the second display control unit 206 a is for displaying a plurality of frame images related to the entire image Ia generated by the signal processing unit 4. Based on the image data, a live view image is displayed on the display panel 6b (step S11).
Next, the second position setting unit 205a sets, for example, a cutout area A having a size or a shape set as a default in the cutout area table T in the approximate center of the image pickup range of the image pickup unit 3 (Step S1). S12). Then, the second display control unit 206a displays a frame W indicating the cutout area A in the entire image Ia sequentially displayed on the display panel 6b, and performs a mask process on areas other than the cutout area A. Then, an image of an area other than the cutout area A is displayed in a semi-transparent display state (step S13; see FIG. 8A).

Thereafter, the CPU of the central control unit 1 determines whether an instruction to change the size or shape of the cutout area A is input based on a predetermined operation of the operation input unit 10 by the user (step S14). This determination is made, for example, by selecting one of the combinations of the size and shape of the cutout area A specified in the cutout area table T from the combination of the size and shape of the operation input unit 10 by the user. This is performed depending on whether or not the selection is made based on the operation (third operation).
Here, if it is determined that an instruction to change the size or shape of the cutout area A is input (step S14; YES), the displacement control unit 205d determines the cutout area A relative to the image pickup range of the image pickup unit 3. With the position fixed at the approximate center, the size and shape of the cutout area A are changed according to the instructed change content (step S15). Then, the process returns to step S13, and the second display control unit 206a displays a frame W indicating the cut area A after the change on the display panel 6b in correspondence with the change in the size and shape of the cut area A. At the same time, an image of an area other than the cutout area A is displayed in a semi-transmissive display state (see FIG. 8B).

On the other hand, if it is determined in step S14 that an instruction to change the size or shape of the cutout area A has not been input (step S14; NO), the CPU of the central control unit 1 causes the operation input unit 10 by the user to be changed. It is determined whether or not a half-press operation of the shutter button 10a has been performed (step S16).
Here, if it is determined that the half-press operation of the shutter button 10a has not been performed (step S16; NO), the CPU of the central control unit 1 returns the process to step S14, and similarly to the above, the extraction area It is determined whether or not an instruction to change the size and shape of A has been input.

If it is determined in step S16 that the half-press operation of the shutter button 10a has been performed (step S16; YES), the second display control unit 206a displays the semi-transparent display state of the image in the area other than the cut-out area A. Is canceled (step S17; see FIG. 9A).
Then, the displacement control unit 205d performs control for displacing the position of the cutout region A so that the second displacement unit 205c follows the movement of the specific subject while the size and shape of the cutout region A are fixed. (Step S18; see FIG. 9B). Specifically, the second displacement unit 205c determines the position of the cutout area A within the imaging range of the imaging unit 3 in accordance with the relative movement of the specific subject detected by the second subject movement detection unit 205b. Displace. Further, the second display control unit 206a causes the display panel 6b to displace and display the frame W indicating the cutout area A in accordance with the displacement of the cutout area A.

Next, the CPU of the central control unit 1 determines whether or not the half-press operation of the shutter button 10a of the operation input unit 10 by the user has been released (step S19).
Here, if it is determined that the half-pressing operation of the shutter button 10a is not released (step S19; NO), the CPU of the central control unit 1 performs a full-pressing operation of the shutter button 10a of the operation input unit 10 by the user. It is determined whether or not it has been performed (step S20).

If it is determined in step S20 that the shutter button 10a has not been fully pressed (step S20; NO), the process returns to step S18, and the displacement control unit 205d performs the cut-out area similarly to the above. In a state where the size and shape of A are fixed, the second displacement unit 205c performs control to displace the position of the cutout region A so as to follow the movement of a specific subject.
On the other hand, if it is determined in step S20 that the shutter button 10a has been fully pressed (step S20; YES), the second cutout unit 205e is the time when the shutter button 10a is fully pressed. The YUV data of the whole image Ia generated by the signal processing unit 4 is acquired from the second memory 202, and the partial image Ip corresponding to the cutout area A is cut out from the whole image Ia (step S21; see FIG. 10A). . The imaging control unit 3c performs AF (automatic focusing processing), AE (automatic exposure processing), AWB (automatic white balance), and the like with the cutout area A as a reference when capturing the entire image Ia. Also good.
Thereafter, the second recording control unit 208 displays the partial image Ip corresponding to the cutout area A cut out by the second cutout unit 205e and the entire image Ia picked up by the image pickup unit 3 (see FIG. 10B). Are individually compressed to form separate files, and these are associated with each other and recorded in the recording unit 9 (step S22).

  On the other hand, if it is determined in step S19 that the half-press operation of the shutter button 10a has been released (step S19; YES), the process returns to step S12, and the second position setting unit 205a causes the imaging range of the imaging unit 3 to be For example, a cutout area A having a size and a shape set last time (for example, before releasing the half-pressing operation of the shutter button 10a) is set in the approximate center. Thereafter, similarly to the above, each processing after step S13 is performed.

As described above, according to the imaging apparatus 200 of the second embodiment, the image in the cutout area A is displayed on the display panel 6b as a live view image, specifically, in the entire image Ia as a live view image. Since the cutout area A is displayed on the display panel 6b in an identifiable manner, the positional relationship of the partial image Ip corresponding to the cutout area A in the entire image Ia can be easily grasped. Further, until the half-pressing operation of the shutter button 10a is performed, the position of the cutout area A within the imaging range of the imaging unit 3 is fixed, and when the half-pressing operation of the shutter button 10a is performed, the position within the imaging range is fixed. When the position of the cutout area A in the imaging range is displaced in accordance with the relative movement of the specific subject so as to follow the movement of the specific subject, and the shutter button 10a is fully pressed, Since the partial image Ip corresponding to the cutout area A in the image Ia is recorded, before the half-pressing operation of the shutter button 10a is performed, the specific subject to be cutout is changed by the user changing the imaging direction and the angle of view. Can be freely changed, and after a half-pressing operation of the shutter button 10a, camera shake occurs or a specific subject moves. Even if the angle of view is changed, the position of the cutout area A can be displaced by following the relative movement of the specific subject, and the specific subject to be cut out can be changed, determined, and tracked (fixed). ) Can be easily performed.
In particular, until the shutter button 10a is half-pressed, the size and shape of the cutout area A can be changed while the position of the cutout area A is fixed with respect to the imaging range. It is possible to freely change the size and shape of the cutout area A including the specific subject to be processed. Further, when the shutter button 10a is pressed halfway, the size and shape of the cutout area A are fixed to the size and shape desired by the user, and the cutout is performed by following the relative movement of a specific subject. The position of the exit area A can be displaced.
In this way, usability for the digital zoom function of the imaging apparatus 200 can be improved.

  When the shutter button 10a is fully pressed, the partial image Ip corresponding to the cutout area A and the whole image Ia taken at the same timing as the cutout of the cutout area A are recorded in association with each other. Thus, it is possible to more easily grasp the positional relationship of the partial image Ip with respect to the entire image Ia.

Further, since the frame W indicating the cutout area A is displayed in the whole image Ia that is sequentially displayed on the display panel 6b as a live view image, the cutout area A is displayed so as to be identifiable in the whole image Ia. Thus, the positional relationship within the entire image Ia of the partial image Ip corresponding to the cutout area A can be more easily grasped. In particular, until a half-press operation of the shutter button 10a is performed, an image of an area other than the cutout area A in the entire image Ia that is sequentially displayed as a live view image is displayed as a partial image corresponding to the cutout area A. Since the image is displayed in a predetermined display mode that does not attract relative to Ip, it is possible to make the cutout area A relatively conspicuous in the entire image Ia, and to easily identify the cutout area A. It can be displayed as possible.
Furthermore, when a half-press operation of the shutter button 10a is performed, a predetermined display mode in which an image in an area other than the cut-out area A is not relatively emphasized with respect to the partial image Ip corresponding to the cut-out area A. Since the display state at is canceled, the angle of view of the entire image Ia can be adjusted more easily.

  Further, any one of a plurality of combinations of the size and shape of the cutout area A is determined according to a predetermined operation of the operation input unit 10 performed by the user until the half-press operation of the shutter button 10a is performed. Since a combination is selected and a cutout area A having a size and shape corresponding to this combination is displayed in an identifiable manner in the entire image Ia as a live view image, a cutout area including a specific subject to be cut out The size and shape of A can be freely changed, and the entire cutout area A of the changed size and shape is displayed in an identifiable manner in the entire image Ia, so that the entire partial image Ip corresponding to the cutout area A is displayed. The positional relationship in the image Ia can be grasped more easily.

The present invention is not limited to the first and second embodiments, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, in the first and second embodiments, the partial image Ip and the entire image Ia are recorded in association with each other. However, the recording is not limited to this example, and at least the partial image Ip is recorded. Any configuration can be used.

  In the first embodiment, the live view image displayed on the display panel 6b is switched from the entire image Ia to the partial image Ip after the half-press operation of the shutter button 10a. The partial image Ip may be displayed on the display panel 6b as a live view image regardless of whether or not the shutter button 10a is half-pressed.

  Further, in the first and second embodiments, the determination of a specific subject to be cut out, tracking (fixing), and image recording are instructed by the half-press operation and full-press operation of the same shutter button 10a. As a result, it is possible to perform a quick operation including image recording. However, an operation other than the shutter button may be used to instruct the determination and tracking (fixing) of a specific subject to be cut out. . For example, the operation input unit 10 includes a touch panel (not shown) formed integrally with the display panel 6b. For example, the first contact operation is a first operation on the basis of the number of times of contact with the touch panel. The second contact operation performed continuously may be set as the second operation.

  In the first and second embodiments, the determination and tracking (fixing) of a specific subject to be cut out are instructed by a half-press operation of the shutter button 10a. When a face is a specific subject, the registered face may always be determined and tracked (fixed) without any user operation.

  In addition, the configurations of the imaging devices 100 and 200 illustrated in the first and second embodiments are examples, and are not limited thereto. For example, the recording means for recording the partial image Ip and the entire image Ia may be provided in an external device such as a server, for example, or image data may be transmitted and recorded via a communication network.

In addition, in the first embodiment, under the control of the central control unit 1, the first cutout unit 5a, the first display control unit 6a, the first subject movement detection unit 5d, the first displacement unit 5e, Although the first recording control unit 8 is driven, the present invention is not limited to this, and a predetermined program or the like may be executed by the CPU of the central control unit 1.
That is, a program including a cutout processing routine, a display control processing routine, a movement detection processing routine, a displacement processing routine, and a recording control processing routine is recorded in a program memory (not shown). Then, the CPU of the central control unit 1 may realize a function of cutting out a partial region corresponding to the zoom magnification from the entire image Ia picked up by the image pickup unit 3 by the cut-out processing routine. In addition, the CPU of the central control unit 1 causes the CPU of the central control unit 1 to sequentially display the entire image Ia sequentially captured by the imaging unit 3 on the display panel 6b as a live view image, and when the first operation is performed. The live view image sequentially displayed on the panel 6b may be switched to the partial image Ip corresponding to a partial area cut out from the entire image Ia to be displayed. Further, a function of detecting relative movement of a specific subject with respect to the angle of view captured by the imaging unit 3 may be realized by the CPU of the central control unit 1 by a movement detection processing routine. Further, after the first operation is performed on the CPU of the central control unit 1 by the displacement processing routine, the cut-out position of the part of the cut-out region is displaced in accordance with the relative movement of the specific subject to be detected. You may make it implement | achieve a function. In addition, the function of recording the partial image Ip corresponding to the cut out partial area when the second operation different from the first operation is performed on the CPU of the central control unit 1 by the recording control processing routine is realized. You may make it let it.

  Similarly, the CPU of the central control unit 1 may realize a function of sequentially cutting out a partial area corresponding to the zoom magnification from the entire image Ia picked up by the image pickup unit 3 by a cut-out processing routine. Further, the CPU of the central control unit 1 may realize a function of sequentially displaying the partial image Ip corresponding to a partial area that is sequentially cut out as a live view image on the display panel 6b by the display control processing routine. Further, a function of detecting relative movement of a specific subject with respect to the angle of view captured by the imaging unit 3 may be realized by the CPU of the central control unit 1 by a movement detection processing routine. Further, the CPU of the central control unit 1 may realize a function of displacing the cutout position of a part of the cutout area in accordance with the relative movement of the specific subject to be detected by the displacement processing routine. The CPU of the central control unit 1 records a partial image Ip corresponding to the cut out partial area when a predetermined operation is performed by a recording control processing routine. A function of recording the partial image Ip corresponding to the cut out partial area and the entire image Ia captured by the imaging unit 3 at the same timing as the cutting out of the partial area when set. It may be realized.

In the second embodiment, the second display control unit 206a, the second position setting unit 205a, the second displacement unit 205c, the displacement control unit 205d, and the second recording control are controlled under the control of the central control unit 1. However, the present invention is not limited to this, and a configuration in which a predetermined program or the like is executed by the CPU of the central control unit 1 may be employed.
That is, a program including a setting processing routine, an area display control processing routine, a displacement processing routine, a displacement control processing routine, and a recording control processing routine is recorded in a program memory (not shown). Then, a function of setting the cutout area A at a predetermined position within the imaging range of the imaging unit 3 may be realized by the CPU of the central control unit 1 by a setting processing routine. Further, a function of causing the CPU of the central control unit 1 to display the image in the set cutout area A on the display panel 6b as a live view image by the area display control processing routine may be realized. In addition, a function for displacing the position of the cutout area A within the imaging range is realized by causing the CPU of the central control unit 1 to follow the movement of a specific subject within the imaging range of the imaging unit 3 by a displacement processing routine. You may make it let it. Further, until the first operation is performed by the CPU of the central control unit 1 by the displacement control processing routine, the position of the cutout area A within the imaging range is fixed, and when the first operation is performed, You may make it implement | achieve the function which performs the control which displaces the position of the protrusion area | region A. FIG. In addition, when the second operation is performed after the first operation is performed on the CPU of the central control unit 1 by the recording control processing routine, the cut-out area A in the entire image Ia captured by the imaging unit 3 is displayed. A function of recording the corresponding partial image Ip may be realized.

  Furthermore, as a computer-readable medium storing a program for executing each of the above processes, a non-volatile memory such as a flash memory or a portable recording medium such as a CD-ROM is applied in addition to a ROM or a hard disk. Is also possible. A carrier wave is also used as a medium for providing program data via a predetermined communication line.

Although several embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
Setting means for setting a cutout region at a predetermined position within the imaging range of the imaging means;
Area display control means for causing the display means to display an image in the cutout area set by the setting means as a live view image;
A displacement means for displacing the position of the cutout area in the imaging range so as to follow the movement of a specific subject within the imaging range of the imaging means;
Until the first operation is performed, the position of the cutout area in the imaging range is fixed, and when the first operation is performed, the position of the cutout area is displaced by the displacement means. Displacement control means for performing
A recording control unit that records a partial image corresponding to the cut-out area in the entire image captured by the imaging unit when the second operation is performed after the first operation is performed;
An imaging apparatus comprising:
<Claim 2>
Live view display control means for sequentially displaying the entire image sequentially captured by the imaging means on the display means as the live view image,
The setting means sets the cut-out area at a predetermined position within the imaging range of the imaging means during display of the entire image as the live view image by the live view display control means,
2. The imaging according to claim 1, wherein the region display control unit causes the display unit to display the cutout region set by the setting unit so as to be identifiable in the entire image as the live view image. apparatus.
<Claim 3>
The displacement control means includes
Until the first operation is performed, at least one of the size and shape of the cutout area can be changed in a state where the position of the cutout area is fixed with respect to the imaging range. 3. The imaging apparatus according to claim 2, wherein when the operation 1 is performed, the position of the cutout region is displaced by the displacement unit in a state where the size and shape of the cutout region are fixed.
<Claim 4>
Further comprising a cutting-out means for cutting out the cut-out area from the entire image imaged by the imaging means;
When the second operation is performed, the recording control unit records the partial image corresponding to the cut-out area cut out by the cut-out unit in association with the entire image picked up by the image pickup unit. The imaging apparatus according to any one of claims 1 to 3, wherein
<Claim 5>
When the first operation is performed, the live view display control unit sequentially extracts the live view image sequentially displayed on the display unit from the entire image sequentially captured by the imaging unit. The imaging apparatus according to claim 2, wherein the imaging device is switched to a partial image corresponding to a region.
<Claim 6>
The live view display control means sequentially reduces the whole image picked up by the image pickup means at a predetermined position of a partial image corresponding to the cut-out area sequentially displayed on the display means as the live view image. Combined and displayed,
The area display control means displays a frame indicating the position and size of the cut-out area in the entire image that is synthesized and displayed in a reduced state at a predetermined position of the partial image. The imaging device according to claim 5.
<Claim 7>
The area display control means displays a frame indicating the cut-out area in the entire image sequentially displayed on the display means as the live view image by the live view display control means. The imaging device according to 5 or 6.
<Claim 8>
The region display control unit is a region other than the cut-out region in the entire image that is sequentially displayed on the display unit as the live view image by the live view display control unit until the first operation is performed. The image pickup apparatus according to claim 7, wherein the image is displayed in a predetermined display form so as not to be relatively emphasized with respect to the partial image corresponding to the cut-out area.
<Claim 9>
When the first operation is performed, the area display control means displays a frame indicating the cut area whose size and shape are fixed in the entire image as the live view image, and the cut area The imaging apparatus according to claim 8, wherein the display state of the image in a region other than the display state in the predetermined display mode is canceled.
<Claim 10>
Further comprising a defining means for defining a plurality of combinations in which at least one of the size and shape of the cutout region is different;
The area display control unit selects any one of the combinations defined by the defining unit according to a third operation performed until the first operation is performed. The image pickup apparatus according to claim 8 or 9, wherein the image pickup device is selected and displayed so that a cutout region having a size and a shape corresponding to the combination can be identified in the entire image as the live view image.
<Claim 11>
A movement detecting means for detecting a relative movement of the specific subject within the cutout region with respect to the imaging range of the imaging means;
The displacement means displaces the position of the cutout region in the imaging range in accordance with the relative movement of the specific subject detected by the movement detection means. The imaging device according to any one of the above.
<Claim 12>
An imaging method using an imaging device,
A setting process for setting a cutout region at a predetermined position within the imaging range of the imaging means;
An area display control process for causing the display means to display an image in the cutout area set by the setting process as a live view image;
A displacement process for displacing the position of the cutout region in the imaging range so as to follow the movement of a specific subject within the imaging range of the imaging means;
Until the first operation is performed, the position of the cutout area within the imaging range is fixed, and when the first operation is performed, the position of the cutout area is displaced by the displacement process. Displacement control processing to perform,
When a second operation is performed after the first operation is performed, a recording control process for recording a partial image corresponding to the cut-out area in the entire image captured by the imaging unit;
An imaging method comprising:
<Claim 13>
The computer of the imaging device,
Setting means for setting a cutout region at a predetermined position within the imaging range of the imaging means;
Area display control means for causing the display means to display an image in the cutout area set by the setting means as a live view image;
Displacement means for displacing the position of the cutout region in the imaging range so as to follow the movement of a specific subject within the imaging range of the imaging means;
Until the first operation is performed, the position of the cutout area in the imaging range is fixed, and when the first operation is performed, the position of the cutout area is displaced by the displacement means. Displacement control means for performing,
A recording control unit that records a partial image corresponding to the cut-out area in the entire image captured by the imaging unit when the second operation is performed after the first operation is performed;
A program characterized by functioning as

100, 200 Imaging device 1 Central control unit 3 Imaging unit 5 First image processing unit 5a First cutout unit 5b Subject position detection unit 5c First position setting unit 5d First subject movement detection unit 5e First displacement unit 6 First Display unit 6a First display control unit 6b Display panel 7 Image quality setting unit 8 First recording control unit 9 Recording unit 10 Operation input unit 10a Shutter button 202 Second memory 205 Second image processing unit 205a Second position setting unit 205b Second Subject movement detection unit 205c Second displacement unit 205d Displacement control unit 205e Second cutout unit 206 Second display unit 206a Second display control unit 208 Second recording control unit Ia Whole image Ip Partial image T Cutout region table

Conventionally, in an imaging device capable of shooting from a wide angle to a telephoto, while a wide-angle image before zooming is being displayed through, a wide-angle image before zooming is sequentially cut out and acquired, and when a zoom operation is performed on the telephoto side, There is also known a technique for holding a wide-angle image before zooming obtained by cutting out at a point in time, and displaying a held wide-angle image before zoom operation together with a telephoto image after zoom operation when the zoom magnification exceeds a predetermined magnification. (For example, refer to Patent Document 1).

However, in Patent Document 1 , the cutout area is fixed, and there is a problem that the cutout area has no diversity .

The present invention has been made in view of such problems, and it is an object of the present invention to provide an imaging apparatus, an imaging method, and a program capable of providing diversity in a cutout area when cutting out a partial area of a captured image. .

In order to solve the above problems, an imaging apparatus according to the present invention provides:
Live view display control means for sequentially displaying the whole image sequentially captured by the imaging means on the display means as a live view image;
Setting means for setting a cutout region at a predetermined position within the imaging range of the imaging means during display of the entire image as the live view image by the live view display control means;
Defining means for defining a plurality of combinations in which at least one of the size and shape of the cutout region is different;
One of the combinations defined by the defining means is selected, and a cutout area having a size and shape corresponding to the combination is identified in the entire image as the live view image. Area display control means for enabling display;
It is characterized by having.

ADVANTAGE OF THE INVENTION According to this invention, diversity can be given to the cut-out area | region at the time of cutting out a partial area | region of a captured image .

Claims (11)

Live view display control means for sequentially displaying the whole image sequentially captured by the imaging means on the display means as a live view image;
Setting means for setting a cutout region at a predetermined position within the imaging range of the imaging means during display of the entire image as the live view image by the live view display control means;
A displacement means for displacing the position of the cutout area in the imaging range so as to follow the movement of a specific subject within the imaging range of the imaging means;
Until the first operation is performed, the position of the cutout area in the imaging range is fixed, and when the first operation is performed, the position of the cutout area is displaced by the displacement means. Displacement control means for performing
Until the first operation is performed, an image of an area other than the cut-out area in the entire image that is sequentially displayed on the display means as the live view image by the live view display control means is extracted. An area display control means for displaying in a predetermined display mode so as not to be relatively emphasized with respect to the partial image corresponding to the area;
An imaging apparatus comprising: The displacement control means includes
Until the first operation is performed, at least one of the size and shape of the cutout area can be changed in a state where the position of the cutout area is fixed with respect to the imaging range. 2. The imaging apparatus according to claim 1, wherein when the operation 1 is performed, the position of the cutout region is displaced by the displacement unit in a state where the size and shape of the cutout region are fixed. A recording control unit for recording a partial image corresponding to the cut-out area in the whole image captured by the imaging unit when the second operation is performed after the first operation is performed; The imaging device according to claim 1, wherein: Further comprising a cutting-out means for cutting out the cut-out area from the entire image imaged by the imaging means;
When the second operation is performed, the recording control unit records the partial image corresponding to the cut-out area cut out by the cut-out unit in association with the entire image picked up by the image pickup unit. The imaging apparatus according to claim 3, wherein: The live view display control means, when the first operation is performed, the live view image sequentially displayed on the display means, from the whole image sequentially imaged by the imaging means,
The imaging apparatus according to claim 1, wherein the imaging device is switched to a partial image corresponding to the cut region that is sequentially cut out. The live view display control means sequentially reduces the whole image picked up by the image pickup means at a predetermined position of a partial image corresponding to the cut-out area sequentially displayed on the display means as the live view image. Combined and displayed,
The area display control means displays a frame indicating the position and size of the cut-out area in the entire image that is synthesized and displayed in a reduced state at a predetermined position of the partial image. The imaging device according to any one of claims 1 to 5. The area display control means displays a frame indicating the cut-out area in the entire image sequentially displayed on the display means as the live view image by the live view display control means. The imaging device according to any one of 1 to 6. When the first operation is performed, the area display control unit displays a frame indicating the cut-out area whose size and shape are fixed in the entire image as the live view image, and
The image pickup apparatus according to claim 1, wherein a display state of the image in an area other than the cut-out area in the predetermined display mode is canceled. A movement detecting means for detecting a relative movement of the specific subject within the cutout region with respect to the imaging range of the imaging means;
The displacement means displaces the position of the cutout region in the imaging range in accordance with the relative movement of the specific subject detected by the movement detection means. The imaging device according to any one of the above. An imaging method using an imaging device,
Live view display control processing for sequentially displaying the whole image sequentially captured by the imaging unit on the display unit as a live view image;
A setting process for setting a cutout region at a predetermined position within the imaging range of the imaging means during display of the entire image as the live view image by the live view display control process;
A displacement process for displacing the position of the cutout region in the imaging range so as to follow the movement of a specific subject within the imaging range of the imaging means;
Until the first operation is performed, the position of the cutout area within the imaging range is fixed, and when the first operation is performed, the position of the cutout area is displaced by the displacement process. Displacement control processing to perform,
Until the first operation is performed, an image of an area other than the cut-out area in the entire image that is sequentially displayed on the display unit as the live view image by the live view display control process is extracted. An area display control process for displaying the image in a predetermined display manner that does not make it relatively stand out with respect to the partial image corresponding to the area;
An imaging method comprising: The computer of the imaging device,
Live view display control means for sequentially displaying the whole image sequentially captured by the imaging means on the display means as a live view image;
Setting means for setting a cutout region at a predetermined position within the imaging range of the imaging means during display of the entire image as the live view image by the live view display control means;
Displacement means for displacing the position of the cutout region in the imaging range so as to follow the movement of a specific subject within the imaging range of the imaging means;
Until the first operation is performed, the position of the cutout area in the imaging range is fixed, and when the first operation is performed, the position of the cutout area is displaced by the displacement means. Displacement control means for performing,
Until the first operation is performed, an image of an area other than the cut-out area in the entire image that is sequentially displayed on the display means as the live view image by the live view display control means is extracted. An area display control means for displaying in a predetermined display mode so as not to be relatively enhanced with respect to the partial image corresponding to the area;
A program characterized by functioning as

Images