JP2018007190A - Imaging device, image display method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To let a user learn the relationship between a partial image and an entire image more easily.SOLUTION: An imaging device 100 includes: a record control unit 6 for having a partial image corresponding to a cutout region in an entire image photographed with an imaging unit 3 recorded in association with prescribed relation information related to at least the entire image when operation to give instruction to record the image is performed; and a display control unit 8a for obtaining the recorded partial image to display the same by a display panel 8b, obtaining the prescribed relation information recorded in association with the partial image, and having prescribed display operation to switch the partial image displayed on the display panel to the entire image performed.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an imaging apparatus, an image display method, and a program.

  2. Description of the Related Art Conventionally, there has been known an imaging apparatus having a digital zoom function in which a partial area corresponding to a zoom magnification is cut out from a whole image obtained by imaging, enlarged and displayed on a monitor screen, and recorded according to a shooting instruction. In addition, a technique is also known in which a wide-angle image before zooming is combined and displayed on a part of a monitor screen in a reduced state (for example, see Patent Document 1).

JP 2010-232962 A

  However, in the case of the above-mentioned Patent Document 1, even if a telephoto image after zooming and a wide-angle image before zooming are read and displayed after shooting, there is a problem that it is difficult to grasp the mutual relationship and usability is poor. is there.

  The present invention has been made in view of such problems, and an object of the present invention is to provide an imaging apparatus, an image display method, and an image display method that allow a user to more easily understand the relationship between a partial image and an entire image. Is to provide a program.

In order to solve the above problems, an imaging apparatus according to the present invention provides:
Setting means for setting a cutout region at a predetermined position within the imaging range of the imaging means;
When an operation for instructing image recording is performed, a partial image corresponding to the cut-out area in the entire image captured by the imaging unit is associated with at least predetermined related information related to the entire image. Recording control means for recording;
A partial image display control means for acquiring the partial image recorded by the recording control means and displaying the partial image on a display means;
The recording control means acquires the predetermined related information recorded in association with the partial image, and performs a predetermined display operation for switching the partial image displayed on the display means to the whole image. Switching display control means,
It is characterized by having.

  According to the present invention, the user can more easily grasp the relationship between the partial image and the entire image.

It is a block diagram which shows schematic structure of the imaging device of one Embodiment to which this invention is applied. 3 is a flowchart illustrating an example of an operation related to an imaging process by the imaging apparatus of FIG. 1. It is a figure for demonstrating the imaging | photography process of FIG. It is a figure for demonstrating the imaging | photography process of FIG. It is a figure for demonstrating the imaging | photography process of FIG. 3 is a flowchart illustrating an example of an operation related to an image display process by the imaging apparatus of FIG. 1. It is a figure for demonstrating the image display process of FIG. It is a figure for demonstrating the image display process of FIG.

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus 100 according to an embodiment to which the present invention is applied.
As shown in FIG. 1, the imaging apparatus 100 according to the present embodiment specifically includes a central control unit 1, a memory 2, an imaging unit 3, a signal processing unit 4, an image processing unit 5, and recording control. A unit 6, a recording unit 7, a display unit 8, and an operation input unit 9 are provided.
The central control unit 1, the memory 2, the imaging unit 3, the signal processing unit 4, the image processing unit 5, the recording control unit 6, and the display unit 8 are connected via a bus line 10.

  The central control unit 1 controls each unit of the imaging device 100. Specifically, although not shown, the central control unit 1 includes a CPU (Central Processing Unit) and the like, and performs various control operations according to various processing programs (not shown) for the imaging apparatus 100.

The memory 2 is composed of, for example, a DRAM (Dynamic Random Access Memory) or the like, and temporarily stores data processed by the central control unit 1 or the image processing unit 5.
In addition, the memory 2 records a cutout area table T in which a combination of the size (size) and shape of the cutout area A (see FIG. 3A and the like) is defined. Specifically, the cutout area table T defines a plurality of combinations in which at least one of the size and shape of the cutout area A is different.
The size and shape of the cutout area A are, for example, the vertical and horizontal directions of the area that can be imaged when a partial area in the entire image Ia (see FIG. 5B) is zoomed in at a predetermined zoom magnification by digital zoom or optical zoom. And the relative ratios of the vertical and horizontal dimensions of the cutout area A with respect to the vertical and horizontal pixel numbers of the entire image Ia are made different. For example, the cut-out area A has a vertically long shape (see FIG. 3A) and a horizontally long shape (see FIG. 3B). It is defined in the outgoing area table T.
Note that the size and shape of the cutout area A illustrated in FIGS. 3A and 3B are merely examples, and are not limited thereto, and can be arbitrarily changed as appropriate. For example, the shape of the cutout area A may be a circle or an ellipse, may be a polygon other than a rectangle, may be a star or a heart, or may be operated by a user. Any shape that encloses a partial region in the entire image Ia, such as an arbitrary shape designated based on a predetermined operation of the unit 9 or the like, may be used.

  The imaging unit 3 captures a subject at an arbitrary imaging frame rate and generates a frame image. Specifically, the imaging unit 3 includes a lens unit 3a, an electronic imaging unit 3b, and an imaging control unit 3c.

The lens unit 3a includes, for example, a plurality of lenses such as a zoom lens and a focus lens, and a diaphragm for adjusting the amount of light passing through the lens.
The electronic imaging unit 3b is composed of an image sensor (imaging device) such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor). Then, the electronic imaging unit 3b converts the optical image that has passed through the various lenses of the lens unit 3a into a two-dimensional image signal.
For example, the imaging control unit 3c scans and drives the electronic imaging unit 3b with a timing generator or a driver, and converts the optical image that has passed through the lens unit 3a into a two-dimensional image signal at predetermined intervals by the electronic imaging unit 3b. Then, the frame image is read out for each screen from the imaging region of the electronic imaging unit 3b and is output to the signal processing unit 4.
Note that the imaging control unit 3c may perform adjustment control of conditions when imaging a subject such as AF (automatic focusing processing), AE (automatic exposure processing), and AWB (automatic white balance).

  The signal processing unit 4 performs various types of image signal processing on the analog value signal of the frame image transferred from the electronic imaging unit 3b. Specifically, for example, the signal processing unit 4 appropriately adjusts the gain for each RGB color component with respect to the analog value signal of the frame image, and samples and holds it by a sample hold circuit (not shown) to perform A / D conversion. The digital data is converted by a device (not shown), and color processing including pixel interpolation processing and γ correction processing is performed by a color process circuit (not shown) to obtain a luminance signal Y and color difference signals Cb, Cr (YUV) of digital values. Data). The signal processing unit 4 outputs the generated luminance signal Y and color difference signals Cb and Cr to the memory 2 used as a buffer memory.

The image processing unit 5 includes a setting unit 5a, a subject movement detection unit 5b, a displacement unit 5c, a displacement control unit 5d, and a cutout unit 5e.
Note that each unit of the image processing unit 5 includes, for example, a predetermined logic circuit, but the configuration is an example and the present invention is not limited thereto.

The setting unit 5 a sets the cutout area A at a predetermined position within the imaging range of the imaging unit 3.
That is, for example, when a predetermined shooting mode for recording the partial image Ip (see FIG. 5A) and the entire image Ia (see FIG. 5B) in association with each other is set on the display panel 8b. During the display of the entire image Ia as the live view image, the setting unit 5a sets the cutout area A at a predetermined position (for example, approximately the center) within the imaging range (view angle) of the imaging unit 3. Here, the size and shape of the cutout area A may be, for example, the size and shape set as default in the cutout area table T, or the size and shape of the cutout area A set last time. There may be.
For example, when a specific subject is detected from within the angle of view by subject recognition processing (described later) or the like, the setting unit 5a includes the specific subject on the basis of the position of the detected specific subject. The cutout area A may be set in

The subject movement detection unit 5b detects the movement of a specific subject.
That is, the subject movement detection unit 5b detects a relative movement of a specific subject within the cutout area A set by the setting unit 5a with respect to the imaging range of the imaging unit 3.
Specifically, the subject movement detection unit 5b performs, for example, subject recognition processing for collating the feature information recorded in the recording unit 7 on the cutout area A in the entire image Ia to perform the cutout area A. A specific subject is detected from within. Then, the subject movement detection unit 5b performs the subject recognition process described above on the YUV data of the plurality of frame images related to the live view image (entire image Ia) generated by the signal processing unit 4, and the identification once detected. A specific subject is sequentially detected from the cutout area A of each frame image by performing a moving body tracking process using information for tracking the subject (for example, feature points, luminance information, color information, etc.). Thereby, the subject movement detection unit 5b sequentially detects a relative movement of a specific subject in the cutout area A with respect to the imaging range of the imaging unit 3.

When detecting the relative movement of a specific subject with respect to the imaging range of the imaging unit 3, for example, if the specific subject is not a moving object, the specific subject is another subject (for example, a background) within the imaging range. Therefore, the movement of a specific subject may be detected by detecting the movement of another subject (for example, the entire background) within the imaging range.
In addition, the specific subject is not limited to the one detected by the above-described processing. For example, even if the subject has the largest face detected by the face detection processing (subject closest). good.

The displacement part 5c displaces the position of the cutout area A.
In other words, the displacement unit 5c displaces the position of the cutout area A within the imaging range so as to follow the movement of a specific subject within the imaging range of the imaging unit 3. Specifically, the displacement unit 5c is operated by the imaging unit 3 in accordance with the relative movement of the specific subject detected by the subject movement detection unit 5b after the user performs a half-press operation of the shutter button 9a. The position of the cutout area A within the imaging range is displaced. That is, for example, when the position of a specific subject in the cut-out area A is approximately at the center of the cut-out area A, the subject movement detection unit 5b detects the relative movement of the specific subject within the angle of view. However, the displacement unit 5c displaces the position of the cutout area A in accordance with the relative movement of the specific subject, so that the position of the specific subject in the cutout area A does not change. .

Specifically, for example, when a feature point of a specific subject is tracked by the subject movement detection unit 5b and a motion vector of the specific subject is calculated, the displacement unit 5c detects the calculated specific subject. An operation for displacing the position of the cutout area A may be performed based on the motion vector. For example, when subject recognition processing is performed by the subject movement detection unit 5b, the displacement unit 5c displaces the position of the cutout area A based on the movement of the recognized recognition position of the specific subject. Operation may be performed. Furthermore, the displacement unit 5c detects, for example, rotation in the pitch direction, yaw direction, and roll direction with reference to the optical axis direction of the lens unit 3a of the imaging apparatus 100 main body by an angular velocity sensor (not shown) or the like. You may perform the operation | movement which displaces the position of the cutting-out area | region A based on a direction and the rotation amount.
The three operations described above can be executed manually or automatically switched. In addition, for example, when three operations are automatically switched, a specific subject in which characteristic information for identifying a specific subject (a face image of the specific subject) is recorded in the recording unit 7 in advance in the subject recognition process. The image sensing apparatus 100 main body is displaced by a user detected from an angular velocity sensor (not shown) or the like based on the result of the moving body tracking process. Switching may be performed depending on whether or not the speed is equal to or higher than a predetermined speed.
Furthermore, at least any two of the three operations described above may be combined and the position of the cutout area A may be displaced by complex control.

The displacement control unit 5d controls the displacement of the cutout area A.
That is, the displacement control unit 5d fixes the position of the cutout region A at a predetermined position (for example, approximately the center) within the imaging range of the imaging unit 3 until the user performs a half-pressing operation on the shutter button 9a. Control to make a state. Further, until the user presses the shutter button 9a halfway, for example, the size desired by the user from a plurality of combinations of the size and shape of the cutout area A defined in the cutout area table T is used. And the combination of shapes is selected based on a predetermined operation of the operation input unit 9 by the user, so that the displacement control unit 5d fixes the position of the cutout area A with respect to the imaging range of the imaging unit 3, You may control so that at least one of the size and shape of the said cut-out area | region A can be changed (refer Fig.3 (a) and FIG.3 (b)).
In addition, when the user performs a half-press operation on the shutter button 9a, the displacement control unit 5d performs control to displace the position of the cutout region A so that the displacement unit 5c follows the movement of a specific subject. Furthermore, when the half-pressing operation of the shutter button 9a is performed by the user, the displacement control unit 5d fixes the size and shape of the specified cutout area A until the half-pressing operation of the shutter button 9a is performed. Thus, the displacement unit 5c may perform control for displacing the position of the cutout area A so as to follow the movement of a specific subject (see FIG. 4B).

Note that the size and shape of the cutout area A can be changed until the user performs a half-pressing operation on the shutter button 9a. However, this is only an example, and the present invention is not limited thereto. Even after the half-pressing operation of 9a is performed, the size and shape of the cutout area A can be changed. For example, when the shutter button is fully pressed (second operation), the cutout area A can be changed. The size and shape may be fixed.
That is, when the user half-presses the shutter button 9a, the position of the cutout area A is displaced so as to follow the movement of the specific subject. Is in a state that exists. For this reason, for example, when changing so that the size of the cutout area A is increased, a specific subject always exists in the cutout area A, while the size of the cutout area A is Even if the size is changed to be smaller, at least a part of the specific subject exists in the cutout area A. Similarly, even if the area of the cutout area A is reduced by changing the shape of the cutout area A, at least a part of a specific subject exists in the cutout area A. However, in order to properly perform subject recognition processing, moving object tracking processing, and the like by the subject movement detection unit 5b, it is necessary to detect a specific subject again from within the cutout area A after the size and shape change.

The cutout part 5e cuts out the cutout area A from the entire image Ia.
That is, when the full press operation is performed following the half press operation of the shutter button 9a by the user, the cutout unit 5e acquires the YUV data of the entire image Ia generated by the signal processing unit 4 from the memory 2, and Image data of the partial image Ip corresponding to the cut-out area A in the image Ia is cut out (see FIG. 5A). That is, after a half-pressing operation of the shutter button 9a by the user is performed, the displacement control unit 5d displaces the position of the cutout area A so that the displacement unit 5c follows the movement of the specific subject. When the user fully presses the shutter button 9a, the cutout unit 5e corresponds to the cutout region A from the entire image Ia at the position of the cutout region A within the imaging range of the imaging unit 3 at that time. The partial image Ip is cut out.
Note that the cutout area A is an area that can be imaged when, for example, a partial area in the entire image Ia is zoomed in by digital zoom or optical zoom. For example, in the case of a zoom magnification in which each of the vertical and horizontal directions is doubled, an area having a size of 1/4 in the area ratio in the entire image Ia becomes the cutout area A. When the partial image Ip of the cutout area A is displayed on the entire display panel 8b of the display unit 8, the cutout area A is zoomed in and the partial image Ip is enlarged and displayed.
Further, the whole image Ia referred to here is an image that is a base image before the cutout area A is cut out, and is not necessarily an image corresponding to all the pixels of the image sensor (imaging device).

The recording control unit 6 controls reading of data from the recording unit 7 and writing of data to the recording unit 7.
That is, the recording control unit 6 is for recording an image encoded in a predetermined compression format (for example, JPEG format) in the recording unit 7 configured by, for example, a nonvolatile memory (flash memory) or a recording medium. The image data is recorded. Specifically, the recording control unit 6 cuts out the entire image Ia picked up by the image pickup unit 3 when an operation for instructing image recording (for example, full pressing operation of the shutter button 9a) is performed by the user. A partial image Ip corresponding to the cut-out area A cut out by the unit 5e, a whole image Ia picked up by the image pickup unit 3, and moving image information M having a visual effect that dynamically switches from the partial image Ip to the whole image Ia; Are recorded in the recording unit 7 in association with each other.
Specifically, the recording control unit 6 includes a moving image generation unit 6 a that generates moving image information M, and causes the recording unit 7 to record the moving image information M generated by the moving image generation unit 6 a.

When the user fully presses the shutter button 9a to instruct the recording of the partial image Ip or the entire image Ia, the moving image generating unit 6a uses at least the predetermined image from the partial image Ip as predetermined related information related to the entire image Ia. The moving image information M having a visual effect that is dynamically switched to the image Ia is generated.
This moving image information M is, for example, a region other than the partial image Ip in the entire image Ia from the first display state (see FIG. 7A) in which the partial image Ip is displayed in the entire display region of the display panel 8b. Through a display state in the middle of displaying the displayed image (see FIG. 7C), a second display state in which the entire image Ia is displayed in the entire display area of the display panel 8b (see FIG. 8B). In order to display a moving image that dynamically switches images at a predetermined frame rate.
Specifically, the moving image generating unit 6a, for example, the image data of the entire image Ia, the image data of the partial image Ip, and the coordinates of the position of the partial image Ip (cutout area A) in the entire image Ia (for example, upper left In order to display the partial image Ip while gradually reducing the size of the partial image Ip while fixing the aspect ratio of the partial image Ip from the first display state to the intermediate display state. Information indicating the display position and the enlargement / reduction ratio of the partial image Ip, and the area for displaying the partial image Ip while gradually narrowing the non-display area in the entire image Ia between the intermediate display state and the second display state. Information indicating the position of a non-display area in the entire image Ia is generated. The moving image generating unit 6a then reduces the size of the partial image Ip displayed in the entire display area of the display panel 8b in accordance with the information indicating the display position and the enlargement / reduction ratio of the partial image Ip. The image F1 (see FIG. 7B), the frame image F2 (see FIG. 7C) in which the area other than the partial image Ip in the entire image Ia is hidden, and the position of the area to be hidden are shown. In accordance with the information, moving image information M including a predetermined number of frame images F3 (see FIG. 8A) in which the non-display area in the entire image Ia is gradually narrowed is generated.
In the moving image information M, for example, the first frame image may be the partial image Ip, and the last frame image may be the entire image Ia. The moving image information M is, for example, data in a format conforming to the MOV format or H.264 / AVC, but is only an example and is not limited thereto, and can be arbitrarily changed as appropriate.

Further, the recording control unit 6 individually compresses the partial image Ip, the entire image Ia, and the moving image information M, and causes the recording unit 7 to record them as separate files with the same file name. That is, the recording control unit 6 causes the partial image Ip, the entire image Ia, and the moving image information M to have the same file name, and causes the recording unit 7 to record them in association with each other.
Of the partial image Ip, the entire image Ia, and the moving image information M, the partial image Ip and the entire image Ia can be reproduced independently of each other. That is, the recording control unit 6 records an image to be reproduced (for example, the partial image Ip) when the reproduction of the partial image Ip or the entire image Ia is instructed based on a predetermined operation of the operation input unit 9 by the user. Read from unit 7. The display control unit 8a performs control to display the reproduction target image read from the recording unit 7 and decoded by the image processing unit 5 in the display area of the display panel 8b (details will be described later).
On the other hand, the moving image information M can be reproduced when the execution of a predetermined display operation is instructed while the partial image Ip is displayed on the display panel 8b. That is, for example, when the user operates the index C (see FIG. 7A) displayed on the display panel 8b via the operation input unit 9, the first display state described above (FIG. 7A). When the execution of the moving image display (predetermined display operation) from the second display state (see FIG. 8B) is instructed, the recording control unit 6 displays the displayed partial image Ip. The associated moving image information M is read from the recording unit 7. Then, the display control unit 8a performs control to display a moving image in the display area of the display panel 8b based on the moving image information M read from the recording unit 7 and decoded by the image processing unit 5 (details will be described later).

The partial image Ip and the entire image Ia can be deleted independently. That is, when the recording control unit 6 is instructed to delete the partial image Ip or the entire image Ia based on a predetermined operation of the operation input unit 9 by the user, the recording control unit 6 records an image to be deleted (for example, the partial image Ip). Delete from part 7.
On the other hand, when the deletion of at least one of the partial image Ip and the entire image Ia is instructed, the moving image information M can be deleted along with the deletion. In other words, as described above, when the recording control unit 6 is instructed to delete the partial image Ip or the entire image Ia based on a predetermined operation of the operation input unit 9 by the user, the image (for example, the partial image) to be deleted. The moving image information M associated with Ip and the like is also deleted from the recording unit 7 together.

  When the partial image Ip and the entire image Ia have different image quality, the recording control unit 6 individually compresses the entire image Ia with a compression rate so that the entire image Ia has a lower image quality than the partial image Ip. You may make it record on the recording part 7 as a separate file.

  The display unit 8 includes a display control unit 8a and a display panel 8b.

  The display control unit 8a performs control to display a predetermined image on the display area of the display panel 8b based on image data of a predetermined size read from the memory 2 or the recording unit 7 and decoded by the image processing unit 5. Specifically, the display control unit 8a includes a VRAM (Video Random Access Memory), a VRAM controller, a digital video encoder, and the like. Then, the digital video encoder reads out the luminance signal Y and the color difference signals Cb and Cr decoded by the image processing unit 5 and recorded in the VRAM from the VRAM through the VRAM controller at a predetermined reproduction frame rate. A video signal is generated based on the data and output to the display panel 8b. Note that the image processing unit 5 may be transformed into a predetermined size (for example, full HD size) based on, for example, the display resolution of the display panel 8b.

The display control unit 8a also updates a plurality of frame images related to the entire image Ia sequentially captured by the imaging unit 3 at a predetermined playback frame rate in a still image or moving image shooting mode while sequentially updating the live view image. Is displayed on the display panel 8b.
At this time, the display control unit 8a can identify the cutout area A by displaying a frame W indicating the cutout area A in the entire image Ia sequentially displayed on the display panel 8b as a live view image. Display. Specifically, for example, the extraction specified in the extraction area table T until the user half-presses the shutter button 9a, that is, until the size and shape of the extraction area A are fixed. When a combination of size and shape desired by the user is selected based on a predetermined operation of the operation input unit 9 by the user from among a plurality of combinations of size and shape of the region A, the display control unit 8a selects By displaying the frame W indicating the cutout area A having the size and shape corresponding to the combination, the cutout area A is displayed in an identifiable manner in the entire image Ia.

Further, the display control unit 8a performs mask processing on an area other than the cut-out area A in the entire image Ia sequentially displayed on the display panel 8b until the user performs a half-press operation on the shutter button 9a. Then, an image of an area other than the cutout area A is displayed in a semi-transparent display state (see FIG. 3A and the like). As a result, the display control unit 8a displays the image of the area other than the cutout area A in a predetermined display mode that does not make the image relatively stand out with respect to the partial image Ip corresponding to the cutout area A. It has become.
Then, when the user presses the shutter button 9a halfway and the size and shape of the cutout area A are fixed, the display control unit 8a displays the semi-transparent display of the image in the area other than the cutout area A. The display in the state is canceled (see FIG. 4A). As a result, the display control unit 8a displays a frame W indicating the cutout area A having a fixed size and shape in the entire image Ia as the live view image.

  Note that, as a predetermined display mode in which an image in an area other than the cutout area A is relatively inconspicuous, a semi-transparent display state of an image in an area other than the cutout area A is illustrated as an example. However, the present invention is not limited to this, and can be arbitrarily changed as appropriate. For example, the display control unit 8a may change the brightness, saturation, hue, and the like of an image in a region other than the cutout region A, or perform mosaic processing and blurring processing on an image in a region other than the cutout region A. Alternatively, the area other than the cutout area A may be completely covered with the mask image.

Further, the display control unit 8a acquires the partial image Ip recorded in the recording unit 7 by the recording control unit 6 and displays the partial image Ip on the display panel 8b, and the moving image information recorded in association with the partial image Ip. (Predetermined related information) M is acquired, and a predetermined display operation for switching the partial image Ip displayed on the display panel 8b to the entire image Ia is performed.
That is, for example, the display control unit 8a corresponds to the partial image Ip in the first display state in which the partial image Ip desired by the user is displayed on the display panel 8b based on a predetermined operation of the operation input unit 9 by the user. In addition, the display panel 8b displays an index C that instructs execution of moving image display (predetermined display operation) from the first display state to the second display state (see FIG. 7A). When the user operates the index C via the operation input unit 9, the display control unit 8 a is associated with the partial image Ip read from the recording unit 7 and decoded by the image processing unit 5. Moving image information M is acquired, and the second display state (see FIG. 8B) is passed through the intermediate display state (see FIG. 7C) from the first display state (see FIG. 7A). Until then, control is performed to display on the display panel 8b a moving image for dynamically switching images at a predetermined frame rate.
Specifically, the display control unit 8a displays the partial image Ip in the moving image information M from the first display state (see FIG. 7A) in which the partial image Ip is displayed on the entire display area of the display panel 8b. A predetermined number of frame images F1 (see FIG. 7B), in which the size of the partial image Ip is gradually reduced according to the information indicating the position and the enlargement / reduction ratio, are switched at a predetermined frame rate and displayed on the display panel 8b. To go. Then, when the display control unit 8a enters the display state (see FIG. 7C) in the middle of displaying the frame image F2 in which the region other than the partial image Ip in the entire image Ia is not displayed on the display panel 8b. A predetermined number of frame images F3 (see FIG. 8A), in which the non-display area in the entire image Ia is gradually narrowed according to the information indicating the position of the non-display area in the moving image information M, are set to a predetermined frame. The rate is switched and displayed on the display panel 8b. Thereafter, the display control unit 8a displays the entire image Ia over the entire display area of the display panel 8b to enter the second display state.
The predetermined display operation for switching the partial image Ip to the entire image Ia is an example and is not limited to this, and can be arbitrarily changed as appropriate.

  In the first display state, displaying the partial image Ip in the entire display area of the display panel 8b means that at least one of the vertical and horizontal lengths of the partial image Ip corresponds to the vertical and horizontal length of the display panel 8b. It means a state where it is enlarged so as to be approximately equal to the length of the person to do. That is, for example, when the aspect ratio of the partial image Ip does not match the aspect ratio of the display panel 8b, an area where the partial image Ip is not displayed is generated in the display area of the display panel 8b (see FIG. 7A). .

The display panel 8b displays an image captured by the imaging unit 3 in the display area based on the video signal from the display control unit 8a.
Examples of the display panel 8b include a liquid crystal display panel and an organic EL (Electro-Luminescence) display panel. However, the display panel 8b is an example and is not limited thereto.

The operation input unit 9 is for performing a predetermined operation of the imaging apparatus 100. Specifically, the operation input unit 9 is a shutter button 9a that can be operated in two stages, a half-pressing operation (first operation) and a full-pressing operation (second operation), in response to an instruction to shoot a subject. Operation units such as a selection determination button (not shown) related to a selection instruction for a shooting mode and a function, and a zoom button (not shown) related to a zoom amount adjustment instruction are provided.
When various buttons are operated by the user, the operation input unit 9 outputs an operation signal corresponding to the operated button to the central control unit 1. The central control unit 1 causes each unit to execute a predetermined operation (for example, taking a still image) according to an operation instruction output from the operation input unit 9 and input.

<Shooting process>
Next, imaging processing by the imaging apparatus 100 will be described with reference to FIGS.
FIG. 2 is a flowchart illustrating an example of an operation related to the photographing process. FIGS. 3A to 5B are diagrams for explaining the photographing process.

  In the imaging process described below, it is assumed that a predetermined imaging mode for recording the partial image Ip and the entire image Ia in association with each other is set.

As shown in FIG. 2, first, the imaging unit 3 starts imaging of a subject, and the display control unit 8 a displays an image for displaying a plurality of frame images related to the entire image Ia generated by the signal processing unit 4. Based on the data, the live view image is displayed on the display panel 8b (step S1).
Next, the setting unit 5a sets, for example, a cutout area A having a size and a shape set as a default in the cutout area table T in the approximate center of the image pickup range of the image pickup unit 3 (step S2). Then, the display control unit 8a displays a frame W indicating the cutout area A in the entire image Ia sequentially displayed on the display panel 8b, and performs mask processing on areas other than the cutout area A, An image of an area other than the cut-out area A is displayed in a semi-transparent display state (step S3; see FIG. 3A).

Thereafter, the CPU of the central control unit 1 determines whether or not an instruction to change the size or shape of the cutout area A is input based on a predetermined operation of the operation input unit 9 by the user (step S4). This determination is made, for example, by selecting one of the combinations of the size and shape of the cutout area A defined in the cutout area table T as a predetermined value of the operation input unit 9 by the user. This is performed depending on whether or not the selection is made based on the operation (third operation).
Here, if it is determined that an instruction to change the size or shape of the cutout area A is input (step S4; YES), the displacement control unit 5d sets the cutout area A to the image pickup range of the image pickup section 3. With the position fixed at the approximate center, the size and shape of the cutout area A are changed according to the instructed change content (step S5). Then, the process returns to step S3, and the display control unit 8a displays the frame W indicating the changed cutout area A on the display panel 8b in response to the change in the size and shape of the cutout area A. Then, an image of an area other than the cutout area A is displayed in a semi-transparent display state (see FIG. 3B).

On the other hand, if it is determined in step S4 that an instruction to change the size or shape of the cutout area A has not been input (step S4; NO), the CPU of the central control unit 1 causes the operation input unit 9 by the user to be changed. It is determined whether or not the half-press operation of the shutter button 9a has been performed (step S6).
Here, if it is determined that the half-press operation of the shutter button 9a has not been performed (step S6; NO), the CPU of the central control unit 1 returns the process to step S4, and similarly to the above, the cut-out area It is determined whether or not an instruction to change the size and shape of A has been input.

If it is determined in step S6 that the half-press operation of the shutter button 9a has been performed (step S6; YES), the display control unit 8a displays the image in the region other than the cut-out region A in the semi-transmissive display state. The display is canceled (step S7; see FIG. 4A).
Then, the displacement control unit 5d performs control for displacing the position of the cutout region A so that the displacement unit 5c follows the movement of the specific subject in a state where the size and shape of the cutout region A are fixed. S8; see FIG. 4 (b)). Specifically, the displacement unit 5c displaces the position of the cutout area A within the imaging range of the imaging unit 3 in accordance with the relative movement of the specific subject detected by the subject movement detection unit 5b. Further, the display control unit 8a causes the display panel 8b to displace and display the frame W indicating the cutout area A in accordance with the displacement of the cutout area A.

Next, the CPU of the central control unit 1 determines whether or not the half-pressing operation of the shutter button 9a of the operation input unit 9 by the user has been released (step S9).
If it is determined that the half-pressing operation of the shutter button 9a has not been released (step S9; NO), the CPU of the central control unit 1 performs a full-pressing operation of the shutter button 9a of the operation input unit 9 by the user. It is determined whether or not it has been performed (step S10).

If it is determined in step S10 that the shutter button 9a has not been fully pressed (step S10; NO), the process returns to step S8, and the displacement control unit 5d performs the extraction region similarly to the above. In a state where the size and shape of A are fixed, the displacement unit 5c performs control to displace the position of the cutout region A so as to follow the movement of a specific subject.
On the other hand, if it is determined in step S10 that the shutter button 9a is fully pressed (step S10; YES), the cutout unit 5e performs signal processing when the shutter button 9a is fully pressed. The YUV data of the whole image Ia generated by the unit 4 is acquired from the memory 2, and the partial image Ip corresponding to the cutout area A is cut out from the whole image Ia (step S11; see FIG. 5A). The imaging control unit 3c performs AF (automatic focusing processing), AE (automatic exposure processing), AWB (automatic white balance), and the like with the cutout area A as a reference when capturing the entire image Ia. Also good.
Thereafter, the moving image generating unit 6a generates moving image information M having a visual effect that dynamically switches from the partial image Ip to the entire image Ia (step S12), and the recording control unit 6 is cut out by the cutting unit 5e. The partial image Ip corresponding to the cut-out area A, the entire image Ia (see FIG. 5B) captured by the imaging unit 3, and the generated moving image information M are individually compressed, and the same file name And make them separate files and record them in the recording unit 7 in association with each other (step S13).

  On the other hand, if it is determined in step S9 that the half-press operation of the shutter button 9a has been released (step S9; YES), the process returns to step S2, and the setting unit 5a is an abbreviation within the imaging range of the imaging unit 3. In the center, for example, the cutout area A having the size and shape set last time (for example, before releasing the half-press operation of the shutter button 9a) is set. Thereafter, similarly to the above, each processing after step S3 is performed.

In the above-described shooting process, the moving image information M is generated following the extraction of the partial image Ip corresponding to the cutout area A. For example, if it takes time to generate the moving image information M, the following information is generated. There is a possibility that the waiting time until photographing will be long. For this reason, the process (steps S12 and S13) for generating the moving image information M and recording it in association with the partial image Ip and the entire image Ia (steps S12 and S13) may be performed in parallel in the background of the next shooting process.
Further, even a device having a relatively low processing capability may cause the same problem as described above. For example, the partial image Ip and the whole image Ia are transmitted to an external device, and the moving image information is transmitted by the external device. M may be generated.

<Image display processing>
Next, image display processing by the imaging apparatus 100 will be described with reference to FIGS. 6 to 8B.
FIG. 6 is a flowchart illustrating an example of an operation related to the image display process. FIGS. 7A to 8B are diagrams for explaining image display processing.

As shown in FIG. 6, first, when a partial image Ip desired by the user is designated based on a predetermined operation of the operation input unit 9 by the user in the image recorded in the recording unit 7, the recording control unit 6 reads the designated partial image Ip from the recording unit 7, and the display control unit 8a displays the partial image Ip read from the recording unit 7 and decoded by the image processing unit 5 as a first display state on the display panel. It is displayed on the entire display area 8b (step S21; see FIG. 7A).
In the first display state, the display control unit 8a associates the partial image Ip with an index C for instructing execution of moving image display from the first display state to the second display state. To display.

Next, the CPU of the central control unit 1 determines whether or not the index C associated with the partial image Ip has been operated based on a predetermined operation of the operation input unit 9 by the user (step S22).
If it is determined that the index C is not operated (step S22; NO), the CPU of the central control unit 1 returns the process to step S21 and maintains the first display state in the same manner as described above. Let
On the other hand, when it is determined in step S22 that the index C has been operated (step S22; YES), the recording control unit 6 stores the moving image information M associated with the displayed partial image Ip. The display control unit 8a acquires the moving image information M read from the recording unit 7 and decoded by the image processing unit 5 (step S23).

  Subsequently, based on the acquired moving image information M, the display control unit 8a applies a predetermined number of frame images F1 (see FIG. 7 (b)) obtained by gradually reducing the size of the partial image Ip to a predetermined frame rate. To switch to display on the display panel 8b (step S24). Then, the display control unit 8a causes the display panel 8b to display a frame image F2 in which a region other than the partial image Ip in the entire image Ia is not displayed as a display state in the middle (step S25; see FIG. 7C). ). In this way, the display control unit 8a causes the display panel 8b to dynamically switch the frame image from the first display state to the intermediate display state by gradually reducing the size of the partial image Ip.

Thereafter, based on the acquired moving image information M, the display control unit 8a switches and displays a predetermined number of frame images F3 that are gradually reduced in the non-display area in the entire image Ia at a predetermined frame rate. The information is displayed on the panel 8b (step S26; see FIG. 8A). Then, the display control unit 8a displays the entire image Ia in the entire display area of the display panel 8b as the second display state (step S27). In this way, the display control unit 8a dynamically switches the frame image from the intermediate display state to the second display state so that the non-display area in the entire image Ia is gradually narrowed to the display panel 8b. Display.
Thus, the image display process is terminated.

  As described above, according to the imaging apparatus 100 of the present embodiment, when an operation for instructing image recording is performed, the partial image Ip corresponding to the cutout area A in the entire image Ia and at least the entire image Ia are displayed. Predetermined related information recorded in association with the partial image Ip displayed on the display panel 8b is acquired and displayed on the display panel 8b. A predetermined display operation for switching the partial image Ip to the whole image Ia is performed, so that the partial image Ip displayed on the display panel 8b can be dynamically switched to the whole image Ia including the partial image Ip. The user can more easily grasp the relationship between the partial image Ip and the entire image Ia.

  Further, when the index C displayed on the display panel 8b in association with the partial image Ip is operated by the user, the display is performed based on the moving image information having a visual effect that dynamically switches from the partial image Ip to the entire image Ia. Since a moving image that dynamically switches from the first display state in which the partial image Ip is displayed in the entire display area of the panel 8b to the second display state in which the entire image Ia is displayed in the entire display area is displayed. The relationship between the partial image Ip displayed on the panel 8b and the entire image Ia dynamically switched from the partial image Ip becomes clearer, and the relationship between the partial image Ip and the entire image Ia is given to the user. This makes it easier to grasp.

  In addition, as a display state in the middle of the dynamic switching from the first display state to the second display state, an image in which an area other than the partial image Ip in the entire image Ia is not displayed is displayed on the display panel 8b. Since the non-display area in the entire image Ia is dynamically reduced from the intermediate display state to the second display state, the positional relationship and relative position of the partial image Ip in the entire image Ia The user can easily grasp the size. In particular, the display panel 8b is dynamically switched from the first display state in which the partial image Ip is displayed over the entire display area of the display panel 8b to the intermediate display state by gradually reducing the size of the partial image Ip. The positional relationship and relative size of the partial image Ip displayed in the entire display area in the entire image Ia become clearer, and the relationship between the partial image Ip and the entire image Ia can be made easier for the user. It can be grasped.

  When an operation for instructing image recording is performed, moving image information having a visual effect that dynamically switches from the partial image Ip to the entire image Ia is generated, and the generated moving image information is associated with the partial image Ip. For example, the moving image information is transferred to an external device or a web (World Wide Web) server, and a moving image having the same visual effect is displayed on a web page established by the external device or the web server. Can improve usability.

Further, since the partial image Ip and the entire image Ia can be reproduced and deleted independently, these images, particularly the partial image Ip, can be handled in the same manner as a normal image.
Furthermore, since the moving image information M can be reproduced when the execution of a predetermined display operation is instructed in a state where the partial image Ip is displayed on the display panel 8b, the moving image information M of the moving image associated with the partial image Ip is displayed. Reproduction can be performed more easily, a moving image can be displayed from the state in which the partial image Ip is displayed, and can be dynamically switched to the entire image Ia, and the relationship between the partial image Ip and the entire image Ia can be displayed to the user. Gender can be grasped more easily.
In addition, when the deletion of the partial image Ip and the entire image Ia is instructed, the moving image information M can be deleted along with the deletion. Therefore, the deletion of the moving image information M is linked to the deletion of the partial image Ip and the entire image Ia. The image recorded in the recording unit 7 can be managed more easily.

The present invention is not limited to the above-described embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, in the above-described embodiment, the partial image Ip, the entire image Ia, and the moving image information M are recorded in association with each other, but this is an example, and the present invention is not limited to this. Any configuration may be used as long as the moving image information M is recorded in association with each other.

  Further, in the above-described embodiment, the moving image information having a visual effect that dynamically switches from the partial image Ip to the entire image Ia is illustrated as the predetermined related information. However, the information is not limited to this example. As long as a predetermined display operation for switching the partial image Ip to the entire image Ia is performed, it can be arbitrarily changed.

  Further, in the above embodiment, the partial image Ip is dynamically switched to the entire image Ia when the index C displayed on the display panel 8b is operated by the user. However, the operation of the index C is not necessarily required. That is, for example, when a predetermined time has elapsed for displaying the partial image Ip on the display panel 8b, it may be automatically switched to the entire image Ia.

In addition, in the present embodiment, the setting unit 5a, the recording control unit 6, and the display control unit 8a are driven under the control of the central control unit 1. However, the present invention is not limited to this. Alternatively, a predetermined program or the like may be executed by the CPU of the central control unit 1.
That is, a program including a setting processing routine, a recording control processing routine, a partial image display control processing routine, and a switching display control processing routine is recorded in a program memory (not shown). Then, a function of setting the cutout area A at a predetermined position within the imaging range of the imaging unit 3 may be realized by the CPU of the central control unit 1 by a setting processing routine. When an operation for instructing the CPU of the central control unit 1 to record an image is performed by the recording control processing routine, the partial image Ip corresponding to the cutout area A in the entire image Ia captured by the imaging unit 3 Alternatively, a function of recording at least predetermined related information related to the entire image Ia may be realized. Further, a function of acquiring the recorded partial image Ip and displaying it on the display panel 8b may be realized by the CPU of the central control unit 1 by the partial image display control processing routine. In addition, the CPU of the central control unit 1 acquires predetermined related information recorded in association with the partial image Ip by the switching display control processing routine, and the entire partial image Ip displayed on the display panel 8b is acquired. A function for performing a predetermined display operation for switching to the image Ia may be realized.

  Furthermore, as a computer-readable medium storing a program for executing each of the above processes, a non-volatile memory such as a flash memory or a portable recording medium such as a CD-ROM is applied in addition to a ROM or a hard disk. Is also possible. A carrier wave is also used as a medium for providing program data via a predetermined communication line.

Although several embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
Setting means for setting a cutout region at a predetermined position within the imaging range of the imaging means;
When an operation for instructing image recording is performed, a partial image corresponding to the cut-out area in the entire image captured by the imaging unit is associated with at least predetermined related information related to the entire image. Recording control means for recording;
A partial image display control means for acquiring the partial image recorded by the recording control means and displaying the partial image on a display means;
The recording control means acquires the predetermined related information recorded in association with the partial image, and performs a predetermined display operation for switching the partial image displayed on the display means to the whole image. Switching display control means,
An imaging apparatus comprising:
<Claim 2>
The predetermined related information includes moving image information having a visual effect that dynamically switches from the partial image to the entire image,
The partial image display control means further causes the display means to display an index instructing execution of the predetermined display operation in association with the partial image displayed on the display means.
When the index is operated by the user, the switching display control means starts from the first display state in which the partial image is displayed on the entire display area of the display means on the entire display area based on the moving image information. The imaging apparatus according to claim 1, wherein a moving image that is dynamically switched to a second display state in which the entire image is displayed is displayed as the predetermined display operation.
<Claim 3>
The switching display control means is further configured to hide a region other than the partial image in the entire image as a display state in the middle of dynamic switching from the first display state to the second display state. The displayed image is displayed on the display means, and the region to be non-displayed in the whole image is dynamically switched from the intermediate display state to the second display state so as to be gradually narrowed. Item 3. The imaging device according to Item 2.
<Claim 4>
The switching display control means further dynamically switches from the first display state to the intermediate display state by gradually reducing the size of the partial image. Imaging device.
<Claim 5>
When an operation for instructing recording of an image is performed, the apparatus further includes moving image generation means for generating moving image information having a visual effect that dynamically switches from the partial image to the entire image,
The imaging apparatus according to any one of claims 1 to 4, wherein the recording control unit records the moving image information generated by the moving image generation unit as the predetermined related information.
<Claim 6>
The recording control unit records the entire image in association with the partial image and the predetermined related information;
The partial image and the entire image can be reproduced independently,
The predetermined related information can be reproduced when the execution of the predetermined display operation is instructed in a state where the partial image is displayed on the display unit by the partial image display control unit. Item 6. The imaging device according to Item 5.
<Claim 7>
The partial image and the whole image can be deleted independently,
The imaging apparatus according to claim 5, wherein the predetermined related information can be deleted along with the deletion when an instruction to delete at least one of the partial image and the whole image is given.
<Claim 8>
An image display method using an imaging device,
A setting process for setting a cutout region at a predetermined position within the imaging range of the imaging means;
When an operation for instructing image recording is performed, a partial image corresponding to the cut-out area in the entire image captured by the imaging unit is associated with at least predetermined related information related to the entire image. Recording control processing to record,
A partial image display control process for acquiring the partial image recorded by the recording control process and displaying the partial image on a display unit;
The predetermined related information recorded in association with the partial image by the recording control process is acquired, and a predetermined display operation for switching the partial image displayed on the display means to the entire image is performed. Switching display control processing,
An image display method comprising:
<Claim 9>
The computer of the imaging device,
Setting means for setting a cutout region at a predetermined position within the imaging range of the imaging means;
When an operation for instructing image recording is performed, a partial image corresponding to the cut-out area in the entire image captured by the imaging unit is associated with at least predetermined related information related to the entire image. Recording control means for recording,
A partial image display control means for acquiring the partial image recorded by the recording control means and displaying the partial image on a display means;
The recording control means acquires the predetermined related information recorded in association with the partial image, and performs a predetermined display operation for switching the partial image displayed on the display means to the whole image. Switching display control means,
A program characterized by functioning as

DESCRIPTION OF SYMBOLS 100 Image pick-up device 1 Central control part 3 Image pick-up part 5 Image processing part 5a Setting part 6 Recording control part 6a Movie generation part 7 Recording part 8 Display part 8a Display control part 8b Display panel 9 Operation input part 9a Shutter button Ia Whole image Ip part Image M Movie information

Claims (9)

Setting means for setting a cutout region at a predetermined position within the imaging range of the imaging means;
When an operation for instructing image recording is performed, a partial image corresponding to the cut-out area in the entire image captured by the imaging unit is associated with at least predetermined related information related to the entire image. Recording control means for recording;
A partial image display control means for acquiring the partial image recorded by the recording control means and displaying the partial image on a display means;
The recording control means acquires the predetermined related information recorded in association with the partial image, and performs a predetermined display operation for switching the partial image displayed on the display means to the whole image. Switching display control means,
An imaging apparatus comprising: The predetermined related information includes moving image information having a visual effect that dynamically switches from the partial image to the entire image,
The partial image display control means further causes the display means to display an index instructing execution of the predetermined display operation in association with the partial image displayed on the display means.
When the index is operated by the user, the switching display control means starts from the first display state in which the partial image is displayed on the entire display area of the display means on the entire display area based on the moving image information. The imaging apparatus according to claim 1, wherein a moving image that is dynamically switched to a second display state in which the entire image is displayed is displayed as the predetermined display operation. The switching display control means is further configured to hide a region other than the partial image in the entire image as a display state in the middle of dynamic switching from the first display state to the second display state. The displayed image is displayed on the display means, and the region to be non-displayed in the whole image is dynamically switched from the intermediate display state to the second display state so as to be gradually narrowed. Item 3. The imaging device according to Item 2. The switching display control means further dynamically switches from the first display state to the intermediate display state by gradually reducing the size of the partial image. Imaging device. When an operation for instructing recording of an image is performed, the apparatus further includes moving image generation means for generating moving image information having a visual effect that dynamically switches from the partial image to the entire image,
The imaging apparatus according to any one of claims 1 to 4, wherein the recording control unit records the moving image information generated by the moving image generation unit as the predetermined related information. The recording control unit records the entire image in association with the partial image and the predetermined related information;
The partial image and the entire image can be reproduced independently,
The predetermined related information can be reproduced when the execution of the predetermined display operation is instructed in a state where the partial image is displayed on the display unit by the partial image display control unit. Item 6. The imaging device according to Item 5. The partial image and the whole image can be deleted independently,
The imaging apparatus according to claim 5, wherein the predetermined related information can be deleted along with the deletion when an instruction to delete at least one of the partial image and the whole image is given. An image display method using an imaging device,
A setting process for setting a cutout region at a predetermined position within the imaging range of the imaging means;
When an operation for instructing image recording is performed, a partial image corresponding to the cut-out area in the entire image captured by the imaging unit is associated with at least predetermined related information related to the entire image. Recording control processing to record,
A partial image display control process for acquiring the partial image recorded by the recording control process and displaying the partial image on a display unit;
The predetermined related information recorded in association with the partial image by the recording control process is acquired, and a predetermined display operation for switching the partial image displayed on the display means to the entire image is performed. Switching display control processing,
An image display method comprising: The computer of the imaging device,
Setting means for setting a cutout region at a predetermined position within the imaging range of the imaging means;
When an operation for instructing image recording is performed, a partial image corresponding to the cut-out area in the entire image captured by the imaging unit is associated with at least predetermined related information related to the entire image. Recording control means for recording,
A partial image display control means for acquiring the partial image recorded by the recording control means and displaying the partial image on a display means;
The recording control means acquires the predetermined related information recorded in association with the partial image, and performs a predetermined display operation for switching the partial image displayed on the display means to the whole image. Switching display control means,
A program characterized by functioning as

Images