JP2011097344A - Imaging device and imaging method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To acquire images where the same area is photographed even if a photographing area is changed during the time that self-timer is set on. <P>SOLUTION: A digital still camera has an image sensor, an extraction part which extracts an image area of a prespecified size from an image, an image display controller which displays the image in the extracted area, a position change detector (S14) which detects the position change of a body until the self-timer set time is over after a photographing instruction operation is received, and an extraction position determination part (S15) which determines a position to extract an area of the prespecified size from the image outputted from the image sensor until the self-timer set time is over after reception of the photographing instruction operation on the basis of the position within the area extracted by the extraction part and the detected position change upon reception of the photographing instruction operation. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging apparatus and an imaging method, and more particularly to an imaging apparatus having a self-timer imaging function and an imaging method executed by the imaging apparatus.

  Some imaging devices represented by digital still cameras have a self-timer imaging function. If the user sets the self-timer mode and then presses the shutter button after setting the imaging range, the self-timer setting time starts. Images can be taken after a lapse. During imaging in self-timer mode, the user often leaves the digital still camera, so when the digital still camera is placed in an unstable place, or when the wind is strong, etc., until the image is captured after the shutter button is pressed. During this time, the digital still camera may move.

  Japanese Patent Application Laid-Open No. 2009-33233 discloses an imaging unit that captures captured image data by capturing an image of a subject, a storage processing unit that performs a storage process of captured image data obtained by the imaging unit, and a self-timer imaging operation. When the self-timer imaging operation is performed by the operation means, the motion detection means, and the operation means, a shutter that saves the captured image data obtained by the imaging means after the self-timer set time has elapsed by the storage processing means There is described an image pickup apparatus comprising: a control unit that controls a processing operation based on detection information by the motion detection unit. The conventional image pickup apparatus can interrupt or cancel the shutter processing operation when the image pickup apparatus is moving when the self-timer set time has elapsed.

However, even if the image capturing apparatus does not move when the self-timer set time elapses, if the image capturing apparatus moves between when the user presses the shutter and the self-timer set time elapses, the shutter processing operation is performed. Runs without interruption or abortion. In this case, there is a problem that the captured image is an image obtained by imaging a subject in an imaging range different from the imaging range desired by the user. In particular, the subject may not be the center of the image, or a part of the subject may be out of the imaging range.
JP 2009-33233 A

  The present invention has been made to solve the above-described problems, and one of the objects of the present invention is to change the imaging range until the self-timer set time elapses after an operation instructing imaging is accepted. Even if it is a case, it is providing the imaging device which can acquire the image which imaged the same imaging range.

  Another object of the present invention is to obtain an image obtained by imaging the same imaging range even when the imaging range changes from when an operation instructing imaging is accepted until the self-timer set time elapses. It is to provide an imaging method.

  Still another object of the present invention is to acquire an image obtained by imaging the same imaging range even when the imaging range changes from when an operation instructing imaging is accepted until the self-timer set time elapses. Providing a simple imaging program.

  In order to achieve the above-described object, according to an aspect of the present invention, an imaging apparatus captures an image of a subject, acquires an image, and cuts out an image of a region having a predetermined size from the acquired image. Cutout means, display control means for displaying an image of the cutout area, operation accepting means for accepting an operation for instructing imaging by a user, and a self-timer set time elapses after the operation for instructing imaging is accepted An operation for instructing imaging based on the displacement detection means for detecting the displacement of the main body and the position in the region cut out by the cutting means when the operation for instructing imaging is received and the detected displacement Cut out to determine a position to cut out a region of a predetermined size from the image output by the imaging means when the self-timer set time has passed since the acceptance of Comprising a location determining means.

  According to this aspect, the displacement of the main body from when the operation instructing imaging is accepted until the self-timer set time elapses is detected, and in the area cut out from the image when the operation instructing imaging is accepted Based on this position and the detected displacement, a position to cut out the region from the image is determined when the self-timer set time has elapsed since the operation for instructing imaging was accepted. For this reason, even if the imaging range at the time when an operation for instructing imaging is accepted is different from the imaging range at the time when the self-timer set time has elapsed, the images to be cut out from the respective images have the same imaging range. It can be set as the imaged image. As a result, there is provided an imaging device capable of acquiring an image obtained by imaging the same imaging range even when the imaging range changes after the self-timer set time elapses after an operation instructing imaging is accepted. be able to.

  According to another aspect of the present invention, the imaging device captures an image of an object and acquires an image, and the image capturing unit photoelectrically converts an optical image of the object imaged on an imaging surface via a lens. Accordingly, a display control unit that includes a photoelectric conversion unit that outputs an image signal, a display control unit that displays an output image, an operation reception unit that receives an operation instructing imaging by a user, and an operation instructing imaging is received. Displacement detecting means for detecting the displacement of the main body until the self-timer set time elapses, and imaging range changing means for moving the position of the optical axis of the lens with respect to the photoelectric conversion means, and the imaging range changing means Based on the position of the optical axis of the lens with respect to the photoelectric conversion means and the detected displacement when the instruction operation is received, the self-task is performed after the operation for instructing imaging is received. Including a position determining means for determining a position of the optical axis of the lens relative to the photoelectric conversion means when Ma set time has elapsed.

  According to this aspect, the displacement of the main body until the self-timer set time elapses after the operation instructing imaging is received, and the position of the optical axis of the lens when the operation instructing imaging is received Based on the detected displacement, the position of the optical axis of the lens when the self-timer set time has elapsed after the operation for instructing imaging is received is determined. Therefore, an imaging apparatus is provided that can acquire an image obtained by capturing the same imaging range even when the imaging range changes from when an operation instructing imaging is accepted until the self-timer set time elapses. be able to.

  Preferably, the displacement detection unit extracts a feature region from the reference image acquisition unit that acquires, as a reference image, an image output from the imaging unit in response to an operation instructing imaging being received. Feature area extraction means; corresponding area extraction means for extracting a corresponding area corresponding to the feature area extracted from the image output by the imaging means when the self-timer set time has elapsed since the operation instructing imaging is accepted; The displacement is determined based on a vector from the feature area toward the corresponding area.

  Preferably, the displacement detection means includes a motion vector calculation means for calculating a motion vector based on a plurality of images output continuously by the imaging means, and the self-timer set time has elapsed since the operation for instructing imaging was accepted. Until then, based on all the motion vectors calculated by the shake detection means, the displacement of the main body after the operation for instructing imaging is received is calculated.

  Preferably, the camera further includes shake detection means for detecting shake of the main body, and the displacement detection means calculates the displacement of the main body after an operation for instructing imaging is received based on the detected shake.

  According to still another aspect of the present invention, the imaging method is an imaging method executed by the imaging device, and the imaging device includes an imaging unit that captures an image of a subject and acquires the image. A step of cutting out an image of an area of a predetermined size from the output image, a step of displaying an image of the cut out area, a step of accepting an operation instructing imaging by a user, and an operation of instructing imaging are accepted Detecting a displacement of the main body after an operation for instructing imaging is accepted, when the imaging mode is set in the self-timer imaging mode in which the imaging unit images after the self-timer set time has elapsed, and imaging Based on the position in the image of the region cut out in the cut-out step and the detected displacement when the operation for instructing is accepted , And determining a position for cutting out a region of a predetermined size from among the images captured means outputs when an operation to instruct the imaging has elapsed self-timer set time after accepted, the.

  According to this aspect, an imaging method capable of acquiring an image obtained by imaging the same imaging range even when the imaging range changes from when an operation instructing imaging is accepted until the self-timer set time elapses Can be provided.

  According to still another aspect of the present invention, the imaging program is an imaging method executed by the imaging device, the imaging device images an object, acquires an image, and the imaging unit includes a lens. Including a photoelectric conversion means for outputting an image by photoelectrically converting an optical image of a subject imaged on an image formation surface via, and a means for moving the position of the optical axis of the lens with respect to the photoelectric conversion means. A step of displaying an image output by the imaging means, a step of accepting an operation instructing imaging by a user, and a self-timer that causes the imaging means to image after a self-timer set time has elapsed since the operation instructing imaging was accepted When the imaging mode is set as the imaging mode, a step of detecting the displacement of the main body after an operation for instructing imaging is received and instructing the imaging Based on the position of the optical axis of the lens with respect to the photoelectric conversion means when the operation is accepted and the detected displacement, the photoelectric conversion means when the self-timer set time has elapsed since the operation instructing the imaging is accepted Determining the position of the optical axis of the lens.

  According to this aspect, an imaging method capable of acquiring an image obtained by imaging the same imaging range even when the imaging range changes from when an operation instructing imaging is accepted until the self-timer set time elapses Can be provided.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  In this embodiment, a digital still camera will be described as an example of an imaging device. The imaging device is not limited to a digital still camera, and may be, for example, a video camera or a mobile phone as long as the device has a self-timer imaging function.

  FIG. 1 is a block diagram showing a schematic configuration of a digital still camera according to one embodiment of the present invention. Referring to FIG. 1, a digital still camera 1 includes a control unit 11 that controls the entire digital still camera 1, a lens group 13 that includes a plurality of lenses including a focus lens and a zoom lens, and a lens group 13. A lens driving unit 15 to be driven, an image sensor 19, a liquid crystal display (LCD 23) 23, a codec (CODEC) 21, a signal processing circuit 22 for image processing, a program to be executed by the control unit 11, and the like are stored. An EEPROM (Electrically Erasable and Programmable Read Only Memory) 25, an SDRAM (Synchronous Dynamic Random Access Memory) 27 used as a work area of the control unit 11, and a memory card 29 It includes a card interface (I / F) 29 which is mounted, an operation unit 35 that accepts a user's operation, the battery 41 supplies power to the entire digital still camera 1, a.

  The lens group 13 is provided on the front surface of the digital still camera 1 main body, and the LCD 23 is provided on the back surface of the digital still camera 1 opposite to the surface on which the lens group 13 is provided. The lens group 13 is controlled by the lens driving unit 15. The lens group 13 is housed inside the main body when the digital still camera 1 is not driven. The lens driving unit 15 causes the lens group 13 to protrude outside the main body in the initialization process at the time of activation. Further, the lens group 13 has a zoom mechanism for adjusting the zoom lens, and the lens driving unit 15 adjusts the zoom lens of the lens group 13 in order to determine the zoom amount of the lens group 13 in the initialization process at startup. Place it at the reference position.

  The image sensor 19 is a photoelectric conversion element such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and its imaging plane is perpendicular to the optical axis of the lens group 13. The image sensor 19 photoelectrically converts an optical image of a subject formed on the imaging surface via the lens group 13 and outputs image data to the control unit 11. The control unit 11 receives image data output from the image sensor 19 and stores the image data in the SDRAM 27. The image data here is, for example, bitmap format data in which one pixel is composed of R (red), G (green), and B (blue). The image sensor 19 is not limited to a CMOS image sensor, and a CCD (Charge Coupled Device) image sensor may be used. In this case, since the CCD image sensor outputs an analog signal, the analog signal output from the CCD image sensor may be converted into digital image data by an analog / digital converter. Here, digital image data output from a CMOS image sensor as a photoelectric conversion element and analog signals output from a CCD image sensor are collectively referred to as an image signal.

  The image sensor 19 is controlled by the control unit 11 to control the time for photoelectric conversion. Specifically, when the control unit 11 causes the image sensor 19 to start photoelectric conversion, the control unit 11 opens a shutter provided between the lens group 13 and the image sensor 19. Thereby, the image sensor 19 starts photoelectric conversion. When the time for photoelectric conversion has elapsed, the control unit 11 closes the shutter and causes the image sensor 19 to output image data.

  When capturing a moving image, the image sensor 19 outputs one frame of image data at a predetermined time interval. A frame is a unit constituting a moving image, and one frame means one image. The frame can be replaced with a field. The predetermined time interval is 1/5 second when the frame rate is 5 FPS. Here, the moving image is referred to as a through image.

  The signal processing circuit 22 reads the image data stored in the SDRAM 27, performs various signal processing on the image data, and converts the image data into a color system YUV format represented by a luminance signal and a color difference signal. The signal processing circuit 22 stores YUV format image data in the SDRAM 27.

  The control unit 11 generates an RGB signal from the YUV format image data stored in the SDRAM 27 and outputs the RGB signal to the LCD 23. As a result, an image output from the image sensor 19 by imaging the subject is displayed on the LCD 23. Instead of the LCD 23, an organic EL (ElectroLuminescence) display may be used.

  The codec 21 is controlled by the control unit 11, reads YUV format image data stored in the SDRAM 27, compresses and encodes the encoded data, and stores the encoded data in the SDRAM 27. Here, the image data is compressed and encoded by the JPEG method. Further, when storing a moving image, the codec 21 compresses and encodes a plurality of frames by an MPEG (Moving Picture Experts Group) compression method. In this case, encoded data that has been compression-encoded in units of GOP (Group of Pictures) is stored in the SDRAM 21. Note that the compression method of image data of still images or moving images is not limited to these, and other compression methods may be used.

  The card I / F 29 is loaded with a memory card 29A having a nonvolatile memory. The control unit 11 can access the memory card 29A via the card I / F 29, and stores the encoded data stored in the SDRAM 27 in the memory card 29A.

  The operation unit 35 includes a plurality of keys including a shutter button 35A for receiving an instruction to start imaging, and receives a user operation. The operation unit 35 includes a mode setting key to which an instruction for setting the digital still camera 1 to the self-timer mode is assigned in advance. The operation unit 35 may include a touch panel superimposed on the LCD 23.

  The battery 41 is a primary battery or a secondary battery, and supplies power to the entire digital still camera 1. The control unit 11 detects the output voltage V1 of the battery 41 and calculates the remaining capacity of the battery 41. The battery 41 may be detachable from the digital still camera 1 main body.

  The control unit 11 implements a self-timer imaging function by executing an imaging program stored in the EEPROM 25. The digital still camera 1 in the present embodiment switches the imaging mode between the normal mode and the self-timer imaging mode. The control unit 11 implements a self-timer imaging function when the imaging mode is switched to the self-timer imaging mode. Here, the self-timer imaging function is a function of imaging after a preset self-timer set time has elapsed since the operation of pressing the shutter button 35A by the user was detected. Specifically, when the mode setting key is pressed by the user, the control unit 11 switches the imaging mode to the self-timer imaging mode. When the image capturing mode is the self-timer image capturing mode, when the shutter button 35A is pressed by the user, the control unit 11 captures an image after the self-timer set time has elapsed from that time. When imaging, the control unit 11 opens the shutter of the lens group 13 for a time corresponding to a preset shutter speed, and acquires image data output by the image sensor 19 after the shutter is closed. While the shutter is open, the image sensor 19 performs photoelectric conversion.

  An example in which the imaging program is stored in the EEPROM 25 will be described. However, the imaging program is not limited to the EEPROM 25, and the imaging program stored in the memory card 29A may be executed. Further, the recording medium for storing the imaging program is not limited to the memory card 29A, but a magnetic tape, a flexible disk, an optical disc (CD-ROM (Compact Disc-Read Only Memory) / MO (Magnetic Optical Disc / MD (Mini Disc)). / DVD (Digital Versatile Disc)), IC card (including memory card), optical card, mask ROM, EPROM (Erasable Programmable ROM), and the like.

  FIG. 2 is a functional block diagram illustrating an example of functions that the control unit has. The functions shown in FIG. 2 are realized in the control unit 11 when the control unit 11 executes the imaging program. Instead of the control unit 11, the function shown in FIG. 2 may be realized by a circuit.

  Referring to FIG. 2, the control unit 11 includes an operation receiving unit 51 that receives an operation by a user, an imaging control unit 53 that controls the lens driving unit 15 and the image sensor 19, and a displacement detection unit 57 that detects the displacement of the main body. A cutout unit 55 that cuts out an image having a predetermined size from the image, a cutout position determination unit 59 that determines the position of the region cut out from the image, and an image display control unit 61 that controls the LCD 23. And including.

  The operation reception unit 51 displays a self-timer setting screen including an area for inputting the self-timer setting time on the LCD 23. When the user inputs the self-timer setting time to the operation unit 35, the operation receiving unit 51 is input from the operation unit 35. The self-timer set time is accepted and stored in the EEPROM 25. Note that the default value of the self-timer setting time is stored in the EEPROM 25, and the operation reception unit 51 updates the default value with the self-timer setting time input by the user. The operation accepting unit 51 switches the imaging mode to the self-timer imaging mode when the mode setting key of the operation unit 35 is pressed by the user. Here, when the imaging mode is switched to the self-cannabis imaging mode, the operation reception unit 51 outputs a signal indicating that the imaging mode is the self-timer imaging mode to the imaging control unit 53 and the displacement detection unit 57. Further, when the user half-presses the shutter button 35A of the operation unit 35, the operation reception unit 51 outputs a focus instruction to the imaging control unit 53, and when the user fully presses the shutter button 35A, instructs the user to perform imaging. The operation is accepted, and an imaging instruction is output to the imaging control unit 53 and the displacement detection unit 57.

  When the shutter button 35A included in the operation unit 35 is half-pressed, the imaging control unit 53 causes the image sensor 19 to output image data at a predetermined time interval, so that the contrast of the acquired image data is increased. The drive unit 15 is controlled to adjust the focus lens of the lens group 13 so as to adjust the focus by a so-called autofocus function. Note that the method of the autofocus function is not limited to this, and other methods may be used.

  The imaging control unit 53 outputs image data to the image sensor 19 at predetermined time intervals before the user fully presses the shutter button 35A, in other words, before the imaging instruction is input from the operation receiving unit 51. The image data output by the image sensor 19 is output to the cutout unit 55 and the displacement detection unit 57. An image of the image data output by the image sensor 19 at a predetermined time interval before the imaging instruction is input from the operation receiving unit 51 is referred to as a through image.

  The cutout unit 55 cuts out an image of a cutout area having a predetermined size from the image data image input from the imaging control unit 53. The size of the cutout area is smaller than the image size of the image data input from the imaging control unit 53. Further, the shape of the cutout region is preferably similar to the image of the image data. When cutting out an image from a through image, the cutout unit 55 arranges a cutout region at the center of the through image, and cuts out the image of the cutout region. The cutout unit 55 outputs the image of the cutout region cut out from the through image to the image display control unit 61.

  The image display control unit 61 displays the image of the cutout area input from the cutout unit 55 on the LCD 23. Since the image display control unit 61 displays the image of the cut-out area cut out from the through image by the cut-out unit 55 on the LCD 23, the user can determine the imaging range. The user then presses the shutter button 35A after fixing the digital still camera 1, adjusting the zoom amount of the lens group 13, and displaying an image in a desired imaging range on the LCD 23. .

  When an imaging instruction is input from the operation receiving unit 51, the imaging control unit 53 controls the lens driving unit 15 and the image sensor 19 to perform photoelectric conversion for an imaging time corresponding to a shutter speed predetermined for the image sensor 19. (Exposure), and image data output by the image sensor 19 is acquired. Specifically, when an imaging instruction is input from the operation receiving unit 51, the imaging control unit 53 fixes the focus lens and sets the shutter speed to a preset shutter speed if the imaging mode is set to the normal mode. During the corresponding imaging time, the photoelectric conversion by the image sensor 19 is started by opening the shutter included in the lens group 13. Then, the imaging control unit 53 closes the shutter when the imaging time has elapsed, acquires the image data output by the image sensor 19, and outputs the acquired image data (captured image) to the cutout unit 55 and the displacement detection unit 57. To do.

  On the other hand, if the imaging mode is set to the self-timer imaging mode, the imaging control unit 53 fixes the focus lens when an imaging instruction is input from the operation receiving unit 51, and the EEPROM 25 after the imaging instruction is input. Until the self-timer set time stored in elapses. Then, when the self-timer set time has elapsed, the imaging control unit 53 starts photoelectric conversion by the image sensor 19 by opening the shutter included in the lens group 13 during the imaging time corresponding to the preset shutter speed. Let Then, the imaging control unit 53 closes the shutter when the imaging time has elapsed, acquires the image data output by the image sensor 19, and outputs the acquired image data (captured image) to the cutout unit 55 and the displacement detection unit 57. To do.

  If the imaging mode is set to the self-timer imaging mode, the displacement detection unit 57 receives the image of the image data (reference image) input from the imaging control unit 53 when the imaging instruction is input, and the imaging instruction The displacement of the main body is detected from the image (reference image) of the image data input from the imaging control unit 53 when the self-timer set time has elapsed since the input, and the detected displacement of the main body is determined as the cut-out position determining unit. 59.

  FIG. 3 is a block diagram illustrating an example of detailed functions of the displacement detection unit. Referring to FIG. 3, displacement detection unit 57 includes a standard image acquisition unit 81, a feature region extraction unit 83, a reference image acquisition unit 85, a corresponding region extraction unit 87, and a vector calculation unit 89.

  The reference image acquisition unit 81 acquires the image data input from the imaging control unit 53 as a reference image when the imaging instruction is input from the operation reception unit 51, and outputs the reference image to the feature region extraction unit 83. The feature region extraction unit 83 extracts a feature region from the reference image. Here, since the subject is a person, the feature area is an area including an image of a person's face. The feature area may be varied depending on the subject. Since the technique for extracting an area including an image of a human face from an image is well known, detailed description thereof will not be repeated here, but, for example, characteristic areas such as an area including pixels of human skin color, eyes, and mouth It can be extracted from the arrangement of pixels of various colors. The feature region extraction unit 83 outputs the position of the extracted feature region in the reference image to the vector calculation unit 89, and outputs the feature region image to the corresponding region extraction unit 87. When extracting a plurality of feature areas, the feature area extraction unit 83 outputs the positions in the reference image of each of the plurality of feature areas to the vector calculation unit 89, and converts the images of the plurality of feature areas into the corresponding region extraction unit 87. Output to. Here, the position of the feature region in the reference image is the coordinate of the center of gravity of the feature region.

  The reference image acquisition unit 85 acquires, as a reference image, image data (captured image) input from the imaging control unit 53 when the self-timer set time has elapsed after the imaging instruction is input from the operation receiving unit 51. The reference image is output to the corresponding area extraction unit 87. The corresponding area extracting unit 87 extracts a corresponding area corresponding to the feature area input from the feature area extracting unit 83 from the reference image. The corresponding area is a part of the reference image and includes an image similar to the image of the feature area. For example, the corresponding area extraction unit 87 scans the reference image with the image of the characteristic area, and sets the area in the reference image that minimizes the difference as the corresponding area.

  The corresponding area extraction unit 87 outputs the position of the extracted corresponding area in the reference image to the vector calculation unit 89. Here, the position of the corresponding area in the reference image is the coordinate of the center of gravity of the corresponding area. When images of a plurality of feature regions are input from the feature region extraction unit 83, corresponding regions corresponding to the plurality of feature regions are extracted, and the positions of the extracted corresponding regions in the reference image are expressed as vectors. It outputs to the calculation part 89. At this time, the position of the corresponding region and information for identifying the corresponding feature region are determined so that the vector calculation unit 89 can determine which of the plurality of feature regions corresponds to the corresponding region. The set is output to the vector calculation unit 89.

  The vector calculation unit 89 receives the position of the feature region from the feature region extraction unit 83 and the position of the corresponding region from the corresponding region extraction unit 87. The vector calculation unit 89 calculates a vector from the feature region position to the corresponding region position, and outputs the calculated vector to the cut-out position determination unit 59 as a body displacement vector indicating the body displacement. The body displacement vector calculated by the vector calculation unit 89 indicates the movement of the face area in the image. The movement of the face area in the image is due to the movement of the main body of the digital still camera 1 relative to the subject, so it can be said that the displacement of the main body appears in the image.

  When the positions of a plurality of feature regions are input from the feature region extraction unit 83, any one of the positions of the plurality of corresponding regions input from the corresponding region extraction unit 87 and the position of the feature region corresponding thereto Calculate the vector. This is because it is sufficient to calculate one vector as a main body displacement vector for the position of one set of feature areas and the position of corresponding areas.

  Returning to FIG. 2, the cut-out position determination unit 59 sets a new cut-out position after the cut-out area is translated from the center of the image in parallel with the main body displacement vector input from the displacement detection unit 57. Decide on an area. Then, the determined position of the cutout region is output to the cutout unit 55.

  Image data is input to the clipping unit 55 from the imaging control unit 53. Image data that is input when the self-timer set time has elapsed since the user pressed the shutter button 35A is referred to as a captured image. The cutout unit 55 arranges a cutout region at a position input from the cutout position determination unit 59 from the picked-up image input from the image pickup control unit 53, and cuts out an image of the cutout region in the picked-up image. The cutout unit 55 outputs the cutout image of the cutout region to the image display control unit 61.

  The image display control unit 61 displays the image of the cutout area input from the cutout unit 55 on the LCD 23. Since the image display control unit 61 displays the image of the cutout region cut out from the captured image by the cutout unit 55 on the LCD 23, the user can check the imaging range of the captured image. When the user wishes to save the image displayed on the LCD 23, the user may press the key that the operation unit 35 has and has been assigned with an operation instructing the saving in advance. When an operation for instructing saving is input, the control unit 11 stores an image of the cutout area displayed on the LCD 23 in the EEPROM 25.

  FIG. 4 is a diagram illustrating an example of a through image and a cutout region output from the image sensor. FIG. 5 is a diagram illustrating an example of a captured image output from the image sensor and a cutout region. FIG. 6 is a diagram for explaining the main body displacement. With reference to FIG. 4, the through image 101 includes feature regions 105 and 106 obtained by imaging a human face. The center of gravity of the feature region 105 is indicated by a point 105A. The cutout area 103 is located at the center of the through image 101. In FIG. 4, the cut-out area 103 is indicated by a solid line for the sake of explanation, but there is no solid line indicating the cut-out area 103 in the through image 101. The cutout area 103 is smaller in size than the through image 101. An image of the cutout area 103 in the through image 101 is displayed on the LCD 23.

  FIG. 5 is a diagram illustrating an example of a captured image output from the image sensor and a cutout region. Referring to FIG. 5, the captured image 111 includes corresponding regions 115 and 116 in which a human face is captured. The corresponding area 115 is an area corresponding to the feature area 105 shown in FIG. 4 and the center of gravity is indicated by a point 105B. Here, referring to FIG. 6, a vector 117 directed from the center of gravity 105 </ b> A of the feature region 105 to the center of gravity 105 </ b> B of the corresponding region 115 indicates the displacement of the main body.

  4 and 5, the position of the cutout region 103 in the through image 101 is the center of the through image 101, but the position of the cutout region 113 in the captured image 111 is 117 from the center to the vector. It is the position which moved parallel to. In the present embodiment, the through image and the captured image are images having the same resolution. However, if the resolutions are different, the resolution of the other may be adjusted to one of the resolutions.

  FIG. 7 is a flowchart illustrating an example of a process flow of the self-timer imaging control according to the first embodiment. The self-timer imaging control process is a process executed by the control unit 11 when the control unit 11 executes an imaging program stored in the EEPROM 25. Referring to FIG. 7, control unit 11 determines whether or not the imaging mode is set to the self-timer imaging mode (step S01). The process waits until the imaging mode is set to the self-timer imaging mode. If the imaging mode is set to the self-timer imaging mode, the process proceeds to step S02. In other words, the self-timer imaging control process is a process executed on condition that the imaging mode is set to the self-timer imaging mode.

  In step S02, the image data output from the image sensor 19 is acquired as a through image. Then, a cutout area is extracted from the acquired through image (step S03), and the cutout area image is displayed on the LCD 23 (step S04). The size of the cutout area is a predetermined size, and the position of the cutout area is the center in the through image. In other words, the center of the cutout area and the center of the through image overlap.

  In step S05, it is determined whether shutter button 35A has been pressed. If shutter button 35A is pressed, the process proceeds to step S06. If not, the process returns to step S02. The image of the cut-out area cut out from the through image is displayed on the LCD 23 until the shutter button 35A is pressed. For this reason, the user can determine the imaging range by looking at the image displayed on the LCD 23.

  In step S06, the last acquired through image is set as a reference image. Specifically, the frame of the through image acquired last in step S02 is stored in the SDRAM 27 as a reference image. In the next step S07, the cutting position is set as the reference position. The cut-out position is a position in the through image of the cut-out area cut out from the through image in step S03, and here, the reference position is the center of the through image.

  In the next step S08, it is determined whether or not the self-timer set time has elapsed. In step S05, the operation waits until the time elapsed since the operation of pressing the shutter button is detected becomes equal to the self-timer set time. If the elapsed time is equal to the self-timer set time, the process proceeds to step S09. In step S09, an image is taken. Specifically, after the shutter of the lens group 13 is closed and the image sensor 19 is initialized, the shutter of the lens group 13 is opened for a time corresponding to the shutter speed set in the imaging condition, and the image sensor 19 is subjected to photoelectric conversion. Let Thereafter, the image data output by the image sensor 19 is acquired as a captured image (step S10).

  In the next step S11, the captured image is set as a reference image. Then, a feature region is extracted from the reference image (step S12). Here, the feature region is a region in which a human face is represented. In the next step S13, a corresponding area corresponding to the feature area is extracted from the reference image. The corresponding area is an area including an image similar to the image of the feature area in the reference image. Then, a main body displacement vector is calculated (step S14). The main body displacement vector is a vector from the position of the feature region in the standard image toward the position of the corresponding region in the reference image.

  In the next step S15, a cutting position is determined from the reference position set in step S07 and the main body displacement vector detected in step S14. The end point of the main body displacement vector when the reference position is set as the start point of the main body displacement vector is determined as the cutout position. In the next step S16, an image of the cut-out area arranged at the cut-out position determined in step S15 is cut out from the captured image acquired in step S10. In step S <b> 17, the image of the cut out area is displayed on the LCD 23.

  In step S18, it is determined whether an operation for instructing storage by the user has been accepted. If an operation for instructing storage is accepted, the process proceeds to step S19; otherwise, the process proceeds to step S20. In step S19, the image of the cut area cut out in step S16 is stored in the EEPROM 25, and the process proceeds to step S20. In step S20, it is determined whether an operation for instructing termination by the user has been accepted. If an operation for instructing termination is accepted, the process is terminated; otherwise, the process returns to step S18.

  As described above, the digital still camera 1 according to the first embodiment detects the displacement of the main body until the self-timer set time elapses after the operation for instructing imaging is accepted, and the operation for instructing imaging. Based on the position in the region cut out from the reference image when received and the detected displacement, the region from the captured image when the self-timer set time has elapsed since the operation for instructing imaging was received The position to cut out is determined. For this reason, even if the imaging range at the time when an operation for instructing imaging is accepted is different from the imaging range at the time when the self-timer set time has elapsed, the images to be cut out from the respective images have the same imaging range. It can be set as the imaged image.

  In addition, the displacement detection unit 57 acquires an image output from the image sensor 19 as a reference image in response to an operation for instructing imaging, extracts a feature region from the reference image, and performs an operation for instructing imaging. A corresponding area corresponding to the feature area extracted from the image output by the imaging means when the self-timer set time has elapsed since the acceptance is extracted, and the displacement is determined based on a vector from the feature area toward the corresponding area. For this reason, since the change amount of the imaging range is detected using the image output from the image sensor 19, the displacement can be detected with a simple configuration.

<Second Embodiment>
The digital camera 1 according to the second embodiment is obtained by changing the displacement detector 57 according to the first embodiment to a displacement detector 57A. Since other configurations are the same as those of the digital camera 1 in the first embodiment described above, the description will not be repeated here, and different portions will be mainly described.

  FIG. 8 is a diagram illustrating an example of a detailed function of the displacement detection unit according to the second embodiment. Referring to FIG. 8, displacement detection unit 57 </ b> A includes a motion vector calculation unit 91 and a movement vector calculation unit 93. The motion vector calculation unit 91 calculates a motion vector from a plurality of image data output by the image sensor 19 at predetermined time intervals. The motion vector calculation unit 91 outputs the calculated motion vector to the movement vector calculation unit 93. Since a method for calculating a motion vector from two consecutive images is well known, description thereof will not be repeated here. The motion vector calculated by the motion vector calculation unit 91 is a motion vector indicating the motion of the entire image. Accordingly, only the subject may move in the imaging range, but the motion vector detected by the subject moving is excluded. Specifically, the motion vector calculation unit 91 calculates a motion vector in a plurality of regions in the image, and outputs the motion vector having the largest number of approximate motion vectors to the movement vector calculation unit 93. The movement vector calculation unit 93 calculates a movement vector by integrating the input motion vectors. The movement vector calculation unit 93 outputs the calculated movement vector to the cutout position determination unit 59 as the displacement of the main body.

  FIG. 9 is a flowchart illustrating an example of a process flow of the self-timer imaging control according to the second embodiment. 7 is different from the flowchart shown in FIG. 7 in that steps S11 to S14 are deleted, steps S21 to S23 are added between steps S07 and S08, and step S15 is changed. This is the point that became step S15A. Referring to FIG. 9, the processing from step S21 to step S23 is executed after the operation of pressing the shutter button is detected in step S05 until it is determined in step S08 that the self-timer set time has elapsed. Is done. In step S21, the image data output from the image sensor 19 is acquired as a through image. Then, a motion vector is calculated from the acquired through image. The through image acquired in step S21, and in step S02 or when step S21 is executed in the previous loop, the through image acquired in step S21 and acquired in step S21 executed in the current loop. A motion vector is calculated from the obtained through image. In the next step S23, the movement vector is calculated by integrating the motion vectors calculated in step S22. The processes in steps S21 to S23 are repeatedly executed every time a through image frame is acquired from the time when the operation of pressing the shutter button 35A is detected until the self-timer set time elapses. Therefore, the calculated movement vector is the amount of movement of the optical image formed on the image plane of the image sensor 19 between the detection of the operation of pressing the shutter button 35A and the elapse of the self-timer setting time. Indicates the direction of movement.

  In step S15A, the cutting position is determined from the reference position set in step S07 and the movement vector calculated in step S23. Specifically, the end point of the movement vector when the start point of the movement vector is used as the reference position is determined as the cutout position.

  The displacement detector 57 in the first embodiment described above detects the displacement of the main body by comparing the two images and calculating the main body displacement vector indicating the moving amount and moving direction of the feature region in the image. On the other hand, the displacement detector 57A in the second embodiment detects the displacement of the main body by integrating the motion vectors extracted from a plurality of frames included in the through image. For this reason, an existing program can be used.

<Third Embodiment>
A digital still camera 1A according to the third embodiment is obtained by adding a gyro sensor to the digital still camera 1 according to the first embodiment.

  FIG. 10 is a block diagram illustrating a schematic configuration of a digital still camera according to the third embodiment. Referring to FIG. 10, the difference from the block diagram shown in FIG. 1 is that a gyro sensor 33 is added. Since other configurations are the same as those of the digital still camera 1 in the first embodiment shown in FIG. 1, the description thereof will not be repeated here.

  The gyro sensor 33 detects an angular velocity when the main body of the digital still camera 1A rotates. Here, assuming that the horizontal direction is the X axis, the vertical direction is the Y axis, and the optical axis of the lens is the Z axis, the gyro sensor 33 is centered on the angular velocity in the rotational direction (yaw direction) centered on the Y axis and the X axis. Are detected, and the angular velocities in the yaw direction and the pitch direction are output to the control unit 11.

  The control unit 11 included in the digital still camera 1 </ b> A according to the third embodiment has the same functions except for the block diagram and the displacement detection unit 57 shown in FIG. 2. The displacement detector 57 in the third embodiment receives the output of the gyro sensor 33, calculates the amount of movement of the main body in the X-axis direction from the angular velocity in the yaw direction input from the gyro sensor 33, and the angular velocity in the pitch direction. To calculate the amount of movement of the main body in the Y-axis direction. The displacement detection unit 57 integrates the movement amount of the main body in the X-axis direction and the movement amount of the main body in the Y-axis direction, and the main body displacement vector having the integrated value of the X-direction shake amount and the integrated value of the X-direction shake amount as elements. Is calculated. Further, the displacement detection unit 57 converts the main body displacement vector into a movement vector by converting the shake amount of the main body into the movement amount of the optical image formed on the imaging surface of the image sensor 19. The displacement detector 57 uses a predetermined coefficient for the zoom amount of the lens group 13 when converting the main body displacement vector into a movement vector.

  Note that the displacement detection unit 57 in the third embodiment does not need to receive image data (through image) from the imaging control unit 53.

  FIG. 11 is a flowchart illustrating an example of a process flow of the self-timer imaging control according to the third embodiment. 7 differs from the flowchart shown in FIG. 7 in that Steps S11 to S14 are deleted, Steps S31 and S32 are added between Steps S07 and S08, and Step S15 is changed. This is the point that became step S15B. Referring to FIG. 11, the processes in steps S31 and S32 are performed after the operation of pressing the shutter button by the user is detected in step S05 until it is determined in step S08 that the self-timer set time has elapsed. Executed. In step S31, the shake amount of the main body is acquired from the gyro sensor 33. The shake amount of the main body in the X-axis direction is calculated from the angular velocity in the yaw direction input from the gyro sensor 33, and the shake amount of the main body in the Y-axis direction is calculated from the angular velocity in the pitch direction. In the next step S32, the main body displacement vector is calculated by integrating the main body shake amounts in the X-axis direction and the Y-direction, and the main body displacement vector is converted into a movement vector.

  The processes in step S31 and step S32 are repeatedly executed until the self-timer set time elapses after the operation of pressing the shutter button 35A is detected. Therefore, the calculated movement vector is the amount of movement of the optical image formed on the image plane of the image sensor 19 between the detection of the operation of pressing the shutter button 35A and the elapse of the self-timer set time. Indicates the direction of movement.

  In step S15B, the cutting position is determined from the reference position set in step S07 and the movement vector calculated in step S32. Specifically, the end point of the movement vector when the start point of the movement vector is used as the reference position is determined as the cutout position.

  Since the digital still camera 1A according to the third embodiment calculates the displacement of the main body after an operation instructing imaging is accepted based on the shake detected by the gyro sensor 33 that detects the shake of the main body. Can be accurately detected.

<Fourth embodiment>
A digital still camera 1C according to the fourth embodiment is obtained by adding a camera shake correction unit to the digital still camera according to the first embodiment. Hereinafter, a difference between the digital still camera 1 </ b> C in the fourth embodiment and the digital still camera 1 in the first embodiment will be described.

  FIG. 12 is a block diagram illustrating a schematic configuration of a digital still camera according to the fourth embodiment. Referring to FIG. 12, the difference from the block diagram shown in FIG. 1 is that control unit 11 is changed to control unit 11A, and camera shake correction unit 17 is added. Since other configurations are the same as those of the digital still camera 1 in the first embodiment shown in FIG. 1, the description thereof will not be repeated here.

  The camera shake correction unit 17 moves the image sensor 19 and moves the position of the optical axis of the lens group 13 of the image sensor 19. For this reason, the camera shake correction unit 17 includes driving units corresponding to the two directions in order to move the image sensor 19 in two directions that are parallel to the image forming plane of the image sensor 19 and intersect each other. Here, the two directions are a horizontal direction (X-axis direction) and a vertical direction (Y-axis direction) that intersect at right angles to each other. The imaging surface of the image sensor 19 is a surface perpendicular to the optical axis of the lens group 13. Since the image sensor 19 is moved in two directions that are parallel to and intersect with each other by the camera shake correction unit 17, the image formation surface of the image sensor 19 is maintained in a state perpendicular to the optical axis of the lens group 13. Is done.

  The camera shake correction unit 17 moves the image sensor 19 to the initial position before the shutter button 35A included in the operation unit 35 is fully pressed. The initial position of the image sensor 19 is the center of the range in which the image sensor 19 can move in each of two vertical and horizontal directions. When the image sensor 19 is located at the initial position, the optical axis of the lens group 13 is the center of the image sensor 19. The initial position can be arbitrarily determined.

  When the shutter button 35A included in the operation unit 35 is fully pressed, the camera shake correction unit 17 forms an optical image formed on the image sensor 19 at the same position even when the main body of the digital still camera 1 moves. Then, the image sensor 19 is moved. In other words, an optical image formed on the imaging surface of the image sensor 19 while the image sensor 19 performs photoelectric conversion is connected when the shutter button 35A is fully pressed and the image sensor 19 starts photoelectric conversion. The image sensor 19 is moved so as to be the same as the optical image formed on the image plane. Specifically, based on the angular velocities in the yaw direction and the pitch direction detected by the gyro sensor 33, the direction parallel to the image plane of the image sensor 19 and the correction amount are determined, and the image sensor 19 is moved. The camera shake correction unit 17 outputs correction amounts in the horizontal direction (X-axis direction) and the vertical direction (Y-axis direction) to the control unit 11.

  Further, the camera shake correction unit 17 may move the lens group 13 instead of or in addition to moving the image sensor 19, or the optical path between the lens group 13 and the image sensor 19. You may make it move the mirror provided in this.

  FIG. 13 is a diagram illustrating an example of functions of a control unit included in the digital still camera according to the fourth embodiment. Referring to FIG. 13, the same functions as those in the block diagram shown in FIG. The control unit 11A included in the digital still camera 1C according to the fourth embodiment includes an operation reception unit 51, an imaging control unit 53, a displacement detection unit 57A, an image display control unit 61, and a position determination unit 71. Including.

  The imaging control unit 53 causes the image sensor 19 to output image data at a predetermined time interval before the imaging instruction is input from the operation receiving unit 51, and the image data (through image) output by the image sensor 19 is output. The image is output to the image display control unit 61.

  When an imaging instruction is input from the operation receiving unit 51, the imaging control unit 53 controls the lens driving unit 15 and the image sensor 19 to perform photoelectric conversion for an imaging time corresponding to a shutter speed predetermined for the image sensor 19. (Exposure), and image data output by the image sensor 19 is acquired. Then, the imaging control unit 53 closes the shutter when the imaging time has elapsed, acquires the image data output by the image sensor 19, and sends the acquired image data (captured image) to the image display control unit 61 and the displacement detection unit 57. Output.

  On the other hand, if the imaging mode is set to the self-timer imaging mode, the imaging control unit 53 fixes the focus lens when an imaging instruction is input from the operation receiving unit 51, and the EEPROM 25 after the imaging instruction is input. Until the self-timer set time stored in elapses. During this time, the through image is output to the image display control unit 61. Then, when the self-timer set time has elapsed, the imaging control unit 53 starts photoelectric conversion by the image sensor 19 by opening the shutter included in the lens group 13 during the imaging time corresponding to the preset shutter speed. Let Then, the imaging control unit 53 closes the shutter when the imaging time has elapsed, acquires the image data output by the image sensor 19, and sends the acquired image data (captured image) to the image display control unit 61 and the displacement detection unit 57. Output. The image display control unit 61 displays the through image or the captured image input from the imaging control unit 53 on the LCD 23.

  When the imaging mode is set to the self-timer imaging mode, the displacement detection unit 57A receives an image (reference image) of image data input from the imaging control unit 53 at the time when the imaging instruction is input, and the imaging instruction The displacement of the main body is detected from the image (reference image) of the image data input from the imaging control unit 53 before the self-timer set time elapses from the input, and the detected displacement of the main body is determined as the cut-out position determination unit. 59. The reference image is an image data image input from the imaging control unit 53 immediately before the self-timer set time elapses after the imaging instruction is input. Specifically, it is the last image data output from the image sensor 19 before the self-timer set time elapses after the imaging instruction is input.

  The displacement detection unit 57A has a function similar to the function shown in the block diagram of FIG. 3, but the reference image acquisition unit 85 has the image sensor 19 immediately before the self-timer set time elapses after the imaging instruction is input. An image to be output (through image) is acquired as a reference image. In this case, an image (captured image) output by the image sensor 19 when the self-timer set time has elapsed after the imaging instruction is input is acquired as a reference image. This is different from the displacement detector 57 in the first embodiment. Since other functions are the same as those shown in FIG. 3, the description thereof will not be repeated here.

  The position determination unit 71 acquires the position of the optical axis of the lens group 13 with respect to the image sensor 19 when the shutter button 35A is pressed from the camera shake correction unit, and uses it as the main body displacement vector input from the displacement detection unit 57A. Based on this, the position of the optical axis of the lens group 13 with respect to the image sensor 19 when the self-timer set time has elapsed since the operation of pressing the shutter button 35A was detected is determined. Here, since the position of the optical axis of the lens group 13 with respect to the image sensor 19 when the shutter button 35A is pressed is the initial position, the end point of the main body displacement vector when the initial position is the start point of the main body displacement vector is The position of the optical axis of the lens group 13 with respect to the image sensor 19 is determined. The position determination unit 71 outputs to the camera shake correction unit 17 an instruction to move the image sensor 19 by the main body displacement vector input from the displacement detection unit 57A. Accordingly, the camera shake correction unit 17 moves the image sensor 19 by the amount of the main body displacement vector, so that the position of the optical axis of the lens group 13 with respect to the image sensor 19 is determined.

  When the position of the optical axis of the lens group 13 with respect to the image sensor 19 when the shutter button 35A is pressed is not the initial position, the shutter button 35A is pressed at the start point of the vector input from the displacement detector 57A. The position of the end point when the position of the optical axis of the lens group 13 with respect to the image sensor 19 is determined as the position of the optical axis of the lens group 13 with respect to the image sensor 19, and the optical axis of the lens group 13 is determined at the determined position. Is calculated and output to the camera shake correction unit 17.

  FIG. 14 is a flowchart illustrating an example of a process flow of the self-timer imaging control according to the fourth embodiment. The self-timer imaging control process is a process executed by the control unit 11A when the control unit 11A executes an imaging program stored in the EEPROM 25. Referring to FIG. 14, control unit 11A determines whether or not the imaging mode is set to the self-timer imaging mode (step S51). The process waits until the imaging mode is set to the self-timer imaging mode. If the imaging mode is set to the self-timer imaging mode, the process proceeds to step S52.

  In step S52, the image data output from the image sensor 19 is acquired as a through image. Then, the obtained through image is displayed on the LCD 23 (step S53). In step S54, it is determined whether or not the shutter button 35A has been pressed. If shutter button 35A is pressed, the process proceeds to step S55; otherwise, the process returns to step S52. The through image is displayed on the LCD 23 until the shutter button 35A is pressed. For this reason, the user can determine the imaging range by looking at the image displayed on the LCD 23.

  In step S55, the position of the optical axis of the lens group 13 with respect to the image sensor 19 is set as the reference optical axis position. Since the position of the optical axis of the lens group 13 with respect to the image sensor 19 at this stage is the initial position, the initial position is set to the reference optical axis position.

  In step S56, the image data output from the image sensor 19 is acquired as a through image. Then, the obtained through image is set as a reference image (step S57). The reference image is a through image output by the image sensor 19 when the shutter button 35A is pressed.

  In step S58, the image data output from the image sensor 19 is acquired as a through image. Then, the obtained through image is set as a reference image (step S59). In step S60, it is determined whether the self-timer set time has elapsed. If the time elapsed since the operation of pressing the shutter button in step S54 is detected is equal to the self-timer set time, the process proceeds to step S61. Otherwise, the process returns to step S58. That is, the acquired through image is set as the reference image until the self-timer setting time elapses after the operation of pressing the shutter button is detected. In other words, the reference image is a through image acquired immediately before the self-timer set time has elapsed since the operation of pressing the shutter button was detected.

  The processing from step S61 to step S63 is the same as the processing from step S12 to step S14 shown in FIG. In step S64, the position of the optical axis of the lens group 13 with respect to the image sensor 19 is determined from the optical axis position set as the reference optical axis position in step S55 and the main body displacement vector calculated in step S63. Here, since the optical axis position set as the reference optical axis position in step S55 is the initial position, the end point of the main body displacement vector when the initial position is the start point of the main body displacement vector is used as the lens group for the image sensor 19. The position of 13 optical axes is determined.

  In the next step S65, the optical axis position is changed. Specifically, an instruction to move the image sensor 19 by the main body displacement vector is output to the camera shake correction unit 17. Accordingly, the camera shake correction unit 17 moves the image sensor 19 by the amount of the main body displacement vector, so that the position of the optical axis of the lens group 13 with respect to the image sensor 19 is determined.

  In step S66, an image is taken. Specifically, after the shutter of the lens group 13 is closed and the image sensor 19 is initialized, the shutter of the lens group 13 is opened for a time corresponding to the shutter speed set in the imaging condition, and the image sensor 19 is subjected to photoelectric conversion. Let Thereafter, the image data output by the image sensor 19 is acquired as a captured image (step S67). Then, the acquired captured image is displayed on the LCD 23 (step S68), and the process proceeds to step S69. The processing from step S69 to step S71 is the same as the processing from step S18 to step S20 in FIG.

  In the digital still camera 1C according to the fourth embodiment, the displacement of the main body from when the operation for instructing imaging is accepted until the self-timer set time elapses is detected, and the operation for instructing imaging is accepted. Based on the position of the optical axis of the lens and the detected displacement, the position of the optical axis of the lens when the self-timer set time has elapsed after the operation for instructing imaging is received is determined. For this reason, even when the imaging range changes from when the operation for instructing imaging is accepted until the self-timer set time elapses, an image obtained by imaging the same imaging range can be acquired.

<Fifth embodiment>
A digital camera 1C according to the fifth embodiment is obtained by changing the displacement detection unit 57 in the fourth embodiment to be a displacement detection unit 57A. Since other configurations are the same as those of the digital camera 1 in the fourth embodiment described above, the description will not be repeated here, and different portions will be mainly described.

  The displacement detection unit 57A in the fifth embodiment is the same as the displacement detection unit 57A in the second embodiment shown in FIG. 8, and includes a motion vector calculation unit 91 and a movement vector calculation unit 93. The motion vector calculation unit 91 calculates a motion vector from a plurality of image data output by the image sensor 19 at predetermined time intervals, and outputs the calculated motion vector to the movement vector calculation unit 93. The movement vector calculation unit 93 calculates a movement vector by adding up the input motion vectors, and outputs the calculated movement vector to the position determination unit 71 as a displacement of the main body.

  FIG. 15 is a flowchart illustrating an example of a process flow of the self-timer imaging control according to the fifth embodiment. The difference from the flowchart shown in FIG. 14 is that step S57 to step S64 are changed to step S81, step S82, step S60, and step S64A. Referring to FIG. 15, the processing of step S81 and step S82 is executed after the operation of pressing the shutter button is detected in step S54 until it is determined in step S60 that the self-timer set time has elapsed. Is done. After a through image is acquired in step S56, a motion vector is calculated in step S81. A motion vector is calculated from the through image acquired when step S56 is executed in the previous loop and the through image acquired in the current loop. In the next step S82, a motion vector is calculated by integrating the motion vectors calculated in step S81. The processes of step S56, step S81, and step S82 are repeatedly executed every time a through image is acquired from when the operation of pressing the shutter button 35A is accepted until the self-timer set time elapses. Therefore, the calculated movement vector is the amount of movement of the optical image formed on the image plane of the image sensor 19 from when the operation of pressing the shutter button 35A is accepted until the self-timer set time elapses. Indicates the direction of movement.

  In step S64A, a new optical axis position is determined from the position of the optical axis set as the reference position in step S55, here the initial position, and the movement vector calculated in step S82. Specifically, the end point of the movement vector when the start point of the movement vector is used as the reference position is determined as the optical axis position.

  The digital still camera 1C according to the fifth embodiment has the same effects as the digital still camera 1 according to the second embodiment in addition to the effects of the digital still camera 1C according to the third embodiment. it can.

<Sixth Embodiment>
A digital still camera 1D according to the sixth embodiment is obtained by adding a gyro sensor to the digital still camera 1C according to the fourth embodiment.

  FIG. 16 is a block diagram illustrating an outline of a configuration of a digital still camera according to the sixth embodiment. Referring to FIG. 16, the difference from the block diagram shown in FIG. 12 is that a gyro sensor 33 is added. Since other configurations are the same as those of the digital still camera 1 in the first embodiment shown in FIG. 12, the description thereof will not be repeated here.

  The gyro sensor 33 is the same as that mounted on the digital still camera 1A in the third embodiment.

  The control unit 11 provided in the digital still camera 1A according to the sixth embodiment has the same functions except for the block diagram and the displacement detection unit 57 shown in FIG. The displacement detection unit 57 in the sixth embodiment receives the output of the gyro sensor 33, calculates the amount of movement of the main body in the X-axis direction from the angular velocity in the yaw direction input from the gyro sensor 33, and calculates the angular velocity in the pitch direction. To calculate the amount of movement of the main body in the Y-axis direction. The displacement detection unit 57 integrates the movement amount of the main body in the X-axis direction and the movement amount of the main body in the Y-axis direction, and the main body displacement vector having the integrated value of the X-direction shake amount and the integrated value of the X-direction shake amount as elements. Is calculated. Further, the displacement detection unit 57 converts the main body displacement vector into a movement vector by converting the shake amount of the main body into the movement amount of the optical image formed on the imaging surface of the image sensor 19. The displacement detector 57 uses a predetermined coefficient for the zoom amount of the lens group 13 when converting the main body displacement vector into a movement vector.

  Note that the displacement detection unit 57 in the sixth embodiment does not receive image data (through image) from the imaging control unit 53.

  FIG. 17 is a flowchart illustrating an example of a process flow of the self-timer imaging control according to the sixth embodiment. The difference from the flowchart shown in FIG. 14 is that step S56 to step S64 are changed to step S91, step S92, step S60, and step S64B. Referring to FIG. 17, the processing in step S91 and step S92 is executed after the operation of pressing the shutter button is detected in step S54 until it is determined in step S60 that the self-timer set time has elapsed. The In step S91, the shake amount of the main body is acquired from the gyro sensor 33. The shake amount of the main body in the X-axis direction is calculated from the angular velocity in the yaw direction input from the gyro sensor 33, and the shake amount of the main body in the Y-axis direction is calculated from the angular velocity in the pitch direction. In the next step S92, the main body displacement vector is calculated by integrating the main body deflection amounts in the X-axis direction and the Y direction, and the main body displacement vector is converted into a movement vector.

  The processes in step S91 and step S92 are repeatedly executed until the self-timer set time elapses after the operation of pressing the shutter button 35A is detected. Therefore, the calculated movement vector is an optical image formed on the imaging surface of the image sensor 19 at two time points when the self-timer set time has elapsed since the operation of pressing the shutter button 35A was detected. Indicates the amount and direction of movement.

  In step S64B, the optical axis position is determined from the optical axis position set at the reference optical position set in step S55 and the movement vector calculated in step S92. Specifically, the end point of the movement vector when the start point of the movement vector is set as the reference optical position is determined as a new optical axis position.

  The digital still camera 1D in the sixth embodiment has the same effects as the digital still camera 1A in the third embodiment in addition to the effects of the digital still camera 1C in the third embodiment. it can.

  In the above-described embodiment, the digital still cameras 1 and 1A to 1D have been described as an example of the imaging apparatus. However, the imaging method for executing the self-timer imaging control process illustrated in FIG. Needless to say, the present invention can be understood as an imaging program to be executed.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

<Appendix>
(1) The imaging apparatus according to claim 5, wherein the shake detection unit is a gyro sensor.

It is a block diagram which shows the outline of a structure of the digital still camera in one of the embodiments of this invention. It is a functional block diagram which shows an example of the function which a control part has. It is a block diagram which shows an example of the detailed function of a displacement detection part. It is a figure which shows an example of the through image and cutout area which an image sensor outputs. It is a figure which shows an example of the picked-up image and cutout area which an image sensor outputs. It is a figure for demonstrating a main body displacement. It is a flowchart which shows an example of the flow of a process of the self-timer imaging control in 1st Embodiment. It is a figure which shows an example of the detailed function of the displacement detection part in 2nd Embodiment. It is a flowchart which shows an example of the flow of a process for the self-timer imaging control in 2nd Embodiment. It is a block diagram which shows the outline of a structure of the digital still camera in 3rd Embodiment. It is a flowchart which shows an example of the flow of a process of the self-timer imaging control in 3rd Embodiment. It is a block diagram which shows the outline of a structure of the digital still camera in 4th Embodiment. It is a figure which shows an example of the function which the control part with which the digital still camera in 4th Embodiment is provided has. It is a flowchart which shows an example of the flow of a process of the self-timer imaging control in 4th Embodiment. It is a flowchart which shows an example of the flow of a process about the self-timer imaging control in 5th Embodiment. It is a block diagram which shows the outline of a structure of the digital still camera in 6th Embodiment. It is a flowchart which shows an example of the flow of a process about the self-timer imaging control in 6th Embodiment.

DESCRIPTION OF SYMBOLS 1 Digital still camera, 1,1A-1D Digital still camera, 11, 11A Control part, 13 Lens group, 15 Lens drive part, 17 Correction unit, 19 Image sensor, 21 Codec, 22 Signal processing circuit, 23 LCD, 25 EEPROM , 27 SDRAM, 29 card I / F, 29A memory card, 33 gyro sensor, 35 operation unit, 35A shutter button, 41 battery, 51 operation reception unit, 53 imaging control unit, 55 cutout unit, 57, 57A displacement detection unit 59, cutout position determination unit, 61 image display control unit, 71 position determination unit, 81 reference image acquisition unit, 83 feature region extraction unit, 85 reference image acquisition unit, 87 corresponding region extraction unit, 89 vector calculation unit, 91 vector Calculation unit, 93 Movement vector calculation unit.

Claims (7)

Imaging means for imaging a subject and acquiring an image;
Cutting means for cutting out an image of a region of a predetermined size from the acquired image;
Display control means for displaying an image of the clipped area;
Operation accepting means for accepting an operation for instructing imaging by a user;
Displacement detecting means for detecting the displacement of the main body until the self-timer set time elapses after an operation instructing imaging is accepted;
The self-timer setting after the operation instructing the imaging is received based on the position in the region cut out by the cutting means and the detected displacement when the operation instructing the imaging is received. An image pickup apparatus comprising: a cut-out position determining unit that determines a position to cut out the region of the predetermined size from the image output by the image pickup unit when time has elapsed. Imaging means for imaging a subject and acquiring an image;
The imaging means includes photoelectric conversion means for outputting an image signal by photoelectrically converting an optical image of a subject imaged on an imaging surface via a lens,
Display control means for displaying the output image;
Operation accepting means for accepting an operation for instructing imaging by a user;
Displacement detecting means for detecting the displacement of the main body until the self-timer set time elapses after an operation instructing imaging is accepted;
An imaging range changing means for moving the position of the optical axis of the lens with respect to the photoelectric conversion means,
The imaging range changing unit accepts an operation for instructing the imaging based on the position of the optical axis of the lens with respect to the photoelectric conversion unit and the detected displacement when the operation for instructing the imaging is accepted. An image pickup apparatus, comprising: a position determining unit that determines a position of an optical axis of the lens with respect to the photoelectric conversion unit when the self-timer set time has elapsed since the detection. The displacement detection means; a reference image acquisition means for acquiring an image output by the imaging means as a reference image in response to an operation instructing the imaging;
Feature region extraction means for extracting a feature region from the acquired reference image;
A corresponding area extracting unit that extracts a corresponding area corresponding to the extracted feature area from an image output by the imaging unit when a self-timer set time has elapsed since the operation instructing the imaging is received;
The imaging apparatus according to claim 1, wherein the displacement is determined based on a vector from the feature area toward the corresponding area. The displacement detection means includes a motion vector calculation means for calculating a motion vector based on a plurality of images continuously output by the imaging means,
From the time the self-timer set time elapses after the operation for instructing the imaging is accepted, based on all the motion vectors calculated by the shake detection means, The imaging apparatus according to claim 1, wherein a displacement of the main body is calculated. Further comprising a shake detection means for detecting the shake of the main body,
The imaging apparatus according to claim 1, wherein the displacement detection unit calculates a displacement of the main body after an operation instructing the imaging is received based on the detected shake. An imaging method executed by an imaging device,
The imaging apparatus includes an imaging unit that images a subject and acquires an image,
Cutting out an image of a region of a predetermined size from an image output by the imaging means;
Displaying an image of the clipped area;
Receiving an operation for instructing imaging by a user;
When the imaging mode is set in the self-timer imaging mode in which the imaging unit performs imaging after the self-timer setting time has elapsed since the operation instructing the imaging is accepted, after the operation instructing the imaging is accepted Detecting the displacement of the body of the
A self-timer after the operation instructing the imaging is received based on the position in the image of the region cut out in the clipping step and the detected displacement when the operation instructing the imaging is received. Determining a position to cut out the region of the predetermined size from the image output by the imaging means when a set time has elapsed. An imaging method executed by an imaging device,
The imaging device captures an object and acquires an image; and
The imaging means includes photoelectric conversion means for outputting an image by photoelectrically converting an optical image of a subject imaged on an imaging surface via a lens,
And a means for moving the position of the optical axis of the lens with respect to the photoelectric conversion means,
Displaying an image output by the imaging means;
Receiving an operation for instructing imaging by a user;
When the imaging mode is set in the self-timer imaging mode in which the imaging unit performs imaging after the self-timer setting time has elapsed since the operation instructing the imaging is accepted, after the operation instructing the imaging is accepted Detecting the displacement of the body of the
Based on the position of the optical axis of the lens with respect to the photoelectric conversion means and the detected displacement when the operation for instructing the imaging is received, the self-timer setting time after the operation for instructing the imaging is received Determining the position of the optical axis of the lens with respect to the photoelectric conversion means when elapses.

Images