JP4867310B2 - CAMERA, RECORDED IMAGE RECORDING / DISPLAY METHOD, AND PROGRAM - Google Patents

Description

The present invention relates to a camera that detects the state of camera shake, a method for recording and displaying a captured image of such a camera, and a program .

  If you do not fix the camera with a camera fixing device such as a tripod and take a picture with the camera, camera shake may occur during the shutter operation, and a blurred photo may be taken.

As a technique for preventing camera shake, there is a technique that detects a camera shake and outputs a warning display to prompt the user to hold the camera firmly.
As such a camera, (1) first determination means for determining that the output of the acceleration sensor is greater than a predetermined value, and second determination means for determining when the image signal has changed to a predetermined amount or more are provided. There are cameras that issue warnings according to the determination results of the first and second determination means (see, for example, Patent Document 1).
(2) An electronic device configured to save a captured image at the time of the shutter operation, automatically acquire images before and after the shutter operation, and warn when a camera shake is detected compared to the image at the time of the shutter operation. There is a still camera (see, for example, Patent Document 2).

  In addition, there is an electronic still camera that can capture images with minimal camera shake by continuously shooting multiple images before and after the shutter operation, and automatically selecting and recording the image with the least blur among them. (For example, refer to Patent Document 3). In the technique disclosed in the patent document, an electronic still camera stores images taken in a few seconds before and after the shutter operation in a memory, and detects a motion vector for each stored image after the shutter operation ends. “Degree of movement” and then select the image with the least “Degree of movement”

  Further, as a conventional technique capable of recording an image at a photo opportunity, there is a past photographing technique for photographing a past image (for example, see Patent Document 4). This past shooting technology captures and saves subject images in a work memory in a cyclic manner, and if the eyes are closed at the moment the shutter key is pressed, the desired image is recorded by returning to the past image. It can be done. That is, a plurality of images are taken at a predetermined time interval from the past to the present (when the shutter key is pressed) by one shutter operation, and a desired image can be selected from them.

JP 2003-140219 A Japanese Patent No. 2870772 Patent No. 2870771 Patent No. 3042485

  In Patent Document 1, a warning is displayed whenever a predetermined amount or more of blur occurs, so that the photographer can hold the camera every time, but in order to obtain a blur-free image, no blur occurs during the shutter operation. However, there is a problem that it is difficult to completely eliminate camera shake during the shutter operation.

  In addition, the technique disclosed in Patent Document 2 has an advantage in that when a camera shake occurs during a shutter operation, the camera shake is detected and a warning is given. There was a problem that it was not completely prevented.

  In the technique described in Patent Document 3, a plurality of images can be taken for several seconds before and after the shutter operation, and an image with the least blur among them can be automatically recorded. For example, image blur due to the movement of the subject is detected as an image blur due to the movement of the camera. However, there is a problem that it cannot be judged whether the camera shake is caused by camera shake or the movement of the subject.

  In the past photographing technique described in Patent Document 4, a plurality of images can be photographed cyclically before the shutter operation, and an image with the least blur among them can be automatically recorded. Since the image blur is detected based on the “movement degree”, as in the case of Patent Document 3, it is possible to determine whether the camera shake is caused by the camera shake or the subject movement. There was a problem of not being.

It is an object of the present invention to record an image with little camera shake and to easily determine the state of camera shake during recording in displaying a captured image after recording.

In order to solve the above-mentioned problem, the invention described in claim 1 is directed to an imaging unit, a camera shake state acquisition unit that cyclically acquires a camera shake state at the time of imaging, and an image captured by the imaging unit. a recording instruction detection means for detecting a recording instruction, the recording instructed by the recording instruction detecting means is detected, cyclically captured plurality of images before and after including the image captured by the imaging means, and , Temporary storage means for temporarily storing a camera shake history consisting of camera shake states acquired cyclically by the camera shake state acquisition means, and after the storage by the temporary storage means, the temporarily stored camera shake history and the display means and the recording instruction detecting means detects the child again recording instruction after instruction of the recording by displaying the ones captured at a predetermined timing in the history of the plurality of images Accordingly, characterized by comprising a recording means for recording a plurality of images stored in the temporary storage means including an image displayed on the display means.

According to a second aspect of the present invention, in the first aspect of the invention, the display unit further displays an index indicating the timing at which the imaging unit has captured a plurality of images in the camera shake history. Based on a plurality of images stored in the temporary storage means, further comprising a selection detection means for detecting selection of an image to be displayed on the display means, wherein the recording means detects the selection by the selection detection means An image is recorded .

According to a third aspect of the present invention, in the second aspect of the present invention, the image whose selection is detected by the selection detecting means is an image picked up from the plurality of images at a timing when the amount of camera shake is small. characterized in that there.
According to a fourth aspect of the present invention, in the second aspect of the present invention, the image whose selection is detected by the selection detection unit is an image captured at a timing closest to the detection timing by the recording instruction detection unit. It is characterized by being.

In order to solve the above-mentioned problem, the invention according to claim 5 is a camera shake state acquisition step for cyclically acquiring a camera shake state at the time of imaging, and an instruction to record an image captured by the imaging unit. a recording instruction detection step of detecting a, when the recording instruction is detected by the recording instruction detection step, cyclically captured plurality of images before and after including the image being captured by the imaging unit, and the a temporary storage step of cyclically acquired temporarily stored in the temporary storage unit shake history consisting of state of the hand movement in the hand shake state acquisition step, after storage in the temporary storage step, the temporary storage unit recording of the finger in a display step of displaying on the display unit and those taken at a predetermined timing in the history of the plurality of images with the stored blur history, the recording instruction detection step By re-detecting a recording instruction after, characterized in that it comprises a recording step of recording the recording unit a plurality of images stored in the temporary storage unit comprising an image displayed on the display unit .

In order to solve the above-mentioned problem, the invention according to claim 6 circulates the state of camera shake at the time of imaging in an information equipment computer comprising an imaging means , a temporary storage means, and a recording means. A camera shake state acquiring unit, a recording instruction detecting unit for detecting a recording instruction of an image captured by the imaging unit, and when the recording instruction is detected by the recording instruction detecting unit, the image is captured by the imaging unit. A plurality of images that are cyclically captured before and after the image, and a camera shake history that includes a camera shake state that is cyclically acquired by the camera shake state acquisition unit . After the storage by the temporary storage control means and the temporary storage control means, the camera shake history stored in the temporary storage means and the plurality of images were captured at a predetermined timing in the history Display output means for displaying and outputting Noto, the recording by detecting again recording instruction after instruction of the recording by the instruction detecting means, a plurality of images stored in the temporary storage means, including image being the display output It is made to function as a recording control means to record the above in the recording means .

According to the present invention, it is possible to record an image with little camera shake, and it is possible to easily determine the state of camera shake during recording in displaying a captured image after recording.

FIG. 1 is an external view of a digital camera as an embodiment of a camera according to the present invention. 1A is a front view of the digital camera 100, FIG. 1B is a configuration example of an imaging unit inside the camera, and FIG. 1C is a rear view.
As shown in FIG. 1A, a digital camera 100 includes a light receiving window 1 of a lens optical system on the front side, a grip portion 6 for stably holding the digital camera, and a strobe light emitting portion 10 as shown in FIG. . Further, reference numeral 7-1 in FIG. 1A denotes an angle sensor / vibration gyroscope (X direction) provided in the front interior, and reference numeral 7-2 denotes an angle sensor / vibration gyroscope (Y direction). Furthermore, an angle sensor / vibration gyro in the Z direction may be provided. These angle sensors / vibration gyros constitute a camera shake detection unit 31 shown in FIG.

  As shown in FIG. 1B, the light incident from the light receiving window 1 of the lens optical system 12 is reflected by the electric mirror / gimbal portion 12-1 provided inside the camera and is incident on the lens group 12-2. An image is formed on a CCD (imaging device) 13 through a lens group 12-2.

  Further, as shown in FIG. 1C, a mode selection key 2, a cursor key 3, a key such as a set key 4, and a liquid crystal monitor screen 5 are provided on the back surface of the digital camera 100. ing. Also, a shutter key 8 and a power button 9 are provided on the upper surface, and a USB terminal connection portion used when connecting to an external device such as a personal computer (hereinafter referred to as a personal computer) or a modem with a USB cable, although not shown. Is provided. Furthermore, an optical transmission / reception port for near field communication such as infrared communication or Bluetooth, a radio communication antenna, or a GPS reception antenna may be provided on the front surface or the like.

FIG. 2 is a diagram showing an embodiment of the electronic circuit configuration of the digital camera 100 of FIG.
In FIG. 2, the digital camera 100 has an automatic focusing (autofocus (AF)) function in a photographing mode that is a basic mode, and a lens 11 that constitutes a photographing lens 2 and a motor 11 that moves a focusing position and an aperture position. System 12, CCD 13 as image sensor, timing generator (TG) 14, vertical driver 15, sample hold circuit (S / H) 16, A / D converter 17, color process circuit 18, DMA (Direct Memory Access) controller 19, DRAM interface (I / F) 20, DRAM 21, control unit 22, VRAM controller 23, VRAM 24, digital video encoder 25, display unit 26, JPEG circuit 27, memory card 28, built-in memory 29, key input unit 30, hand A shake detection unit 31 is provided. In FIG. 2, the lens optical system 12 to the color process circuit 18 correspond to an imaging unit in the present invention. As will be described later (see Embodiment 2), when the digital camera 100 is configured to electronically detect a camera shake amount, the camera shake detection unit 31 may not be provided. Further, a camera shake correction unit 32 and a warning output unit 33 may be provided.

In the monitoring state in the shooting mode, the focus position and the aperture position are moved by driving the motor (M) 11, and the imaging element is arranged behind the shooting optical axis of the optical system 12 constituting the shooting lens 1. The CCD 13 is scanned and driven by a timing generator (TG) 14 and a vertical driver 15, and outputs a photoelectric conversion output corresponding to a light image formed at regular intervals for one screen.
The CCD 13 is a solid-state imaging device that captures a two-dimensional image of a subject, and typically captures an image of several tens of frames per second. The imaging element is not limited to a CCD, and may be a solid-state imaging device such as a CMOS (Complementary Metal Oxide Semiconductor).

  The photoelectric conversion output is appropriately gain-adjusted for each primary color component of RGB in the state of an analog value signal, sampled and held by a sample hold circuit (S / H) 16, and digital data by an A / D converter 17. The color process circuit 18 performs color process processing including image interpolation processing and γ correction processing in the color process circuit 18 to generate a digital luminance signal Y and color difference signals Cb and Cr, and a DMA (Direct Memory Access) controller 19. Is output.

  The DMA controller 19 uses the luminance signal Y and the color difference signals Cb and Cr output from the color process circuit 18 once by using the composite synchronization signal, the memory write enable signal, and the clock signal from the color process circuit 18 once. DMA transfer is performed to the DRAM 21 used as a buffer memory via the interface (I / F) 20.

  The control unit 22 is used as a CPU, a program storage memory such as a flash memory in which an operation program executed by the CPU including processing for camera shake detection in the shooting mode as will be described later is fixed, and a work memory The digital camera 100 controls the entire digital camera 100. After the DMA transfer of the luminance and chrominance signals to the DRAM 21, the luminance and chrominance signals are transferred from the DRAM 21 via the DRMA interface 20. Read and write to the VRAM 24 via the VRAM controller 23.

The control unit 22 calculates a camera shake component from a camera shake (camera shake amount and direction) detection value, displays a time series display of a camera shake state, and selects and records an image with the least camera shake in the shooting mode. Control and so on.
For example, the camera shake components of the camera body are calculated based on the camera shake (shake amount and direction) detection signal from the camera shake detection unit 31, and the calculated camera shake components are graphed and displayed on the LCD monitor screen. 5, the captured image is cyclically stored, and after detecting the imaging instruction, a predetermined number of images are selected in order from the image with the least camera shake, and stored and recorded.

  The control unit 22 also extracts a processing program and menu data corresponding to each mode stored in a program storage memory such as a flash memory in response to the status signal from the key input unit 30, and In addition to performing execution control of other functions, for example, execution of imaging and playback of recorded images, etc., display of a function selection menu at the time of function selection, selection function menu specified by cursor key 3 or the like and determination of image selection Control.

  The digital video encoder 25 periodically reads the luminance and color difference signals from the VRAM 24 via the VRAM controller 23, generates a video signal based on these data, and outputs the video signal to the display unit 26.

As described above, the display unit 26 functions as a monitor display unit (electronic finder) in the shooting mode. By performing display based on the video signal from the digital video encoder 25, the display unit 26 receives from the VRAM controller 23 at that time. An image based on the stored image information is displayed in real time.
In this way, in the display state of a so-called through image in which the image at that time is displayed in real time on the display unit 26 as a monitor image, the shutter key 8 (see FIG. When 1) is operated, a trigger signal (imaging instruction signal) is generated.

  In response to the trigger signal, the control unit 22 immediately stops the path from the CCD 13 to the DRAM 21 after the DMA transfer of the luminance and color difference signals for one screen captured from the CCD 13 to the DRAM 21 at that time. Transition to saved state.

In this stored recording state, the control unit 22 transmits the luminance and color difference signals for one frame written in the DRAM 21 through the DRAM interface 20 to each of Y, Cb, and Cr components of 8 pixels × 8 pixels horizontally. Are read in units called basic blocks and written into a JPEG (Joint Photograph Cording Experts Group) circuit 27. The JPEG circuit 27 uses ADCT (Adaptive Discrete Cosine Transform) and a Huffman code which is an entropy coding system. Data compression is performed by processing such as conversion.
The obtained code data is read out from the JPEG circuit 27 as a data file of one image, and is recorded and stored in either the memory card 28 or the built-in memory 29 that is detachably mounted as a recording medium of the digital camera 100.
Then, along with the compression processing of the luminance and color difference signals for one frame and the completion of writing all the compressed data to the memory card 28 or the built-in memory 29, the control unit 22 activates the path from the CCD 13 to the DRAM 21 again.

  In the playback mode, which is the basic mode, the control unit 22 selectively reads out the image data recorded in the memory card 28 or the built-in memory 29, and is completely opposite to the procedure in which the data is compressed in the image shooting mode by the JPEG circuit 27. The image data compressed in the procedure is expanded, the expanded image data is expanded and stored in the VRAM 24 via the VRAM controller 23, and is periodically read out from the VRAM 24. A signal is generated and reproduced by the display unit 26.

The JPEG circuit 27 supports a plurality of compression ratios, and a mode for storing data corresponding to the compression ratio includes a mode corresponding to a high resolution (generally called high definition, fine, normal, etc.) with a low compression ratio. There is a low-resolution (commonly called economy) mode with a high compression rate.
It also supports high to low pixel counts. For example, there are pixel sizes called SXGA (1600 × 1200), XGA (1024 × 786), SVGA (800 × 600), VGA (640 × 480) and the like.

The key input unit 30 includes the mode selection key 2, the cursor key 3, the set key 4, the shutter key 8, the power button 9, and the like described above, and signals associated with these key operations are directly sent to the control unit 22. .
The mode selection key 2 includes a slide key in the illustrated example, and performs selection of a shooting mode that is a basic mode and a moving image shooting mode that is a lower mode, and a playback mode and a moving image playback mode that is a lower mode thereof. Can do.
The cursor key 3 is normally used for a cursor movement operation performed when selecting a menu. The set key 4 is normally used when confirming the point result with the cursor key 3 or confirming the set value. When the set key 4 is pressed, the point result with the cursor key 3 is confirmed and the process designated by the cursor is started. Is done.
The shutter key 8 outputs a trigger signal (imaging instruction signal) when fully pressed and released.
Note that selection of various shooting modes and playback modes such as movie shooting and movie playback may be performed by providing a dedicated key.

The camera shake detection unit 31 may use a known small azimuth and vibration detection device, and detects the up / down, left / right, and front / back shake (pitch, yaw, roll) of the digital camera 100 at the time of shooting and converts it into a digital signal. The detected camera shake (camera shake amount, camera shake direction) detection signal is sent to the control unit 22. As the azimuth and vibration detection device, for example, two or three angular velocity sensors / vibration gyros as described above can be used.
The camera shake detection unit 31 is configured as a camera shake calculation device including a small azimuth and vibration detection device and a one-chip microcomputer, and controls camera shake component information (pitch, yaw, roll information) of the calculated camera body. You may make it send to the part 22. FIG.
The camera shake detection unit 31 may be a small and inexpensive device that can detect only vibration (amount of camera shake).
In addition, the camera shake detection unit 31 calculates a camera shake amount by acquiring a difference between images in a comparison target area of an image to be circulated and stored in the DRAM 21 before a shooting instruction (in the embodiment, full press of the shutter key 8). It may be configured as a one-chip microcomputer that realizes the function of detecting blur. Instead of the camera shake detection unit 31, an image of the current frame that is circularly stored in the DRAM 21 before the shooting instruction is issued. A subprogram that realizes the function of electronically acquiring the camera shake amount from the previously stored image of the previous frame may be configured to be included as one module and stored in the program storage memory.

  The camera shake correction unit 32 performs image processing for changing a frame for switching a recorded image from a captured image that is slightly larger than the shooting frame based on the calculated shake correction amount. Further, as the camera shake correction unit 32, based on the calculated camera shake correction amount, a correction optical system such as a rotary mirror provided in a part of the optical system 12 is driven and controlled to correct the optical axis on the imaging surface. It may be configured as described above. Note that the camera shake correction unit 32 is essential in the fourth and fifth embodiments described later, but is not essential in the first and second embodiments.

  The warning output unit 33 includes a device that outputs voice and sound, a bell, a warning lamp, or the like. When the amount of shake detected by the camera shake detection unit 31 exceeds a predetermined value, the voice or sound, or A bell or flashing light is output to notify the user. Further, a warning message may be displayed instead of the warning output. The warning output unit 33 is essential in the fifth embodiment described later, but is not essential in the first to fourth embodiments.

(Embodiment 1)
In the present embodiment, the camera shake detection unit 31 shown in FIG. 2 is configured by an azimuth and vibration detection device (or a simple vibration detection device capable of detecting only vibration), and the detected camera shake amount is determined for each camera shake component. A) A time series display together with a through image, a plurality of images photographed before photographing instruction (full pressing of the shutter key 8) and a camera shake amount of each image are associated with each other and stored in a temporary storage memory such as the DRAM 21; An example will be described in which a predetermined number of images are selected and recorded in order from the image with the smallest amount of camera shake after the shooting instruction.

FIG. 3 is a diagram illustrating an example of camera shake state display. In a camera having a camera shake detection function, three camera shake components (pitch (PITCH) component, yaw (YAW) component, and roll) are shown. An example in which the (ROLL) component) is graphically displayed on the monitor screen 5 in time series is shown.
The camera shake detection unit 31 detects the amount and direction of camera shake almost simultaneously with the through image display from the start of shooting, and the three components are each graphed by the graphing means. Then, the graphs are displayed in the graph display field 52 as line graphs 56, 57, and 58 having different colors. In the example shown in the figure, line graphs 56, 57, and 58 are developed in time series from left to right. When the range of the graph display column 52 is exceeded, the oldest one is deleted in order and a new camera shake amount is displayed.
In the example of FIG. 3, three line graphs are displayed in the same display column. However, display columns may be provided on the left side, the right side, or the upper side of the screen 5 and displayed separately (see FIG. 3). ). The position of the display column is not limited to the periphery. That is, a line graph may be displayed at a position that does not interfere with the subject. Moreover, it is not limited to the graph line graph to display. For example, a wavy graph, a line graph, or a bar graph may be used, and the thickness and shape of the line may be changed.
Further, the relative size of each component may be deformed and expressed without being limited to the absolute value of the amount of camera shake. For example, in order to emphasize when the pitch is 1.5 times the yaw, it may be expressed twice or logarithmically.

  In this way, the camera shake state is displayed in chronological order with the three components of up / down, left / right, and front / back, so that the photographer can easily grasp the transition and size of the top / bottom, left / right, front / rear camera shake. The digital camera 100 can be consciously stabilized without camera shake of the digital camera 100 occurring immediately before. In addition, the digital camera 100 is spontaneously stabilized immediately before the shutter key 8 is pressed to reduce camera shake.

  In the example of FIG. 3, the amount of camera shake of the three components is displayed in time series. However, only two of the two components, that is, the pitch component, yaw component, and roll component, or one component are displayed in time series. May be. Further, when displaying the amount of camera shake of three components or two components, it is desirable that the components are generated in different colors for each component.

  FIG. 4 is an explanatory diagram of camera shake components, where the horizontal direction of the camera 200 is the X axis, the center of the camera 200 is the origin, the vertical axis perpendicular to the X axis is the Y axis, the origin passes through the X axis, Y If the axis perpendicular to the axis is the Z-axis, the pitch is the horizontal blur around the Z-axis, the yaw is the left-right blur around the Y-axis, and the roll is the vertical blur around the X-axis. Means.

FIG. 5 is an explanatory diagram of the circular storage area in the DRAM 21 in the photographing mode, FIG. 5 (a) is an example of storage area allocation in the DRAM 21, and FIG. 5 (b) is an explanation of the circular storage of the detected camera shake amount. FIG. 5C is an explanatory diagram of the cyclic storage of the captured image.
In this example, the DRAM 21 has a file management area 211, a camera shake amount circulation storage area 222 for storing the detected camera shake amount in a cyclic manner, an image storage area 223 for storing image data from the color process circuit 18, and a graph value. A storage area 224, a work area 225, and the like are allocated.

  The camera shake amount circulation storage area 222 is divided into a predetermined number (the same number as the division number of the image circulation storage area 223) as shown in FIG. The image is stored in association with the image stored in the image circulation storage area 223. Note that the amount of camera shake to be stored can be stored separately for each direction component. When the detected camera shake amount (by direction component or without direction component) is M, a predetermined number (20 sets in the illustrated example) of camera shake amounts M1, M2,... M20 is stored in time series. Then, when the camera shake amount circulation storage area 222 is full, M2 is overwritten on the oldest camera shake amount M1, M3 is overwritten on M2, M20 is overwritten on M19, and the shift is made from right to left. , M20 stores the latest camera shake amount just detected. In this way, the camera shake amount circulation storage area 222 is updated so as to push out the oldest camera shake amount with the newest camera shake amount at a predetermined time interval (in the example shown, 1/20 (second)).

As shown in FIG. 2C, the image circulation storage area 223 is divided into a predetermined number (the same number as the division number of the camera shake amount storage area 222), and temporarily stores the image data from the color process circuit 18. If the image data for one frame output from the color process circuit 18 is G, a predetermined number (20 in the illustrated example) of image data G1, G2,... G20 are stored in the image circulation storage area 223. When the image circulation storage area 223 is full, the image data G1 is overwritten with G2, G3 is overwritten with G3,... G19 is overwritten with G20 from right to left. The latest image data (one frame) just output from the color process circuit 18 is stored in G20. In this way, the image circulation storage area 223 is updated so as to push out the oldest image with the newest image at a predetermined time interval (in the example shown, 1/20 (second)).
In the example of FIG. 5, a camera shake amount M1 is associated with the image G1, and similarly, M2 is associated with G2,.

  In the graph value storage area 224, a graph value (with or without direction component classification) generated from the amount of camera shake (by direction component) is cyclically stored.

(Camera shake display and image selection / recording operation)
FIG. 6 is a flowchart showing an example of a camera shake state display and image selection / recording operation of the digital camera. The processing shown below is basically executed by the control unit 22 in accordance with a program stored in advance in a program memory such as a flash memory. An example in which the present invention is applied to the digital camera 100 shown in FIGS. 1 and 2 will be described below.

  In the shooting mode, the control unit 22 executes AE processing at a focal length corresponding to the zoom value at that time, obtains image data from the CCD 13, and achieves white balance corresponding to the color of the light source by automatic white balance (AWB) processing. As described above, after adjustment is performed by the color process circuit 18, the VRAM 24 is rewritten with video through image data obtained by thinning out image data from the CCD 13, and a through image is displayed on the display unit 26 (step S1).

  Next, the control unit 22 performs an automatic focusing (AF) process so that a predetermined focus area is in focus (step S2), and the image data from the color process circuit 18 is secured on the DRAM 21. The latest image is stored in the storage area 223. That is, when the image circulation storage area 223 is full, the storage address of the image is shifted and the oldest image is erased (step S3).

  The camera shake detection unit 31 detects shakes (pitch, yaw, roll) before and after, left and right of the digital camera 100 and sends detection signals (digital signals) to the control unit 22 at predetermined time intervals. 22 receives the camera shake detection signal output from the camera shake detector 31 (step S4), and stores it as the latest value in the camera shake amount circulation storage area 222 secured on the DRAM 21. That is, when the camera shake amount circulation storage area 222 is full, the image storage address is shifted and the oldest camera shake amount is erased (step S5).

  Next, the control unit 22 extracts a camera shake component to be displayed (pitch component, yaw component, and roll component in the display example of FIG. 3) to generate a graph value (step S6), and the generated graph value is stored on the DRAM 21. Are stored as the latest value of the time-series graph values stored in the graph value circulation storage area 224. That is, when the graph value circulation storage area 224 is full, the storage address of the graph value is shifted and the oldest value is erased (step S7).

  Next, the control unit 22 gives the time-series graph values stored in the graph value circulation storage area 224 to the digital video encoder 25 via the VRAM controller 23 to generate a video signal, and outputs the video signal to the display unit 26 to display the liquid crystal. In the graph display column of the monitor screen 5, a time-series graph (see FIG. 3) showing a camera shake state is displayed in a different color for each direction component (step S8).

  The control unit 22 checks whether or not the shutter key 8 has been fully pressed. If the shutter key 8 has been fully pressed, the process proceeds to step S9. If not, the process returns to step S1 (step S9).

  When the shutter key 8 is fully pressed, the control unit 22 immediately transfers the image data for one screen captured from the CCD 13 at the time when the shutter key 8 is fully pressed to the DRAM 21 immediately after completion of the DMA transfer to the DRAM 21. The path to the DRAM 21 is stopped, and each handshake amount stored in the handshake amount circulation storage area 222 of the DRAM 21 is compared at the time when the shutter key 8 is fully pressed, and a predetermined number of hands are sequentially ordered from the smallest handshake amount. A blur amount is selected and an image address corresponding to the selected camera shake amount is held. As a result, a predetermined number of images are selected in order from the image with the smallest amount of camera shake (step S9).

The control unit 22 extracts the image data from the image circulation storage area 223 of the DRAM 21 based on the address of the image (= selected image) corresponding to the camera shake amount selected in step S9 and compresses the image data in the JPEG circuit 27. Processing is performed, and an image file (compressed image data) is recorded in a recording memory such as the memory card 28 (or built-in memory) 29 (step S10).

  Further, the control unit 22 takes out the image data of the image (= selected image) recorded in the recording memory in step S10 from the image circulation storage area 223 in the shooting order, sends it to the VRAM 24, and sends it to the VRAM 24 via the VRAM controller 23. 25, the video signal is generated and displayed on the display unit 26 (step S11), and the graph value is calculated from the camera shake amount corresponding to the image displayed in step S11 among the camera shake amounts selected in step S9. The video signal is generated and given to the digital video encoder 25 via the VRAM controller 23 to generate a video signal, which is displayed at a predetermined position of the display unit 26 (superimposed on the image displayed in step S11) as shown in FIG. Step S12).

  Through the operation shown in the flowchart of FIG. 6 above, the digital camera 100 detects camera shake, circulates and stores it in an image in which the amount of camera shake is captured while displaying the camera shake state in chronological order, and issues a shooting instruction (shutter key 8 Since the image is selected in order from the image with the least amount of camera shake after the camera is fully pressed), the camera should be firmly held so that the camera operator does not shake the digital camera 100 immediately before the shooting instruction is grasped. It is possible to automatically select and record an image with less camera shake from images that have been consciously stabilized by holding the camera to reduce camera shake.

  In addition, since the camera shake component is displayed in a graph in time series only at the time of automatic focusing, the photographer can easily grasp the shift and the current state of the camera shake. Accordingly, it is possible to automatically select and record an image with less camera shake from images in which the camera consciously stabilizes the camera and reduces camera shake so that camera shake does not occur until the photographer gives a shooting instruction. In addition, since the graph is displayed only at the time of automatic focusing, the graph does not get in the way and it is easy to determine the composition before the autofocus process.

  In step S10, the number of camera shake amounts to be selected = the number of selected images is one or more, and is a number set at the time of design or by the user. In the description of step S12, the image data of the image selected from the image circulation storage area 223 is extracted in the shooting order. However, the image data may be extracted in ascending order of camera shake.

  In the above flowchart, steps S3 to S8 are shown as operations subsequent to step S2. However, in practice, it is desirable to perform the operations in parallel with the automatic focusing operation in step S2. Further, there are various programs for displaying as shown in FIG. 3 and FIG. 7 and FIG.

  In the flowchart of FIG. 6, the camera shake detection unit 31 is an example of a device that can detect the camera shake amount and direction. However, a simple sensor such as a sensor that can detect only the camera shake amount can be used. If the device is a simple device (or a microcomputer or program programmed to detect only the amount of camera shake), step S4 is executed, “The camera shake detection unit 31 detects the camera shake (the amount of camera shake). Since the detection signal (digital signal) is sent to the control unit 22 at predetermined time intervals, the control unit 22 receives the camera shake detection signal output from the camera shake detection unit 31, and “Step S6 is displayed. The amount of camera shake is taken out and a graph value of the amount of camera shake is generated. ”

FIG. 7 is a diagram showing an example of the camera shake amount display of the selected image displayed in step S6 of FIG. 6. The camera shake amount is circled at a predetermined position on the monitor screen 5 (FIG. 1) for each camera shake component. An example of a graph display is shown. In the pie chart 56, the camera shake amounts 52-1, 52-2, 52-3 are shown differently for each camera shake component. In the figure, the above-described three camera shake components are shown, but two or three of the three components may be displayed.
As described above, the camera shake amount is displayed for each camera shake component in step S13 together with the image selected in step S12. Thus, when a plurality of images are selected, the photographer has a camera shake. You can delete large images.

<Modification>
In the flowchart of FIG. 6, when there is a shooting instruction, the camera shake amount circulated and stored at the time of shutter instruction detection is compared in step S10, and a predetermined number of images are selected in order from the image with the smallest blur amount. However, it may be configured such that a predetermined number of images can be selected in order from an image with a camera shake amount equal to or less than a predetermined value closest to the moment of shooting instruction. Hereinafter, an example will be described in which it is possible to select camera shake amount priority or timing priority when selecting an image.

  FIG. 8 is a flowchart showing another embodiment of the camera shake state display and image selection / recording operation of the digital camera 100. When selecting an image in step S10 of the flowchart of FIG. It is the flowchart which enabled selection. That is, in FIG. 8, steps S1 to S9 and steps S11 to S13 are the same as those in the flowchart of FIG. The photographer sets an image selection flag for selecting whether to perform image stabilization priority image selection or timing priority image selection, for example, by selecting a menu displayed on the screen 5 by the photographer when the shooting mode is selected. It shall be possible.

(Deformation example)
When the shutter 8 is fully pressed in step S9 in FIG. 6, the controller 22 completes the DMA transfer of the image data for one screen captured from the CCD 13 to the DRAM 21 when the shutter key 8 is fully pressed, Immediately, the path from the CCD 13 to the DRAM 21 is stopped, the image selection setting flag is checked, and if the image selection setting is set to image selection with camera shake priority, the process proceeds to step S10-2. If the timing-priority image selection is set), the process proceeds to step S10-3 (step S10-1).

  In the case of image selection with priority on camera shake amount, the control unit 22 compares each camera shake amount stored in the camera shake amount circulation storage area 222 of the DRAM 21 at the time when the shutter key 8 is fully pressed and compares the camera shake amount with the least hand. A predetermined number of camera shake amounts are selected in order from the camera shake amount, and the address of the image corresponding to the selected camera shake amount is held, and the process proceeds to step S11. As a result, a predetermined number of images are selected in order from the image with the smallest amount of camera shake (step S10-2).

  In the case of timing-priority image selection, the control unit 22 compares each camera shake amount stored in the camera shake amount circulation storage area 222 of the DRAM 21 at the time when the shutter key 8 is fully pressed with a threshold value, and is less than the threshold value. A predetermined number of camera shake amounts are selected in order of timing closest to the moment when the shutter key 8 is fully pressed, and an image address corresponding to the selected camera shake amount is held, and the process proceeds to step S11. . Thus, a predetermined number of images are selected in the order close to the moment when the shutter key 8 is fully pressed out of the amount of camera shake less than the threshold (step S10-3).

(Embodiment 2)
In the first embodiment, the camera shake amount is detected by an azimuth and vibration detection device (or a simple camera shake detection device capable of detecting only the camera shake amount) and associated with a past photographed image. Although an image with a small amount is selected and recorded, in this embodiment, the amount of camera shake is electronically acquired from an image captured before a shooting instruction without providing the camera shake detection unit 31 shown in FIG. An example in which an image with the least amount of camera shake is selected and recorded after a shooting instruction will be described.

FIG. 9 is an explanatory diagram of an image blur detection method, and is a diagram schematically showing a state in which blur occurs in the subject image A of the current frame and the subject image B of the previous frame at a certain point in time.
The blur amount is detected by cutting out image data of the evaluation area (line C in the example of FIG. 9) from the new subject image (current frame) acquired for each frame while displaying the through image, and immediately preceding the subject image (previous frame). ) By calculating the amount of correlation with the image data of the evaluation area.

In the example of FIG. 9, the image blur amount is obtained by obtaining the pixel data of the evaluation area as a line C for one line, f (n) as the image signal of the subject image A, and g as the image signal of the subject image B. As (n), the correlation amount Rfg for the sections a to b of the line C can be calculated and calculated based on a correlation equation such as the following equation (1).

FIG. 10 is an explanatory diagram of a camera shake amount detection area, and shows an example in which the focus area is a camera shake amount detection area.
In the description of FIG. 9, since the correlation amount is calculated using one line C in the sections a and b larger than the subject image as the camera shake amount detection region (evaluation region), it seems that the subject's head and limbs moved as shown in FIG. In this case, blurring is detected. In this case, blurring of the image due to camera shake and blurring of the image due to movement of the subject are also detected as blurring. A portion that does not affect the movement of the image, for example, an image portion corresponding to a focus area (rectangular portion surrounded by sections α to β and lines i to j (number of lines = m)) 83 is a camera shake amount detection region. Is set, it is possible to acquire only the amount of camera shake based on the correlation amount accumulated by repeating the calculation according to the above equation (1) for m lines.

FIG. 11 is a flowchart showing an example of camera shake state display and image selection / recording operation of the digital camera.
In FIG. 11, the operations in steps T1 to T3 are the same as those in the flowchart in FIG. 6. Following the circular storage of the image in step T3, the control unit 22 performs the focus area 83 of the captured image data (the subject image of the current frame). The image is cut out (step T4), and the cumulative correlation amount for the m lines in the sections α to β between the cut out image of the subject image of the current frame and the image cut out of the subject image of the previous frame is as shown in Expression (1). The amount of camera shake is calculated by an arithmetic program based on the correlation expression (step T5), and stored as the latest value in the camera shake amount storage area 222 secured on the DRAM 21. That is, when the camera shake amount circulation storage area 222 is full, the image storage address is shifted and the oldest camera shake amount is erased (step T6).

  Next, the control unit 22 takes out the camera shake amount to be displayed and generates a graph value (step T7), and the generated graph value is stored in the graph value circulation storage area 224 secured in the DRAM 21 in time series. Circularly stores the latest graph value. That is, when the graph value circulation storage area 224 is full, the storage address of the graph value is shifted and the oldest value is deleted (step T8).

  Next, the control unit 22 gives the time-series graph values stored in the graph value circulation storage area 224 to the digital video encoder 25 via the VRAM controller 23 to generate a video signal, and outputs the video signal to the display unit 26 to display the liquid crystal. A graph is displayed in time series indicating the amount of work in the graph display field of the monitor screen 5 (see FIG. 13), and the process proceeds to step T10 (step T9). The operations after step T10 are the same as the operations after step S9 in FIG. The modification is the same as that in the first embodiment (see FIG. 8).

FIG. 12 is an operation flowchart of the subprogram showing details of the camera shake amount calculation operation in step T4 of FIG. 11, and shows the correlation amount of the line area L and the focus area as the camera shake amount detection area of the current frame and the previous frame. Assume that the accumulated correlation area is secured in the DRAM 21.
In FIG. 12, the image of the focus area 83 portion of the subject image of the current frame cut out in step T4 of FIG. 11 and the image of the focus area 83 portion of the subject image of the previous frame are m lines (m = line number j−i) ×. Assuming (length of β−α), the control unit 22 sets the value of the line counter L to i and the cumulative correlation amount area to 0 (step T5-1), and the value of the line counter L in the focus area P is (T5-2), and the correlation amount between the image of the focus area 83 of the subject image of the current frame and the image of the focus area 83 of the subject image of the previous frame is obtained by the equation (T5-2). Calculated by a calculation program based on the correlation equation as shown in 1) and added to the cumulative correlation amount area (step (T5-3)), the result of adding 1 to the line counter L is If greater than the proceeds to step T5-5, otherwise the flow returns to step T5-2 (step T5-4).

  The cumulative correlation amount is compared with the upper threshold, and when the cumulative correlation amount is less than or equal to the upper threshold, the process proceeds to step T6 of FIG. 6, and when the cumulative correlation amount is larger than the upper threshold, a cause other than camera shake (for example, camera movement or The process proceeds to step T5-6 as a correlation amount calculated by replacing the cumulative correlation amount with the upper limit threshold as blur due to subject movement (step T5-5). Based on the accumulated correlation amount calculated (or replaced) in step T5-4, the camera shake amount is acquired, and the process proceeds to step T6 in FIG. 6 (step T5-6).

  In the description of the flowcharts of FIG. 11 and FIG. 12, the focus area rectangle is used as the camera shake amount detection area, but the camera shake amount detection area is not limited to the focus area rectangle. For example, a predetermined one line in the rectangle of the focus area may be used as the camera shake amount detection area, and a portion other than the focus area may be used as the camera shake amount detection area.

  FIG. 13 is a diagram showing an example of camera shake state display in the present embodiment, in which the amount of camera shake of the subject image 51 is displayed as a time-series line graph 56 in the graph display area 52.

(Embodiment 3)
In Embodiment 1 and Embodiment 2 described above, the camera itself does not perform camera shake correction and the camera is consciously held stable by displaying the blurring state in a graph. You may make it provide the display function of the log | history data of quantity. It is also possible to automatically save and record an image with the least amount of blur.

  In this embodiment, the digital camera 100 (FIGS. 1 and 2) captures images at a predetermined interval continuously before pressing the shutter key 8 at the time of shooting, and sequentially deletes old images when the memory is full. The camera is configured to perform continuous continuous shooting (hereinafter referred to as “PAST shooting”), and it detects blurring as a camera shake detection means such as a camera shake, a support posture blur, or a vehicle shake, or a camera shake detection means. The unit 31 is provided.

  During continuous shooting of PAST shooting, the angular velocity or blur amount detected at that time is recorded in association with the shot image at the same time, and during the live display of the subject image, the subject image is traced back from the present time (first). (1) The blur amount detected during the PAST imaging for a predetermined time is sequentially updated and plotted, and the subject image is recorded as a dynamic continuous graph or the like as the history data of the blur amount from the (first) predetermined time to the present time. Are displayed on the liquid crystal monitor 5 (FIG. 1), and at the moment when the shutter key 8 is pressed, the history data of the corresponding blur amount is referred to from a plurality of continuous images taken before the pressing. The image with the least blur at the time of shooting is automatically selected and recorded.

More specifically, the image with the least blur is an image with the least amount of blurring during shooting within a preset (second) predetermined time, or a predetermined number of blurring during shooting. Among images that are less than the value, an image that satisfies a predetermined condition, such as an image taken at the time closest to the moment when the shutter key 8 is pressed, is selected. The camera 100 automatically selects the image with the least blurring. It is displayed on the liquid crystal monitor 5 as a stored recording image or a recording candidate image.
In addition, images other than the selected recording candidate images that have been PAST shot before the shutter key 8 is pressed are played back in order by operating the cursor key 3 or the like during shooting review display. Therefore, the user can arbitrarily select a desired image from these images and press the recording determination key such as the set key 4 to save and record the image on the memory card 28.

  FIG. 14 is a diagram showing a display example of the blur amount and its history. FIG. 14A is a through image, and PAST images are continuously taken before the shutter key 8 is pressed. In FIG. 14A, reference numeral 141 indicates a subject image displayed through, reference numeral 142 indicates a graph in which the blur amount and its history are continuously displayed, and reference numeral 143 indicates the current blur amount.

  In the through display shown in FIG. 14 (a), as described above, a plurality of images are sequentially captured at a predetermined interval before the shutter key 8 is pressed, and an image buffer memory for PAST shooting (circular storage in the DRAM 21). PAST photographing is sequentially stored in the area 223). When there is no remaining memory in the specified capacity, the old images are erased sequentially, and the operation of capturing and recording multiple images within the specified capacity or range within the specified time is repeated and detected at each shooting time in association with the image. Record information on the amount of shake. A graph 142 in which blur amounts recorded over the live view of the image are sequentially plotted as a history is sequentially updated and dynamically displayed as the PAST shooting progresses.

  FIG. 14B shows an image displayed immediately after shooting. In FIG. 14B, reference numeral 144 indicates an example of a preview display of a review display image or a recording candidate image at the time of shooting, and reference numeral 145 indicates a point with less blurring in the past shooting shown on the graph 142. 146 indicates the moment when the shutter key 8 is pressed.

When the shutter key 8 is pressed, shooting is performed. Immediately after shooting, the image with the smallest blur amount is automatically selected from the PAST shot images up to that point, and stored and recorded in the memory card 28 as a shot image. Alternatively, it may be displayed as a recording candidate image, and the recording candidate image may be stored and recorded in response to a recording confirmation key input by the photographer's operation of the set key 4 or the like.
In the shooting review display (or recording review display) as shown in FIG. 14B, the blur amount at the time of shooting is displayed together with the selected image together with the history, so at which timing the image is shot and how much blurring has occurred. It can be easily confirmed by an index line or a mark (such as ▼) whether it is an image at the time of occurrence.

  FIG. 14 (c) is a diagram showing the amount of blur at the time of shooting recorded in association with a series of PAST shot images. In FIG. 14 (c), reference numerals 146-1, 146-2,. PAST captured images are shown, and reference numerals 147-1, 147-2,.

  A PAST photographed image other than the automatically selected image can also be selected and reproduced by a cursor or the like in the review display as shown in FIG. 14B, and the corresponding blur amount is displayed as shown in FIG. 14C. Therefore, if there is a desired image that the photographer wants to save, it can be arbitrarily selected by pressing the set key 4 or the like and stored in the memory card 28.

  FIG. 15 is a diagram showing another display example of the blur amount and its history. Although FIG. 14 shows an example in which the blur amount and its history are displayed in a horizontally long line graph that is constantly updated at the bottom of the screen of the liquid crystal monitor 5, the blur amount and its history display method are not limited to this. . For example, it can be displayed by a display method as shown in FIG.

  In FIG. 15A, the amounts of shake such as angular velocity or angular displacement around two axes of pitch and yaw are simultaneously displayed on the right and bottom sides of the display screen in accordance with the approximate direction of shake. FIG. 15 (b) shows that the amounts of blurring around the three axes of pitch, yaw and roll (see FIG. 4) are overlapped on the lower side of the screen so that the amounts of blurring at the same occurrence timing can be compared. This is an example of displaying. FIG. 15 (c) displays the blur amounts and the like around the two axes in a plurality of stages at the same time and displays a plurality of images with a blur amount less than a predetermined value from the PAST captured images with a small blur amount. In this example, a plurality of images are automatically selected in order or in order of photographing time, and the selected recording candidate images and their respective blur amounts are associated with numbers and displayed as a list. In any case, instead of displaying a graph corresponding to the detected blur amount for each axis, it is possible to convert the blur amount of multiple axes with a predetermined formula or perform weighted evaluation to judge the size of blur comprehensively. The index value or the like may be displayed.

  FIG. 16 is a flowchart illustrating an example of shooting control of the digital camera according to the third embodiment. The processing shown below is basically executed by the control unit 22 in accordance with a program stored in advance in a program memory such as a flash memory. An example in which the present invention is applied to the digital camera 100 shown in FIGS. 1 and 2 will be described below.

  When the power of the digital camera 100 is turned on, the control unit 22 first executes necessary initial setting processing such as clearing of the RAM, DRAM 21 and VRAM 24 and setting of a built-in register and outputs a signal from the key input unit 30. Whether or not the shooting mode is selected is checked. If the shooting mode is selected, the process proceeds to step U3. If another processing mode is selected, the process proceeds to step U2 (step U1).

  When another processing mode is selected, the control unit 22 executes the selected processing mode (details omitted) (step U2).

  When the photographing mode is selected, the control unit 22 sets on / off of the camera shake display function based on the photographing conditions such as the exposure time or the focal length of the photographing lens and the user's selection (Step U3), and the photometric processing and white After executing the balance (WB) process (step U4), the shake detecting means 31 is controlled to activate the angular velocity sensor / piezoelectric vibration gyro (step U5), and the amount of camera shake is sequentially detected. The camera shake detection unit 31 detects the amount of shake (pitch, yaw, roll) before and after, right and left of the digital camera 100 and sends it to the control unit 22 at predetermined time intervals (step U6).

  Next, the control unit 22 executes a zoom process and an autofocus (AF) process so as to focus on a predetermined focus area (step U7), and image data from the color process circuit 18 is secured on the DRAM 21. Is stored as a latest image in a captured image temporary storage memory (for example, the image circulation storage area 223 (FIG. 5)), and the blur amount sent from the camera shake detection unit 31 is associated with the image data and temporarily stored for the blur amount. The data is stored in a storage memory (for example, the graph ground circulation storage area 224 (FIG. 5)) (step U8).

  The control unit 22 checks the capacity of the captured image temporary storage memory. When the captured image temporary storage memory is exceeded, that is, when the captured image temporary storage memory is full of captured images, the process proceeds to step U10. In this case, the process proceeds to Step U11 (Step U9).

  When the capacity of the captured image temporary storage memory is exceeded, the control unit 22 sequentially deletes the oldest image stored in the captured image temporary storage memory. Similarly, the oldest blur amount stored in the blur amount temporary storage memory is sequentially deleted (step U10).

  Next, AE processing for a through image is executed with a focal length corresponding to the zoom value at that time, and the captured subject image is displayed on the liquid crystal monitor 5 of the display unit 26 (step U11).

  Next, the control unit 22 checks whether the camera shake correction function set in step U3 is on or off. If it is on, the process proceeds to step U13. If it is off, the process proceeds to step U14 (step U12).

  When the camera shake correction function is on, the current camera shake amount detected by the camera shake detection unit 31 and the camera shake amount of continuous past images taken out from the shake amount temporary storage memory are displayed on the liquid crystal monitor 5 of the display unit 26. A plot is displayed (step U13).

  The control unit 22 checks whether or not the shutter key 8 has been pressed based on a signal from the key input unit 30, and proceeds to step U16 when the shutter key 8 is pressed, and to step U15 when any other key is pressed. move on. Although not shown, if the key is not pressed, the key operation is waited (step U14).

  When another key is pressed, the control unit 22 performs other key processing, for example, display processing (details omitted) (step U15).

  When the shutter key 8 is pressed, the control unit 22 selects the image with the smallest amount of camera shake from the image at the moment when the shutter key 8 is pressed and the past consecutive images recorded within a predetermined time. The image is stored and recorded in a recording medium such as the memory card 28 (step U16), and the image selected in step U16 is reviewed and displayed on the liquid crystal monitor 5 (step U17).

  Next, the control unit 22 checks whether the camera shake correction function set in step U3 is on or off. If it is on, the process proceeds to step U19, and if it is off, the photographing process is terminated (step U18).

  When the shake correction function is on, the camera shake amount at that time is displayed together with the recorded image to be recorded, and the shooting process is ended by the end operation (step U19).

  The shooting control operation shown in the flowchart of FIG. 16 dynamically displays the blur amount history in a graph, so that it is possible to specifically check how much blur has occurred during shooting, and the image quality with the least blurring is good. Images can be automatically selected and saved and recorded. Further, since the image with the least blur and the preceding and following images can be compared and referred to by the respective blur amounts, it is possible to easily confirm how much blur image is taken with what blur.

<Modification>
The selection of the image with the least blurring performed when the shutter key 8 is depressed in step U3 of the flowchart shown in FIG. 16 is selected with priority given to the amount of blurring (recorded before the shutter key 8 is depressed within a predetermined time). The image with the smallest blur amount is selected from the past images that have been selected) or selected with priority to the timing (from the image with the blur amount less than the predetermined value at the time closest to the moment when the shutter key 8 is pressed). Alternatively, a photographed image may be preferentially selected) may be selected and set in advance in a setting mode or the like, and may be switched and selected according to the setting. Hereinafter, a description will be given with reference to FIG.

FIG. 17 is a flowchart illustrating a modification of photographing control of the digital camera according to the third embodiment.
In FIG. 17, when the power of the digital camera 100 is turned on, the control unit 22 performs the same processing as Step U1 to Step U13 of FIG. However, in step U3, in addition to setting of the shooting conditions and the camera shake display function, setting of whether to give priority to blur amount or timing priority based on user selection is performed (step V1).

  The control unit 22 checks whether or not the shutter key 8 has been pressed based on a signal from the key input unit 30, and proceeds to step V4 when the shutter key 8 is pressed, and to step V3 when any other key is pressed. move on. Although not shown, when a key is not pressed, a key operation is waited (step V2).

  When another key is pressed, the control unit 22 executes other key processing, for example, display processing (details omitted) (step V3).

  When the shutter key 8 is pressed, the control unit 22 checks whether the blur amount priority is set or the timing priority is set in step V13. If the blur amount priority is set, the process proceeds to step V6. If the timing priority is set, the process proceeds to step V5. Proceed (step V4).

  In the case of timing priority, the control unit 22 presses the shutter key 8 from the image at the moment when the shutter key 8 is pressed and the past continuous images taken within a predetermined time and the amount of blur is less than the predetermined value. The image taken at the time closest to the moment is selected and stored in a recording medium such as the memory card 28, and the process proceeds to Step V7 (Step V6).

  In the case of giving priority to the amount of shake, the control unit 22 selects the image with the smallest amount of shake from the image at the moment when the shutter key 8 is pressed and the past continuous images recorded within a predetermined time to select the memory card 28. The image selected in step V6 is reviewed and displayed on the liquid crystal monitor 5 (step V7), and the camera shake amount at that time is displayed (step V8).

  Next, the control unit 22 displays a message or a microcomputer that can select whether or not to perform confirmation display of other images and prompts the user to select, and the user performs confirmation display based on a signal from the key input unit 30. It is checked whether or not it is selected. If confirmation display is selected, the process proceeds to step V10, and if not, the photographing process is terminated (step V9).

  When the confirmation display is selected, the control unit 22 selects other images from the continuous images stored in the temporary storage memory according to the user's key operation, that is, images other than those automatically selected in step V5 or step V6. Are sequentially selected and displayed (step V10), and the amount of blur at the time when the image is taken is taken out of the temporary storage memory and displayed simultaneously (step V11).

  Next, the control unit 22 displays a message or a microcomputer that prompts the user to select whether or not to save and record the image selected and displayed in step V11, and prompts the user to make a selection. Based on the signal from the key input unit 30, the user It is checked whether or not the storage record is selected. If the storage record is selected, the process proceeds to Step V13, and if not, the photographing process is terminated (Step V12).

  When the storage record is selected, the control unit 22 stores and displays the displayed image and blur amount in the memory card 28, and ends the photographing process (step V13).

(Embodiment 4)
In the first to third embodiments, the camera itself does not perform camera shake correction, and the camera shake is steadily held by displaying the camera shake state in a graph. You may make it provide the camera-shake correction function which correct | amends automatically. Hereinafter, an example in which the digital camera 100 has a camera shake correction function (see the camera shake correction unit 32 in FIG. 2) will be described.

  In the present embodiment, the digital camera 100 includes a camera shake correction unit that automatically corrects the shake in addition to the camera shake detection unit 31 that detects the shake amount, and automatically corrects the shake detected by the camera shake detection unit 31.

  In the present embodiment, on / off of the blur correction function is switched at the time of switching the shooting mode or by setting in the setting mode, and when the blur correction is on, depending on the detected blur amount, a rotating mirror or the like The blur correction unit 32 configured as described above is driven to perform blur correction processing, and control is performed so as to record an image with corrected blur. When the blur correction function is off, the image at the moment when the shutter key 8 is pressed In addition, control is performed so that an image with the smallest amount of camera shake can be automatically selected and recorded from continuous images recorded by PAST shooting.

  FIG. 18 is a flowchart showing one embodiment of the photographing control of the digital camera according to the fourth embodiment. The processing shown below is basically executed by the control unit 22 in accordance with a program stored in advance in a program memory such as a flash memory. Is. An example in which the present invention is applied to the digital camera 100 shown in FIGS. 1 and 2 will be described below. Note that the on / off switching of the blur correction function is set at the time of switching the shooting mode or in the setting mode, but is performed in step W3 in the flowchart of FIG.

  In FIG. 18, when the power of the digital camera 100 is turned on, the control unit 22 first executes necessary initial setting processing such as clearing of the RAM, DRAM 21 and VRAM 24 and setting of built-in registers and the key input unit 30. Whether or not the shooting mode has been selected is checked based on the signal from step S3. If the shooting mode has been selected, the process proceeds to step W3. If another processing mode has been selected, the process proceeds to step W2 (step W1).

  When another processing mode is selected, the control unit 22 executes the selected processing mode (details omitted) (step W2).

When the shooting mode is selected, the control unit 22 sets on / off of the camera shake correction function based on the shooting conditions such as the exposure time or the focal length of the shooting lens and the user's selection (step W3), and performs photometry processing and white After executing the balance (WB) processing (step W4), the blur detection means 31 is controlled to start detection of image blur from the angular velocity sensor / piezoelectric vibration gyro or imaging signal (step W5). Let them be detected sequentially. The camera shake detection unit 31 detects the amount of shake (pitch, yaw, roll) before and after, right and left of the digital camera 100 and sends it to the control unit 22 at predetermined time intervals (step W6).
Next, zoom processing and autofocus (AF) processing are performed so that a predetermined focus area is in focus (step W7), and image data from the color process circuit 18 is temporarily stored in the DRAM 21 for captured images. In addition to storing the latest image in a storage memory (for example, the image circulation storage area 223 (FIG. 5)), the blur amount sent from the camera shake detection unit 31 is associated with the image data, and the blur amount temporary storage memory (for example, It is stored in the graph value circulation storage area 224 (FIG. 5)) (step W8).

  Next, the control unit 22 checks the capacity of the captured image temporary storage memory, and when the capacity of the captured image temporary storage memory is exceeded, that is, when the captured image temporary storage memory is full of captured images, the process proceeds to step W10. If not, the process proceeds to Step W11 (Step W9).

  When the capacity of the captured image temporary storage memory is exceeded, the control unit 22 sequentially deletes the oldest image stored in the captured image temporary storage memory. Similarly, the oldest blur amount stored in the blur amount temporary storage memory is sequentially deleted (step W10).

  Next, AE processing for a through image is executed at a focal length corresponding to the zoom value at that time, and a through image is displayed on the liquid crystal monitor 5 of the display unit 26 (step W11).

  Further, the current amount of camera shake detected by the camera shake detector 31 is superimposed on the through image and displayed on the liquid crystal monitor 5 (step W12).

  The control unit 22 checks whether or not the shutter key 8 has been pressed based on a signal from the key input unit 30, and proceeds to step W15 when the shutter key 8 is pressed, and to step W14 when any other key is pressed. move on. Although not shown, when a key is not pressed, a key operation is waited (step W13).

  When another key is pressed, the control unit 22 executes other key processing, for example, display processing (details omitted) (step W14).

  If the shutter key 8 has been pressed, it is checked in step W3 whether the blur correction function has been set to on. If it is on, the process proceeds to step W19, and if it is off, the process proceeds to step W16 (step W15).

  When the shake correction function is off, the control unit 22 executes autofocus (AF) processing again (step W16), performs shooting processing according to the shooting conditions set in step W3 (step W17), and the shutter. The image with the smallest amount of camera shake is selected from the image at the moment when the key 8 is pressed and the past continuous images recorded within a predetermined time, and is stored and recorded in a recording medium such as the memory card 28. Proceed (step W18).

  When the camera shake correction function is on, the control unit 22 calculates the camera shake correction amount based on the camera shake amount sent from the camera shake detection unit 31 (step W19), and controls the camera shake correction unit 32 to calculate the camera shake correction amount. Blur correction according to the correction amount is performed (step W20).

  Next, the control unit 22 executes autofocus (AF) processing again (step W21), performs shooting processing according to the shooting conditions set in step W3 (step W22), and stores the blur-corrected image in the memory. It is stored and recorded in a recording medium such as the card 28 (step 23).

  The control unit 22 displays an image to be stored and recorded on a recording medium such as the memory card 28 on the liquid crystal monitor 5 (step W24), displays the amount of camera shake at that time together with the recorded image, and performs an end operation. The photographing process is terminated (step W25).

  Through the control operation shown in the flowchart of step 18 above, the digital camera 100 does not turn on the blur correction even when the blur correction function is on, or when the blur-corrected image is not desired. In each case in any setting state (for the image stabilization function), even if the image was shot but the image was blurred, without being forced to turn on image stabilization automatically against the user's intention. Therefore, it is possible to obtain an image with good image quality with a small amount of blur. In any case, the captured image and the blur amount can be confirmed in association with each other.

(Embodiment 5)
In the present embodiment, as a display method other than the blur display method of the third embodiment or a blur warning method, an index of an allowable blur amount within the allowable blur according to the shooting condition or the print condition is displayed, or the digital camera 100 performs a camera shake. An example provided with a warning function (see warning output unit 33 in FIG. 2) in addition to the correction function will be described.

  FIG. 19 is a diagram showing an example of an acceptable blur display method within the allowable blur according to the shadow condition or the printing condition. FIG. 19A is an allowable value within the allowable blur according to the photographing condition or the printing condition. In this example, the detected blur amount and history data 193 are displayed together with the blur amount index lines 191 and 192. FIG. 19B is a limit index of the limit blur amount that can be corrected by the blur correction unit 32. This is an example showing the blur amount 197 and the history 198 detected together with the lines 194 and 195. In FIG. 19B, reference numeral 199 indicates a time point when a blur exceeding the correction limit occurs.

  As will be described later, the allowable blur amount can be calculated by calculating the allowable blur amount according to the photographing conditions such as the lens focal length and the exposure time, and the print paper size desired by the user. In addition, the calculated blur amount index value can be displayed. Furthermore, regardless of the printing paper, either the allowable blur amount when viewing from the diagonal distance or the allowable blur amount when viewing from the same clear viewing distance according to the print paper size is selected and set. be able to.

  In addition, when a shake amount warning function is provided, and the shake amount warning function is on and the shake correction function is set to off, a warning notification or warning is displayed when a shake that exceeds the permissible shake amount occurs. When the function is on and the blur correction function is set to on, control is performed so that warning notification / display is performed only when a blur amount that exceeds the limit of blurring that can be corrected is generated.

  In addition, an automatic on / off switching function for blur correction is provided, and when the detected blur amount exceeds the allowable blur amount, or when a predetermined statistical value such as the average value of the blur amount history within the predetermined time exceeds the allowable blur amount. The camera shake correction is automatically turned on and controlled.

FIG. 20 is a flowchart illustrating an example of shooting control of the digital camera according to the fourth embodiment. During PAST shooting, an allowable blur amount index display and a warning display according to shooting conditions and printing conditions are displayed. The control operation at the time of performing is shown.
The processing shown below is basically executed by the control unit 22 in accordance with a program stored in advance in a program memory such as a flash memory. An example in which the present invention is applied to the digital camera 100 shown in FIGS. 1 and 2 will be described below.

  In FIG. 20, when the power of the digital camera 100 is turned on, the control unit 22 first executes necessary initial setting processing such as clearing of the RAM, DRAM 21, and VRAM 24, setting of built-in registers, and the like, and the key input unit 30. Check whether the shooting mode is selected based on the signal from the camera, and if the shooting mode is selected, the camera shake warning function is based on the shooting conditions such as the exposure time or the focal length of the shooting lens and the user's selection. Then, on / off of the automatic on switching function of the blur correction function is set (step X1).

  Next, the control unit 22 displays a selection / setting screen in which the paper size and the observation method can be selected, prompts the user to select / set the paper size and the observation method, and the user selects and sets the printing conditions and the observation method. When this is done, the set value is held in the RAM (step X2).

  The control unit 22 examines the observation method selected / set in step X2, and if “observation from clear vision distance” is selected, the process proceeds to step X5, where “observation from the equivalent distance on the sheet diagonal” is selected. In this case, the process proceeds to Step X4 (Step X3).

  When observing from an equivalent distance of the paper diagonal, the allowable blur δ and the exposure time T are set at a constant viewing angle regardless of the paper size, and the process proceeds to Step X6 (the method of setting the allowable blur δ will be described later in “( 3) Refer to “Setting Allowable Blur and Allowable Blur According to Print Size”) (Step X4).

  When observing from a clear viewing distance, the allowable blur δ and the exposure time T are set according to the print paper size (for the setting method of the allowable blur δ and the like, “(3) Allowable blur and allowable according to print size” will be described later. (See “Setting of blur”) (Step X5).

  Next, the control unit 22 controls the blur detection unit 31 to start image blur detection from the angular velocity sensor / piezoelectric vibration gyro or the imaging signal (step X6), and sequentially detects the camera shake amount. The camera shake detection unit 31 detects the amount of shake (pitch, yaw, roll) before and after, right and left of the digital camera 100 and sends it to the control unit 22 at predetermined time intervals (step X7).

  Next, the control unit 22 executes zoom processing and autofocus (AF) processing so as to focus on a predetermined focus area, and acquires lens focal length information (step X8).

  The control unit 22 sets the allowable blur angle θp and the allowable blur angular velocity ωp according to the allowable blur δ and exposure time T [seconds] automatically set in step X4 or X5 and the focal length f acquired in step X8 ( For the setting method of the allowable blur angle θp and the like, see “(1) Setting method of allowable mark blur” described later) (step X9).

  Next, the control unit 22 stores the image data from the color process circuit 18 as a latest image in a captured image temporary storage memory (for example, the image circulation storage area 223 (FIG. 5)) secured on the DRAM 21. Then, the shake amount sent from the camera shake detection unit 31 is associated with the image data and stored in the shake amount temporary storage memory (for example, the graph value circulation storage area 224 (FIG. 5)) (step X10).

  The control unit 22 checks whether or not the shake warning function is set to ON in Step X1, and if it is set to ON, the process proceeds to Step X12. If it is not set to ON, the process proceeds to Step X21 (Step S21). X11).

  If the shake warning function is set to ON, the control unit 22 further checks whether or not the shake correction function is set to ON in Step X3. If it is set to ON, the control unit 22 proceeds to Step X18. If it is off, the process proceeds to Step X13 (Step X12).

  When the blur warning function is off, the control unit 22 displays the detected blur amount from the blur detection unit 31 on the display unit 26 together with the index of the allowable blur amount (step X13), and compares the detected blur amount and the allowable blur amount. If detected blur amount> allowable blur amount, the process proceeds to step X15, and if not, the process proceeds to step X21 (step X14).

  When the detected blur amount> the allowable blur amount, the control unit 22 controls the warning output unit 33 to output a warning sound or the like to notify the user of the occurrence of the blur exceeding the allowable blur amount. A warning message may be displayed instead of the warning output (step X15).

  Next, the control unit 22 checks whether or not the automatic on switching function of the shake correction function is set to ON in Step X1, and if it is set to ON, the process proceeds to Step X17, and if it is OFF, the process proceeds to X21. Proceed (step X16).

  If the automatic on switching function of the blur correction function is set to on, the control unit 22 switches on the blur correction function and proceeds to step X21 (step X17).

  When the shake warning function is ON, the control unit 22 displays the detected shake amount from the shake detection unit 31 on the display unit 26 together with a correctable blur amount index (step X18), and can correct the detected shake amount. If the detected blur amount is greater than the blur amount that can be corrected by comparing the blur amount, the process proceeds to step X20. Otherwise, the process proceeds to step X21 (step X19).

  When the detected blur amount> the correctable blur amount, the control unit 22 controls the warning output unit 33 to output a warning sound or the like to notify the user of the occurrence of the blur exceeding the correctable blur amount. A warning message may be displayed instead of the warning output (step X20).

  Thereafter, the same photographing control operation as the photographing processing after step W9 in FIG. 18 is performed (step X21).

By the control operation shown in the flowchart of FIG. 20, the digital camera 100 selects a desired print sheet when the focal length is changed by a zoom operation or the like or according to shooting conditions such as exposure conditions or illumination conditions. Depending on the print paper size, the allowable amount of blur that is not noticeable is calculated as an index and displayed along with the detected amount of blur, so the user can use this as a guide to check how much blur is allowed. You can take pictures and check the recordings.
In addition, according to automatic on / off switching of the shake correction function, the shake is corrected only in the case of the shake that is not really allowed according to the printing paper and shooting conditions, so that it is possible to prevent image quality deterioration due to unnecessary correction.

(1) Calculation method of allowable blur amount;
The allowable blur amount is determined according to the imaging size (diagonal) Y, or the allowable blur (permissible circle of confusion) δ according to the imaging size Y and the enlargement magnification to the printing paper, and the focus of the photographing lens. An angle of view corresponding to the allowable blur δ is obtained as an allowable angle θp according to the distance f. Further, an allowable blur angle ωp is calculated from the allowable blur angle θp and the set exposure time T [seconds] and displayed as an index value. That is, the field angle θ can be set as the field angle θ = tan −1 (Y / 2f) from the focal length f [mm] and the imaging size (diagonal) Y [mm].
Although the appearance and impression differ between blur and blur, if it is considered that the same size is acceptable, it can be set as an allowable blur angle θp = 2 × tan −1 (δ / 2f).
Permissible blur angular velocity ωp = allowable blur angle θp / exposure time T = 2 × tan −1 (δ / 2f) / T.

(2) Setting of limit blur amount that can be corrected;
The limit blur amount that can be corrected may be set in advance as a predetermined index value based on an angle range θp (max) that can be corrected by the correction optical system, an angular velocity amount ωp (max) that can be followed by responsiveness, and the like. it can.

(3) Setting of allowable blur and allowable blur according to print size;
The ability to distinguish small things with the human naked eye varies from person to person, but in general, the angle is about 1 minute (1 '). If the subject is continuously changing in tone, such as a photo, the angle will be a little looser for 2 to 3 minutes (2 'to 3'). It is said. Considering this as a reference, when observing a photograph or a printed image separated by a clear visual distance (about 25 cm), the allowable blur (allowable circle of confusion) δP on the printed image is δP [mm] = visible visual distance 250 [Mm] × tan (2 ′ to 3 ′) = 0.15 to 0.22 mm, and this size of blur is not recognized as blur by human eyes.
On the other hand, depending on the size of the photograph, for example, it may be natural to view it from a distance corresponding to the diagonal dimension of the photograph. On the basis of this, an 8-cut size (216 x 165 mm, diagonal size 271.8 mm) with a diagonal distance of 27 cm, which is close to the clear viewing distance, is allowed up to 0.2 mm, and a 35 mm film (36 x 24 mm, Assuming that the enlargement ratio from the corner 43.3 mm to the eight cut size is 6 times, the allowable blur of 35 mm size is 0.2 ÷ 6 = 0.033 mm. It is used as a Permissible Circle of Confusion. In this method, an allowable confusion circle diameter within a predetermined viewing angle (2 ′ to 3 ′) may be used according to the imaging size of an imaging element such as a film or a CCD, regardless of the printing paper size or the enlargement ratio. Although it is convenient for conversion, it is not always used in the same eight cuts, so with this conversion method, rougher focus and blur are allowed as the paper size and enlargement ratio are larger.
However, even when the paper size and enlargement ratio are large, focusing, blurring, and blurring may be noticeable when viewed close by posters or photo exhibitions, so it is inappropriate to determine the allowable blur based only on the viewing angle. In some cases, printing should be performed according to which paper is to be printed as viewed from the above-mentioned clear viewing distance. Therefore;

(3) -1: When viewed from an equivalent distance of printing paper size (diagonal) SP;
In this case, the allowable blur δP is δP = SP [mm] × tan (3 ′).
Since this is the image size Y expanded to the print paper size SP, it is divided by the enlargement ratio (= print paper size SP / image size Y) and converted to the image size (diagonal) Y [mm]. Then, the allowable blur δ on the imaging surface is
δ = (Y / SP) × SP × tan (3 ′)
Thus, it can be set according to the imaging size Y regardless of the printing paper size SP. Therefore, the allowable blur angle θp and the allowable blur angular velocity ωp in this case are
θp = 2 × tan −1 (δ / 2f) = 2 × tan −1 {Y × tan (3 ′) / 2f},
ωp = θp / T = 2 × tan −1 {Y × tan (3 ′) / 2f} / T
It becomes.

(3) -2: When viewing printing paper from a clear viewing distance (about 25 cm);
In this case, the allowable blur δP on the printing paper is δP = 250 [mm] × tan (3 ′).
Similarly, when this is converted into an imaging angle size (diagonal) Y [mm], the allowable blur δ on the imaging surface is δ = (Y / SP) × 250 [mm] × tan (3 ′), This can be set in accordance with the ratio between the imaging size Y and the printing paper size SP, or the reciprocal of the enlargement magnification.
Therefore, the allowable blur angle θp and the allowable blur angular velocity ωp in this case are
θp = 2 × tan −1 (δ / 2f) = 2 × tan −1 {Y / SP) × 250 [mm] × tan (3 ′) / 2f},
ωp = θp / T = 2 × tan −1 {(Y / SP) × 250 [mm] × tan (3 ′) / 2f} / T
It becomes.

  In the description of each of the above embodiments, a graph indicating the amount of camera shake is displayed when a through image is displayed. You may do it.

  In the description of each of the above embodiments, still image shooting is taken as an example, but the present invention can also be applied to moving image shooting. For example, in the moving image shooting mode, an operation program at the time of moving image shooting is configured so as to perform the same processing as steps S3 to S8 in FIG. 6 or steps T3 to T9 in FIG. The amount of camera shake can be displayed in time series on a part of the screen.

In addition, the present invention can be applied when shooting with pan and tilt operations. For example, an operation program is configured to perform the same processing as steps S3 to S8 in FIG. 6 or steps T3 to T9 in FIG. 11 between a panning or tilting operation and a shooting instruction, and a screen displaying a moving image is displayed. The amount of camera shake can be displayed in part in time series.

In the above description of each embodiment, the case where the present invention is applied to a digital camera is taken as an example. However, the scope of the present invention is not limited to a camera, and can be applied to a camera-equipped mobile phone or a camera-equipped portable information device. .
Further, a sub liquid crystal display unit may be provided to display a camera shake component. In particular, a camera-equipped mobile phone has a main display and a sub-display so that either a through image or a camera shake component may be displayed on one of them, or a through image and a shake component may be displayed separately on two displays. May be displayed.

  In the description of the flowchart of each self-viewing mode, the processing shown in each flowchart is basically described by an example in which the control unit 22 executes according to a program stored in a program memory such as a flash memory in advance. It is not necessary to store in the program memory, and it may be realized by receiving a part or all of the program memory via a network.

  As mentioned above, although several Example of this invention was described, it cannot be overemphasized that this invention is not limited to said each Example, A various deformation | transformation implementation is possible. For example, the term camera includes not only electronic cameras such as digital cameras but also silver halide cameras.

1 is an external view of a digital camera as an embodiment of a camera according to the present invention. It is a figure which shows one Example of the electronic circuit structure of the digital camera of FIG. It is a figure which shows one Example of the camera shake state display of a camera. It is explanatory drawing of the camera shake component of a camera. It is explanatory drawing of the circulating storage area of DRAM at the time of imaging | photography mode. 6 is a flowchart illustrating an example of a camera shake state display and image selection / recording operation of the digital camera. It is a figure which shows one Example of the camera-shake amount display of the selection image displayed after recording. It is a flowchart which shows the other Example of the camera shake state display of a digital camera, and image selection and recording operation | movement. It is explanatory drawing of the blur detection method of an image. It is explanatory drawing of a camera shake amount detection area | region. 6 is a flowchart illustrating an example of a camera shake state display and image selection / recording operation of the digital camera. 12 is a flowchart illustrating details of a camera shake amount calculation operation in FIG. 11. It is a figure which shows one Example of the camera shake state display of a camera. It is a figure which shows the example of a display of the historical data of blurring amount. It is a figure which shows the other display example of the log | history data of blurring amount. 12 is a flowchart illustrating an example of shooting control of a digital camera according to a third embodiment. 10 is a flowchart illustrating a modification example of shooting control of the digital camera according to the third embodiment. 10 is a flowchart illustrating an example of shooting control of a digital camera according to a fourth embodiment. It is a figure which shows one Example of the blurring display method which can be accept | permitted in the permissible blur according to a shadow condition or printing conditions. 10 is a flowchart illustrating an example of shooting control of a digital camera according to a fourth embodiment.

Explanation of symbols

5 LCD monitor screen (screen)
21 DRAM (temporary storage memory)
22 control unit (shooting instruction detection means, image storage means, camera shake detection value storage means, graph value acquisition means, camera shake amount acquisition means, camera shake amount storage means, graph value storage means, graph display means, image selection means, (Selected image recording means, selected image display means, photographing / recording control means, blur amount history data display control means, correction limit blur amount setting means, blur warning notification control means, allowable blur amount setting means, blur correction state switching means)
26 Display section (graph display means, image display means)
28 Memory card (recording memory, blur history recording means)
29 Internal memory (recording memory)
31 Camera shake detection unit (camera shake detection means, camera shake amount acquisition means, camera shake detection device)
32 Tobble correction unit (Tobble correction means)
33 Warning output unit 51 Subject 100 Digital camera (camera)
200 cameras

Claims (6)

Imaging means;
Camera shake state acquisition means for cyclically acquiring the state of camera shake during imaging;
Recording instruction detection means for detecting a recording instruction of an image captured by the imaging means;
When recording instructed by the recording instruction detecting means is detected, a plurality of images cyclically imaging before and after including the image captured by the imaging means, and, cyclically by the camera shake state acquisition device a temporary storage means for temporarily storing the shake history consisting of state of the acquired camera shake,
Display means for displaying the temporarily stored camera shake history and the plurality of images captured at a predetermined timing in the history after the storage by the temporary storage means ;
A recording unit for recording a plurality of images stored in the temporary storage unit including an image displayed on the display unit by detecting a recording instruction again after the recording instruction by the recording instruction detection unit;
A camera characterized by comprising The display means further displays an index indicating the timing at which the imaging means has captured a plurality of images in the camera shake history, and the display means among the plurality of images stored in the temporary storage means based on these indices. Further comprising selection detecting means for detecting selection of an image to be displayed;
The camera according to claim 1, wherein the recording unit records an image whose selection is detected by the selection detection unit. The camera according to claim 2 , wherein the image whose selection is detected by the selection detection unit is an image captured from the plurality of images at a timing at which a camera shake amount is small . The camera according to claim 2, wherein the image whose selection is detected by the selection detection unit is an image captured at a timing closest to a detection timing by the recording instruction detection unit. A camera shake state acquisition step for cyclically acquiring a camera shake state at the time of imaging;
A recording instruction detection step for detecting a recording instruction of an image captured by the imaging unit;
When a recording instruction is detected in this recording instruction detection step, a plurality of images cyclically imaged before and after that including the image captured by the imaging unit, and the camera shake state acquisition step A temporary storage step of temporarily storing in a temporary storage unit a camera shake history including a state of camera shake acquired in a cyclic manner;
After storing in the temporary storage step, a display step of causing the display unit to display a camera shake history stored in the temporary storage unit and a plurality of images captured at a predetermined timing in the history,
Recording that causes the recording unit to record a plurality of images stored in the temporary storage unit including the image displayed on the display unit by detecting the recording instruction again after the recording instruction in the recording instruction detection step Steps,
A method for recording and displaying a captured image, comprising: An information device computer comprising an imaging means, a temporary storage means, and a recording means,
A camera shake state acquisition means for cyclically acquiring a camera shake state at the time of imaging;
Recording instruction detection means for detecting a recording instruction of an image captured by the imaging means;
When the recording instruction is detected by the recording instruction detecting means, a plurality of images taken cyclically before and after that including the image taken by the imaging means, and the camera shake state obtaining means circulates Temporary storage control means for temporarily storing in the temporary storage means a camera shake history consisting of the state of camera shake acquired in
A display output means for displaying and outputting a camera shake history stored in the temporary storage means and images taken at a predetermined timing in the history after the storage by the temporary storage control means;
Recording control means for causing the recording means to record a plurality of images stored in the temporary storage means including the displayed image by detecting the recording instruction again after the recording instruction by the recording instruction detecting means. ,
A program characterized by functioning as

Images