JP2005339085A - Blur image correction device, blur image correction method, and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow an operator to precisely designate the direction and the degree of a blur by an easy operation for correcting the blur with high precision. <P>SOLUTION: In a blur correction window WD3, an image before correction and an image after correction by a blur correction routine are indicated. A graphic tool TL is superimposed onto the image before correction to be displayed. The graphic tool TL is operated through a mouse for allowing input of the direction and the degree of the blur. An original image has a display magnification higher than that of the image after correction and expanded to be displayed. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a technique for correcting camera shake of a photographed image obtained by photographing with a photographing device.

  When a subject is photographed with a digital camera (digital still camera) or the like, motion of the camera during exposure, that is, blur due to camera shake occurs in the photographed image. Various techniques have been developed in the past to avoid image degradation due to camera shake.

  For example, the camera is equipped with an acceleration sensor or the like for detecting the movement of camera shake, the detection signal of the sensor is converted into an image movement, and the camera optical system (prism, A technique for mechanically moving a lens or an imaging device) is known.

  On the other hand, a technique for correcting camera shake from an image without using an acceleration sensor or the like has also been proposed (for example, Patent Document 1 below).

JP 2000-298300 A

  However, the technique for correcting camera shake from the above-described image has a problem that it is impossible to correct camera shake with high accuracy. This is because it is difficult to accurately detect the direction and degree of camera shake from the image, and depending on the image, the camera shake cannot be corrected with high accuracy.

  The problem to be solved by the present invention is to make it possible to correct camera shake with high accuracy by allowing an operator to specify the direction and degree of camera shake by an accurate and simple operation.

  As means for solving at least a part of the problems described above, the following configuration is adopted.

The camera shake correction device of the present invention is
A camera shake correction device that corrects camera shake in a photographed image obtained by photographing with a photographing device,
A camera shake correction unit that receives an input of the direction and degree of the camera shake, and performs camera shake correction of the captured image based on the input;
A window representing the pre-correction image and the post-correction image by the camera shake correction means for the whole or a part of the photographed image is displayed on the display device, and an operation command using the input device from the operator for the window is accepted. Interface means, and
The interface means includes
A pre-correction image enlargement display means for displaying the pre-correction image at a higher display magnification than the post-correction image;
The captured image is displayed based on an operation command using an input device from an operator for the component while superimposing it on the uncorrected image displayed by the uncorrected image enlargement display means and displaying a predetermined graphics component. And a camera shake direction / degree input means for inputting the direction and the degree of camera shake for input to the camera shake correction means.

  According to the camera shake image correction apparatus having the above-described configuration, the image before correction and the image after correction by the camera shake correction unit are displayed in the window displayed on the display device. Therefore, the operator can compare both images. It is possible to easily determine whether or not the camera shake has been successfully corrected by the camera shake correcting means. In addition, by operating the graphics component displayed superimposed on the pre-correction image by the camera shake direction / degree input means, the operator inputs the direction and degree of the camera shake. Since the camera shake is corrected by the camera shake correcting means, the camera shake can be corrected according to the direction and degree of the camera shake input by the visual recognition of the operator. Further, since the display magnification of the pre-correction image is higher than that of the post-correction image, the operator can easily visually recognize the camera shake when operating the graphics component.

  Accordingly, it is possible to perform camera shake correction in accordance with the direction and degree of camera shake accurately input by the operator's operation, so that image shake can be corrected with high accuracy. Moreover, since it is easy for the operator to visually recognize the camera shake as described above, the operability at the time of input is excellent.

  The predetermined graphics component may be composed of three components: a start point, an end point, and a straight line connecting both.

  According to this configuration, the direction and degree of camera shake in the captured image can be represented by graphics components having a simple shape, so that the configuration is easy and the operation by the operator is easy.

  In the camera shake image correction apparatus having the above-described configuration, it includes a camera shake direction / degree detection unit that detects the direction and degree of the camera shake based on the captured image, and the interface unit is configured to display the window at the initial display time. The image processing apparatus may include a unit that displays the corrected image corrected by the camera shake correction unit based on the direction and level of the camera shake detected by the camera shake direction / level detection unit.

  According to this structure, the camera shake direction / degree detection means corrects camera shake by the camera shake correction means based on the direction and degree of camera shake automatically detected from the photographed image, and the initial position of the window. At the time of display, the corrected image can be displayed. For this reason, immediately after the initial display of the window, an automatically corrected image can be displayed.

  In the camera shake image correction apparatus configured to display the corrected image automatically corrected immediately after the initial display of the window, the camera shake direction / degree input means is configured to display the predetermined graphics component during the initial display of the window. The display may be configured to include means for determining the display based on the direction and degree of the camera shake detected by the camera shake direction / degree detection means.

  According to this configuration, the operator can know the direction and degree of camera shake automatically detected from the photographed image from the initial display by the camera shake direction / degree detection means. Based on the display, the graphics components can be operated. For this reason, it is further excellent in operability.

  The pre-correction image enlargement display means may be configured to increase the display magnification as the degree of camera shake detected by the camera shake direction / degree detection means is smaller.

  According to this configuration, when the degree of camera shake is small, the pre-correction image is displayed at a high display magnification. Therefore, it is much easier for the operator to visually recognize the camera shake from the pre-correction image. In addition, it is possible to more easily input the direction and degree of camera shake using graphics components for the pre-correction image.

  The camera shake direction / degree detection means includes a pixel shake detection means for detecting the direction and degree of camera shake for each pixel of the photographed image, and a degree of camera shake detected by the pixel shake detection means. Edge detection means for detecting the largest edge portion, and camera shake determination means for determining the direction and degree of camera shake of the edge portion detected by the edge detection means to be the direction and degree of camera shake of the entire captured image; It can be set as the structure provided with.

  According to this configuration, camera shake correction is performed based on the direction and degree of camera shake at the edge portion where the degree of camera shake is greatest in the captured image. For this reason, it is possible to improve the accuracy of automatic camera shake correction of a captured image.

  In the image correction apparatus having the above-described configuration, the pre-correction image enlargement display unit may be configured to enlarge and display a region including at least the edge portion detected by the edge detection unit.

  According to this configuration, it is easy for the operator to perform operations using graphics components on the pre-correction image.

  Further, the camera shake direction / degree input means may be configured to display the predetermined graphics component on the edge portion displayed by the pre-correction image enlargement display means.

  According to this configuration, since the predetermined graphics component can be displayed on the edge portion where the degree of camera shake is the largest, an operation using the graphics component for the pre-correction image by the operator can be performed. Even easier.

  In the camera shake image correcting apparatus having the above-described configuration, the camera shake correcting means includes a filter setting means for setting a motion blur filter for applying motion blur based on the input direction and degree of the camera shake, and the set Filter calculation means for performing arithmetic processing on the captured image using a motion blur filter, image difference calculation means for calculating a difference between the captured image and an image obtained by the filter calculation means, and the captured image By combining the difference with respect to the image, it is possible to provide an image synthesizing unit that generates, as the corrected image, an image that is blurred in the direction opposite to the camera shake direction with respect to the captured image.

  According to this configuration, the camera shake correction unit can correct the camera shake with higher accuracy based on the input direction and degree of the camera shake.

The image stabilization method of the present invention is
A camera shake image correction method for correcting camera shake of a photographed image obtained by photographing with a photographing device,
(A) a process of receiving an input of the direction and degree of the camera shake, and performing a camera shake correction of the captured image based on the input;
(B) A window representing the pre-correction image and the post-correction image in the step (a) for all or a part of the photographed image is displayed on the display device, and an operation for the window using an input device from the operator And a process for receiving a command,
The step (b) is:
(B-1) a step of displaying the uncorrected image at a display magnification higher than that of the corrected image;
(B-2) A predetermined graphics component is displayed by being superimposed on the pre-correction image displayed in the step (b-1), and based on an operation command using an input device from the operator for the component. And a step of inputting the direction and degree of camera shake of the photographed image for input to the step (a).

The computer program of the present invention is:
In a computer program for correcting camera shake of a photographed image obtained by photographing with a photographing device,
(A) a function of receiving an input of the direction and degree of the camera shake and executing a camera shake correction of the captured image based on the input;
(B) A window representing the pre-correction image and the post-correction image by the function (a) for the whole or a part of the photographed image is displayed on the display device, and the operation using the input device from the operator for the window In addition to realizing the function to accept commands in a computer,
The function (b) is
(B-1) a function of displaying the pre-correction image at a higher display magnification than the post-correction image;
(B-2) A predetermined graphics component is displayed superimposed on the pre-correction image displayed by the function (b-1), and based on an operation command using an input device from the operator for the component. And a function of inputting the direction and degree of camera shake of the photographed image for input to the function (a).

  According to the camera shake image correction method and computer program of the present invention, as in the camera shake image correction apparatus of the present invention, the direction and degree of camera shake are accurately input by the operation of the operator, and high-precision camera shake correction is performed. In addition, there is an effect that the input operability is also excellent.

  The recording medium of the present invention is characterized by a computer-readable recording medium that records the computer program of the present invention. This recording medium has the same operation and effect as each computer program of the present invention.

  The present invention includes other aspects as follows. The 1st aspect is an aspect as a program supply apparatus which supplies the computer program of this invention via a communication path. In this first aspect, the above-described method and apparatus are realized by placing a computer program on a server or the like on a computer network, downloading a necessary program to a computer via a communication path, and executing the program. Can do.

The best mode for carrying out the present invention will be described based on examples. This embodiment will be described in the following order.
A. Device configuration:
B. Computer processing:
B-1. Overall processing:
B-2. Image stabilization processing:
B-2-1. Automatic correction:
B-2-2. Manual correction:
C. Action / Effect:
D. Other embodiments:

A. Device configuration:
FIG. 1 is an explanatory diagram showing a schematic configuration of a computer system to which an embodiment of the present invention is applied. The computer system of this embodiment mainly includes a personal computer 10 constituting the camera shake image correction apparatus of the present invention, and includes a display 20, a keyboard 22, and a mouse 24 as peripheral devices. Furthermore, a digital camera 26, a CD drive 28, and a printer 29 are connected to the personal computer 10. The keyboard 22 and the mouse 24 correspond to an input device that receives an operation from an operator in the present invention. The display 20 is a display device according to the present invention. The mouse 24 can be replaced with other pointing devices such as a trackball, a trackpad, and a tablet.

  The personal computer 10 includes a memory 13, a display image memory 14, a hard disk drive 15, an input control unit 16, a display control unit 17, an output control unit 18, and the like that are mutually connected by a bus 12 around a CPU 11 as a central processing unit. Is provided. The memory 13 stores various data and becomes a work area of the CPU 11. The display image memory 14 is a memory that temporarily stores image data of an image to be displayed on the display 20.

  The hard disk drive 15 stores a computer program Pr as software for the camera shake correction device. The hard disk drive 15 stores one or more image data Dp. The image data Dp is image data of a captured image taken by the digital camera 26 and is stored in a predetermined area (for example, a holder) of the hard disk drive 15. The captured image is a color image.

  The input control unit 16 is a control unit that captures input operations from the keyboard 22 and the mouse 24, captures image data from the digital camera 26, and captures data from the CD drive 28. The display control unit 17 is a control unit that controls signal output to the display 20. The output control unit 18 is a control unit that controls printing on the printer 29.

  The computer program Pr is originally stored in a CD-ROM (not shown) as a recording medium. The computer program Pr can be read from the CD-ROM and installed in the hard disk drive 15 by setting the CD-ROM in the CD drive 28 and starting a predetermined installation program. When the CPU 11 executes this computer program Pr, various constituent requirements of the camera shake image correction apparatus of the present invention are realized.

  In FIG. 1, various constituent requirements are indicated by functional blocks implemented in the CPU 11. That is, the CPU 11 includes a camera shake correction unit 30 and an interface unit 32 as functions. The interface unit 32 includes a pre-correction image enlargement display unit 32a and a camera shake direction / degree input unit 32b. This computer program Pr is actually an application program for photo retouching that modifies a photographed image photographed by the digital camera 26, and the functions of the units 30 and 32 described above are given to the personal computer 10 by some of the modules therein. make it happen.

  The computer program Pr is provided as a configuration stored in another portable recording medium (portable recording medium) such as a flexible disk, a magneto-optical disk, and an IC card in place of the CD-ROM. It can be. Further, the computer program Pr can be provided via a network from a specific server connected to an external network. The network may be the Internet or a computer program obtained by downloading from a specific homepage. Alternatively, it may be a computer program supplied in the form of an email attachment.

B. Computer processing:
B-1. Overall processing:
When the computer program Pr is started, an application window is first displayed on the display 20. This application window constitutes a graphical user interface (GUI).

  FIG. 2 is an explanatory diagram showing an example of the application window WD. As shown in the figure, in the process menu column MN on the left side of the application window WD, four types of buttons BT1, BT2, BT3, and BT4 of [Input], [Modify], [Print], and [Output] are directed downward. The operator clicks these buttons BT1 to BT4 with the mouse 24 in order, and captures and modifies the captured image captured by the digital camera 26 on the screen of the CRT display 12, You can proceed with output.

  First, the operator clicks the [Input] button BT1 to perform processing for capturing the image data Dp from the hard disk drive 15. Here, instead of the hard disk drive 15, it is possible to change to a configuration for capturing image data directly from the digital camera 26 or a configuration for capturing image data from another storage medium such as a DVD. The captured image data Dp is displayed in the work field FDW of the application window WD.

  Thereafter, the operator clicks the [Modify] button BT2 to modify the captured image data Dp. FIG. 2 shows the case where the [Modify] button BT2 is clicked. As shown in the figure, the menu bar MB of the application window WD is provided with buttons such as [File], [Course menu], [Edit], [Display], [Modify], [Repair / Process]. By clicking the [Modify] button, the image data Dp can be rotated or trimmed, and color correction such as brightness and saturation can be performed. In the figure, a pull-down menu DM that opens when the [Repair / Process] button is clicked is shown. The operator can perform “camera shake correction”, “blur correction”, etc. on the image data Dp by clicking the “Repair / Processing” button and clicking a desired option from the pull-down menu DM. it can.

B-2. Image stabilization processing:
B-2-1. Automatic correction:
The above “camera shake correction” relates to the present invention. The camera shake correction process that is executed when the “camera shake correction” option in the pull-down menu DM is clicked will be described in detail below.

  FIG. 3 is a flowchart showing camera shake correction processing executed by the CPU 11. When the processing is started by clicking the [Camera shake correction] option in the pull-down menu DM, the CPU 11 first performs processing for displaying the [Specify region of interest] window WD1 on the display 20 (step S100). .

  FIG. 4 is an explanatory diagram showing an example of the [Specify Region of Interest] window WD1. As shown in the figure, the “designation of attention area” window WD1 is provided with an image display field FD1, an “designation of area” button BT11, an “enlargement” button BT12, and a “reduction” button BT13.

  In the image display field FD1, the image data Dp displayed in the work field FDW of the application window WD is displayed. At the start of display, the display magnification is adjusted and the entire image of the image data Dp is displayed.

  The “enlarge” button BT12 is a switch for enlarging the image displayed in the image display field FD1. When the “enlarge” button is clicked, “display enlargement mode” is entered, and when the mouse cursor is moved over the image, the shape of the mouse cursor changes. By clicking in this state, the image is enlarged in units of 10%. can do. The position clicked at the same time is set at the center of the image display field FD1.

  The “reduction” button BT13 is a switch for reducing the image displayed in the image display field FD1. When the “Reduce” button is clicked, “Display reduction mode” is entered. When the mouse cursor is moved over the image, the shape of the mouse cursor changes. By clicking in this state, the image is reduced by 10%. can do. The position clicked at the same time is set at the center of the image display field FD1.

  In the example shown in FIG. 4, as a result of clicking the “reduction” button BT13 and performing the operation as described above, the image data Dp is reduced to a desired magnification, and the corners of the piano in the photographed image are The image is displayed so as to be positioned at the center of the image display field FD1.

  [Region designation] button BT11 is a switch for designating a region of interest (hereinafter referred to as “region of interest”) with respect to the captured image displayed in image display field FD1. When the “Region Designation” button BT11 is clicked, the “Region Designation Mode” is entered, and the region of interest can be designated by a rectangle whose diagonal line is a straight line connecting the start point and the end point by dragging on the photographed image.

  FIG. 5 is an explanatory diagram showing an example of the [Specify Region of Interest] window WD1 after the attention region SA has been designated. As shown in the drawing, the attention area SA is designated by a rectangular line segment with respect to the image displayed in the image display field FD1. The operator can specify a desired region on the photographed image displayed in the image display field FD1 by clicking the [Region Designation] button BT11 and then performing a drag operation. In the example shown in the drawing, the attention area SA is designated around the corner of the piano shown in the photographed image. This is because camera shake is easily detected at the boundary of an area having a large difference in density value (tone value) from the surroundings, such as a corner of a piano, that is, an edge portion, so that it is easy to detect camera shake. . The process of designating this attention area SA is step S110 in FIG.

  Thereafter, when the [OK] button BT14 is clicked in the [Specify Region of Interest] window WD1, the [Specify Region of Interest] window WD1 is closed, and the CPU 11 proceeds to the subsequent step S120 as shown in FIG. To proceed. In step S120, the data of the area surrounded by the attention area SA designated in step S110 is extracted as the attention image data GS. When the [OK] button BT14 is clicked in a state where the attention area SA is not designated by the operator, the entire image data Dp is set as the attention image data GS.

  Thereafter, the CPU 11 executes a camera shake direction / degree detection routine for detecting the direction θ1 and the degree m1 of the camera shake for the target image indicated by the target image data GS (step S130).

  FIG. 6 is a flowchart showing details of the camera shake direction / degree detection routine. As shown in the figure, when the processing shifts to this routine, the CPU 11 first sets a value 0 to each of the variable m1 and the variable θ1 as an initial setting (step S131). Next, the CPU 11 performs a process of selecting one pixel constituting the target image data GS extracted in step S120 as one target pixel (step S132). Next, the CPU 11 performs a filter calculation process using a horizontal Sobel filter on a 3 × 3 region of 3 pixels in the vertical direction and 3 pixels in the horizontal direction centering on the target pixel ( Step S133).

  FIG. 7 is an explanatory diagram illustrating a horizontal Sobel filter. The horizontal Sobel filter is a 3 × 3 filter having 3 pixels in the vertical direction and 3 pixels in the horizontal direction, and a weighting coefficient for each pixel is determined as shown in the figure.

  Specifically, in step S133, a filter calculation process is performed such that the 3 × 3 region centered on the pixel of interest is multiplied by the coefficients indicated by the horizontal Sobel filter and the results are summed. This total value is Th.

  Returning to FIG. 6, after execution of step S133, the CPU 11 performs vertical sobel for a 3 × 3 region of 3 pixels in the vertical direction and 3 pixels in the horizontal direction around the target pixel selected in step S131. A filter calculation process using a (Sobel) filter is executed (step S134).

  FIG. 8 is an explanatory view showing a vertical Sobel filter. The vertical Sobel filter is a 3 × 3 filter having 3 pixels in the vertical direction and 3 pixels in the horizontal direction, and a weighting coefficient for each pixel is determined as shown in the figure.

  In step S134, in detail, a filter calculation process is performed such that the 3 × 3 region centered on the target pixel is multiplied by the coefficient indicated by the vertical Sobel filter, and the results are summed. Let this total value be Tv.

  After execution of step S134, the CPU 11 performs processing for calculating the edge direction θ and the degree m of the target pixel from the total values Th and Tv obtained by the filter calculation processing of step S133 and step S134 (step S135). FIG. 9 is an explanatory diagram showing the relationship between the total values Th and Tv and the edge direction θ and the degree m. As shown in the figure, a vector α, which is the sum of the total values Th and Tv, is obtained by vector calculation, and the direction θ and the length m of the vector α are set to the edge direction θ and the degree m of the target pixel.

  Returning to FIG. 6, after executing step S135, the CPU 11 determines whether or not the degree m obtained in step S135 is larger than the variable m1 (step S136). If it is determined that the value is large, the degree m is substituted for the variable m1, and the edge direction θ obtained in step S135 is substituted for the variable θ1 (step S137). That is, when the degree m becomes larger than the previous value, the degree m and the direction θ are stored in m1 and θ1. After executing step S137, the CPU 11 advances the process to step S138. On the other hand, if it is determined in step S136 that the degree m is equal to or less than the variable m1, the CPU 11 proceeds to step S138 without executing step S137.

  In step S138, the CPU 11 determines whether or not the processing in steps S132 to S137 has been completed for all the pixels of the target image data GS. If not, the CPU 11 moves the pixel to the next pixel in step S132. Steps S133 through S137 are repeated. On the other hand, if it is determined in step S138 that the processing for all the pixels has been completed, the process returns to “RETURN” and the processing of this routine is temporarily ended.

  According to the camera shake direction / degree detection routine configured as described above, the edge direction θ1 and the degree m1 of the pixel having the maximum edge degree are obtained in the target image data GS.

  Returning to FIG. 3, when the camera shake direction / degree detection routine is exited, the CPU 11 advances the process to step S <b> 140. In step S140, the CPU 11 executes a camera shake correction routine for the target image data GS extracted in step S120.

  FIG. 10 is a flowchart showing details of a camera shake correction routine for the target image data GS. As shown in the figure, when the processing shifts to this routine, the CPU 11 first calculates a motion blur filter based on the edge direction θ1 and the degree m1 calculated in the camera shake direction / degree detection routine. Processing is performed (step S141). The motion blur filter is a filter that applies “motion blur” to an image, and the coefficient of the filter is determined according to the input of the direction of motion and the degree of blur. That is, the relationship of the following equation (1) is established between the motion direction θ and the degree m and the motion blur filter F1.

F1 = F (θ, m) (1)
Here, F is a function for obtaining a motion blur filter.

  Therefore, in step S141, the “motion direction θ” is set to the edge direction θ1 calculated in the camera shake direction / degree detection routine, and the “motion degree m” is calculated in the camera shake direction / degree detection routine. As the edge degree m1, the motion blur filter F1 is calculated from the relationship of the above formula (1).

  FIG. 11 is an explanatory diagram illustrating an example of a motion blur filter. The motion blur filter F1 is a 3 × 3 filter having three pixels in the vertical direction and three pixels in the horizontal direction, and a weighting coefficient for each pixel is determined as illustrated.

  Returning to FIG. 10, after execution of step S141, the CPU 11 executes filter calculation processing using the motion blur filter F1 on the target image data GS (step S142). More specifically, as in the camera shake direction / degree detection routine, a target pixel is selected from the target image data GS, and the 3 × 3 pixel having three pixels in the vertical direction and three pixels in the horizontal direction around the target pixel. An area is extracted, and a filter calculation process using a filter, here, a motion blur filter F1 is performed on the 3 × 3 area. Convert tone values. This series of processing is performed for all the pixels of the target image data GS by sequentially switching the target pixel. The new image data obtained in this way is referred to as blurred image data GS *.

  Subsequently, the CPU 11 calculates the difference DS between the two by subtracting the blurred image data GS * obtained in step S142 from the target image data GS extracted in step S120 (step S143). Specifically, the difference DS between the image data GS and GS * is calculated by subtracting the gradation value for each RGB of the target image data GS and the blurred image data GS * for each pixel.

  Thereafter, the CPU 11 adds the difference DS calculated in step S143 to the target image data GS extracted in step S120 to generate new image data (step S144). More specifically, the image data GS and the difference DS are added to the gradation value for each RGB for each pixel, thereby performing an operation for synthesizing the data GS and DS.

  FIG. 12 is an explanatory diagram conceptually showing the processing content according to the camera shake correction routine for the target image data GS. In the figure, the hatched portion is a predetermined portion in the target image GS, and here, the corner portion of the piano is schematically shown. The image part of this part includes a blurred part due to camera shake. The camera shake direction θ1 and the degree m1 are automatically detected by the camera shake direction / degree detection routine, and the vector V in the drawing indicates the camera shake direction θ1 and the degree m1. According to steps S141 and S142, motion blurring is performed with the direction θ1 and the length m1 of the vector V. Therefore, the lower boundary line of the corner of the piano moves to the position of the one-dot chain line in the figure. A blurred image GS * having this one-dot chain line as a boundary is generated.

  According to step S143, by subtracting the blurred image GS * from the target image GS, the difference DS between the two images is obtained as shown in the figure. In step S144, the difference DS is added to the target image GS (vector V Since the difference DS takes a negative value when the direction of is a positive direction), it is possible to remove from the target image GS the amount of motion blur due to camera shake. As a result, as shown by the two-dot chain line in the figure, new image data TGS without camera shake can be generated. In the image data TGS obtained in this way, camera shake is corrected with high accuracy. Hereinafter, the image data TGS is referred to as “corrected noticed image data”.

  Returning to FIG. 10, after executing step S <b> 144, the process returns to “RETURN”, and the process of this routine is temporarily terminated.

  Returning to FIG. 3, when the camera shake correction routine for the target image data GS is exited, the CPU 11 advances the process to step S150. In step S150, the CPU 11 performs processing for displaying the [Image Stabilization] window WD2.

  FIG. 13 is an explanatory diagram showing an example of the [Image Stabilization] window WD2. As shown in the figure, the [Image Stabilization] window WD2 is provided with an [Original Image] display field FD11 and a [After Correction] display field FD12. In the upper part of the [After Correction] display field FD12, a [Display in accordance with window] button BT21, a [100% display] button BT22, a [10% reduction display] button BT23, and a [10% enlargement display] button BT24 are provided. ing. Below, an [OK] button BT25 and a [Manual correction] button BT26 are provided.

  In the [original image] display field FD11, the attention image data GS extracted in step S120 is displayed. In the [after correction] display field FD12, the corrected attention image data TGS obtained by the camera shake correction routine for the attention image data GS is displayed. Both image data GS and TGS are displayed at the same position and display magnification automatically calculated from the size of the image of interest and the sizes of both display fields FD11 and FD12, and are configured to be easily compared by the operator. .

  When the [Fit to window] button BT21 is clicked, the display magnification is calculated so that the entire image is displayed in the [original image] / [after correction] display fields FD11 and FD12. Images in the display fields FD11 and FD12 are displayed. When the [100% display] button BT22 is clicked, both images are displayed such that one pixel of the display 20 and one pixel of the image data are 1: 1. When the [10% reduction display] button BT23 is clicked, the current display magnification of both images is reduced by 10% and displayed. When the “10% enlarged display” button BT24 is clicked, the current display magnification of both images is enlarged by 10% and displayed.

  [OK] button BT25 accepts a click from the operator when the operator determines that the corrected image displayed in [After correction] display field FD12 is good. On the other hand, the [Manual correction] button BT26 accepts a click from the operator when the operator determines that the corrected image is not possible. When the [Manual correction] button BT26 is clicked, Camera shake correction can be performed manually by an operator.

  Returning to FIG. 3, when the [Image Stabilization] window WD2 having the above-described configuration is displayed in Step S150, the CPU 11 advances the process to Step S160, and the operation command from the operator is displayed by the [OK] button. Processing is performed to determine which of BT25 and [Manual Correction] button BT26 is to be clicked. If it is determined that the [OK] button BT25 is clicked, camera shake correction processing is executed on the image data Dp that is the subject of camera shake correction (step S170).

  Specifically, the camera shake correction process in step S170 is based on the camera shake direction θ1 and the degree m1 detected in the camera shake direction / degree detection routine in step S130. The direction is corrected using the direction θ1 of the camera shake and the degree m1. That is, in the “camera shake correction routine for the target image data GS” shown in FIG. 10, the camera shake correction process is performed in which the processing target is the image data Dp instead of the target image data GS. The new image data obtained in this way is output as corrected image data in which camera shake is corrected. After the execution of step S170, the process returns to “return” and “camera shake correction processing” ends.

  On the other hand, if it is determined in step S160 that the [manual correction] button BT26 is clicked, the CPU 11 executes a manual correction routine (step S180), and then returns to “return” to “camera shake correction”. The process is terminated.

B-2-2. Manual correction:
FIG. 14 is a flowchart showing details of the manual correction routine. As shown in the figure, when the process shifts to this routine, the CPU 11 first performs a process of displaying the [Manual Correction] window WD3 by the processes of Steps S181 to S184.

  FIG. 15 is an explanatory diagram showing an example of the [Manual Correction] window WD3. As shown in the figure, the [Manual correction] window WD3 is provided with an [Original image] display field FD21 and an [After correction] display field FD22. [100% display] buttons BT31 and BT41, [10% reduction display] buttons BT32 and BT42, and [10% enlargement display] buttons BT33 and BT43 are provided above the display fields FD21 and FD22, respectively. ing. An [OK] button BT45 is provided below. [Angle] edit box BX1 and [Length] edit box BX2 are provided.

  In the [original image] display field FD21, the attention image data GS extracted in step S120 is displayed. In the [after correction] display field FD22, the corrected target image data TGS obtained by the camera shake correction routine for the target image data GS is displayed. The image data GS and TGS displayed in both display fields FD21 and FD22 are the same as those in the above-described [Image Stabilization] window WD2 (FIG. 13), but the display magnification is different from that in the [Image Stabilization] window WD2. To do.

  In the [Manual Correction] window WD3, during initial display, the target image data GS (original image) displayed in the [Original Image] display field FD21 is the corrected target image data displayed in the [After Correction] display field FD22. The display magnification is higher than TGS (corrected image). This display magnification is determined based on the hand movement degree m1 detected by the hand movement direction / degree detection routine in step S130.

  FIG. 16 is a graph showing the relationship between the degree m1 of camera shake and the display magnification R. As shown in the figure, the smaller the degree of camera shake m1, the higher the display magnification R.

  In step S181 in FIG. 14, the CPU 11 displays an image serving as a base of the [Manual Correction] window WD3 in a state where no image is displayed in the [Original Image] display field FD21 and the [After Correction] display field FD22. Thereafter, in step S182, the CPU 11 obtains the display magnification R based on the camera shake degree m1 detected by the camera shake direction / degree detection routine, the size of the target image, and the size of the [original image] display field FD21. Thus, the attention image data GS is displayed in the [original image] display field FD21 with the display magnification R. As described above, the relationship between the camera shake level m1 and the display magnification R is such that the smaller the camera shake level m1 is, the higher the display magnification R is. As for the display position, the center of the target image data GS is positioned at the center of the [original image] display field FD21, and the outside portion that cannot be displayed with the display magnification R is naturally not displayed.

  As for the display position, instead of the above configuration, the pixel (edge portion) having the maximum edge degree having the edge direction θ1 and the degree m1 detected by the camera shake direction / degree detection routine is set to [original The image] display field FD21 can be arranged in the center. Further, instead of this configuration, the pixel having the maximum edge degree having the edge direction θ1 and the degree m1 may be arranged at any position in the [original image] display field FD21.

  After execution of step S182, the CPU 11 displays the corrected target image data TGS obtained by the camera shake correction routine for the target image data GS in the [after correction] display field FD22 (step S183). The display magnification in this display is determined based on the size of the image of interest and the size of the [after correction] display field FD22. As described above, the display magnification is displayed in the [original image] display field FD21. The display magnification is lower than the original image to be displayed.

  The display magnification of the image displayed in the [original image] display field FD21 is changed from the initial display state to [100% display] buttons BT31 and [10%] arranged above the [original image] display field FD21. It can be freely changed by operating the reduced display button BT32 and the 10% enlarged display button BT33. When the [100% display] button BT31 is clicked, the original image is displayed so that one pixel of the display 20 and one pixel of the image data are 1: 1, and the [10% reduction display] button BT32 is clicked. Then, the current display magnification of the original image is reduced by 10%, and when the [10% enlargement display] button BT33 is clicked, the current display magnification of the original image is enlarged by 10% and displayed.

  The display position can be changed by operating the slider bars SB1 and SB2 provided on the right side and the lower side of the [original image] display field FD21 to scroll the image.

  On the other hand, the display magnification of the image displayed in the [after correction] display field FD22 is also changed from the initial display state to [100% display] buttons BT41 and [10%] arranged above the [after correction] display field FD22. It can be freely changed by operating the “reduced display” button BT42 and the “10% enlarged display” button BT43. When the [100% display] button BT41 is clicked, the corrected image is displayed so that one pixel of the display 20 and one pixel of the image data are 1: 1, and the [10% reduction display] button BT32 is clicked. Then, the current display magnification of the corrected image is reduced by 10%, and when the [10% enlargement display] button BT33 is clicked, the current display magnification of the corrected image is enlarged by 10% and displayed. Is done.

  The display position can be changed by scrolling the image by operating the slider bars SB3 and SB4 provided on the right side and the lower side of the [after correction] display field FD22.

  Returning to FIG. 14, after executing step S183, the CPU 11 performs a process of superimposing the original image displayed in the [original image] display field FD21 to display the graphics tool TL (step S184).

  FIG. 17 is an explanatory diagram enlarging the periphery of the graphics tool TL. As shown in the figure, the graphics tool TL is composed of three parts: a cross-shaped mark MK1 indicating the start point, a cross-shaped mark MK2 indicating the end point, and a straight line LN connecting the two. When the [Manual Correction] window WD3 is initially displayed, the graphics tool TL has a direction and a length determined according to the direction θ1 and the degree m1 of the camera shake detected by the camera shake direction / degree detection routine. Specifically, the start point mark MK1 is displayed at the center of the target image data GS (that is, the center of the [original image] display field FD21), and the angle and degree corresponding to the direction θ1 with respect to the mark MK1. An end point mark MK2 is displayed at a position determined from a distance corresponding to m1, and a straight line LN connecting the position of the mark MK1 and the position of the mark MK2 is displayed.

  Note that the display of the start point mark MK1 at the time of initial display can be changed to another position instead of the center of the target image data GS. For example, in the above-described configuration in which the pixel having the maximum edge direction having the edge direction θ1 and the degree m1 detected by the camera shake direction / degree detection routine is displayed in the [original image] display field FD21, this pixel The mark MK1 of the starting point at the time of initial display can be displayed at the position.

  The graphics tool TL can be changed in direction, length, and position in response to an operation of the mouse 24 by the operator. Specifically, when the mouse cursor is moved on the start point mark MK1 or the end point mark M2, the shape of the mouse cursor changes to a predetermined shape (for example, a shape such as “← →”), and dragging in this state is performed. Thus, the position of the start point mark MK1 or the end point mark M2 can be changed. When the mouse cursor is moved on the straight line LN, the shape of the mouse cursor changes to a predetermined shape (for example, a cross shape). By dragging in this state, the graphic relationship is maintained while maintaining the positional relationship between the start point and the end point. The entire stool TL can be moved.

  By operating the graphics tool TL as described above, the operator changes the direction and length of the graphics tool TL while comparing with the actual “blur” on the original image. In step S185 in FIG. 14, a process of accepting an operation on the graphics tool TL is performed. Thereafter, the CPU 11 performs processing for obtaining the direction and length of the graphics tool TL as the direction θ2 and the degree m2 of the hand-shake manually input by the operator (step S186).

  FIG. 18 is an explanatory diagram showing the direction θ2 and the degree m2 of camera shake specified by the graphics tool TL. As shown in the figure, the direction θ2 of camera shake is indicated by a clockwise angle from the reference line with the horizontal direction facing right from the start point mark MK1 as a reference line. This is indicated by the distance between the mark MK1 and the end point mark MK2, that is, the length of the straight line LN. It should be noted that the reference line and the direction in which the camera shake direction θ2 is determined are merely examples. Instead, the other direction is the reference line, and the direction θ2 is counterclockwise (counterclockwise). It can also be set as the structure which determines.

  As described above, the operator can specify the direction θ2 and the degree m2 of the camera shake by operating the graphics tool TL. However, in this embodiment, the operator further designates the [Manual Correction] window WD3. The direction [theta] 2 and the degree m2 of camera shake can also be specified by the provided [angle] edit box BX1 and [length] edit box BX2.

  Returning to FIG. 14, after the execution of step S186, the CPU 11 executes the “camera shake correction routine for the target image data GS” using the camera shake direction θ2 and the degree m2 obtained in step S186 (step S187). The camera shake correction routine for the target image data GS is the one shown in FIG. 10 described above. Here, the motion blur filter calculated in step S141 is about m2 and the direction θ2 of the camera shake obtained in step S186. Based on. That is, the motion blur filter F2 is calculated according to the following equation (2).

F2 = F (θ2, m2) (2)
Here, F is a function for obtaining a motion blur filter.

  Thereafter, filter operation is performed using the motion blur filter F2 to obtain the blurred image data GS *, the difference DS between the noticed image data GS and the blurred image data GS * is obtained, and the noticed image data GS is added to the difference DS. As a result, the corrected attention image data TGS that has undergone camera shake correction is generated.

  When the processing in step S187 is thus completed, the CPU 11 changes the display of the [after correction] display field FD22 by using the corrected target image data TGS obtained in step S187 (step S188).

  Thereafter, the CPU 11 determines whether or not the [OK] button BT45 of the [Manual Correction] window WD3 is clicked (Step S189). The [OK] button BT45 is clicked by the operator when it is determined by the operator that the corrected image displayed in the [After Correction] display field FD22 is good. If it is determined that BT45 has not been clicked, the process returns to step S185 to redo the camera shake correction process, and the camera shake direction θ2 and the degree m2 are set using the graphic tool TL of steps S185 to S188. Repeat the change process.

  On the other hand, if it is determined in step S189 that the [OK] button BT45 has been clicked, the corrected image displayed in the [after correction] display field FD22 is determined to be good, and the process proceeds to step S190. A camera shake correction process is performed on the image data Dp that is the object of camera shake correction.

  More specifically, in the camera shake correction process in step S190, the camera shake direction θ2 and the degree m2 calculated in step S186 are set as the camera shake direction of the entire image data Dp to be subjected to camera shake correction. Correction is performed using θ2 and about m2. That is, in the “camera shake correction routine for the target image data GS” shown in FIG. 10, the motion blur filter F2 is obtained based on the direction θ2 and the degree m2 of the camera shake, and the processing target is set as the target image data GS. Instead, camera shake correction processing using the image data Dp is performed. The new image data obtained in this way is output as corrected image data in which camera shake is corrected. After execution of step S190, the process returns to “RETURN” and the routine is temporarily terminated.

  The interface unit 32 (FIG. 1) is configured by the manual correction routine configured as described above and the CPU 11 that executes the manual correction routine. The camera shake correction unit 30 includes a CPU 11 and a camera shake correction routine that is called in step S187 and the like. The pre-correction image enlargement display unit 32a provided in the interface unit 32 corresponds to step S182, and the camera shake direction / degree input unit corresponds to steps S184 to S186.

C. Action / Effect:
According to the computer system of this embodiment configured as described above, an image before correction and an image after correction by the camera shake correction routine are displayed in the [Manual correction] window WD3 displayed on the display 20. By comparing the two images, the person can easily determine whether or not the camera shake has been successfully corrected by the camera shake correction routine. In addition, by operating the graphics tool TL displayed superimposed on the original image (pre-correction image), the operator inputs the direction and degree of camera shake, and based on this input, the camera shake correction routine Since the camera shake is corrected, the camera shake can be corrected according to the direction and degree of the camera shake inputted by the visual recognition of the operator. Further, since the display magnification of the original image is higher than that of the corrected image, the operator can easily see the camera shake when operating the graphics tool TL.

  Accordingly, it is possible to perform camera shake correction in accordance with the direction and degree of camera shake accurately input by the operator's operation, so that image shake can be corrected with high accuracy. Moreover, since it is easy for the operator to visually recognize the camera shake as described above, the operability at the time of input is excellent.

  In this embodiment, the graphics tool TL is composed of three parts: a start point mark MK1, an end point mark MK2, and a straight line LN connecting the two. For this reason, since the direction and degree of camera shake in the captured image can be represented by graphics parts having a simple shape, the configuration is easy and the operation by the operator is easy.

  In this embodiment, camera shake correction is performed by the camera shake correction routine based on the camera shake direction θ1 and degree m1 automatically detected by the camera shake direction / degree detection routine, and the [Manual Correction] window WD3 is used. In the initial display, the corrected image is displayed. For this reason, immediately after the initial display of the [Manual Correction] window WD3, a corrected image that has been automatically corrected can be displayed.

  Further, at the initial display of the [Manual Correction] window WD3, the display of the graphics tool TL is determined based on the hand shake direction θ1 and degree m1 automatically detected by the hand shake direction / degree detection routine. ing. Therefore, the operator can operate the graphics tool TL based on this initial display. Therefore, the operability when inputting the direction and degree of camera shake is further improved.

  In this embodiment, the original image displayed in the [Manual Correction] window WD3 is configured to increase the display magnification as the degree m1 of the camera shake automatically detected by the camera shake direction / degree detection routine is smaller. ing. For this reason, when the degree of camera shake is small, the pre-correction image is displayed at a high display magnification, so that the operator can more easily visually recognize camera shake from the original image, and It is possible to more easily input the direction and degree of camera shake using the graphics tool TL for the pre-correction image.

  In this embodiment, the camera shake direction / degree detection routine is configured to obtain the edge direction θ1 and the degree m1 of the pixel having the maximum edge degree in the target image data GS. For this reason, camera shake correction is performed based on the direction and degree of camera shake at the edge portion where the degree of camera shake is the largest in the captured image. Therefore, it is possible to improve the accuracy of automatic camera shake correction of the captured image.

D. Other embodiments:
The present invention is not limited to the above-described embodiments and modifications, and can be carried out in various modes without departing from the gist of the present invention. For example, the following modifications are possible. is there.

(1) In the above embodiment, the original image displayed in the [Image Stabilization] window WD2 and the [Manual Correction] window WD3 is the attention image data GS trimmed from the image data Dp. Alternatively, the image data Dp may be displayed as it is.

(2) In the above-described embodiment, the graphics tool TL for inputting the direction and degree of camera shake is composed of three parts: a start point mark MK1, an end point mark MK2, and a straight line LN connecting the two. However, other shapes such as an arrow may be used instead. In short, any shape can be used as long as the tool can input the direction and length.

(3) In the camera shake direction / degree detection routine of the previous embodiment, the direction and degree of camera shake are detected using a Sobel filter. However, the present invention is not limited to this method. You may comprise so that the direction and grade of a blur may be detected.

(4) In the above-described embodiment, the camera shake correction routine for performing the camera shake correction is configured to perform the camera shake correction by performing the motion blur by filtering using the motion blur filter. In short, any configuration may be used as long as it receives an input of the direction and degree of camera shake and corrects camera shake based on the input.

(5) In the above embodiment, the image data Dp as a target for correcting camera shake was taken by the digital camera 26. It may be data. In short, any configuration may be used as long as a captured image obtained by capturing with some imaging device (for example, a video camera having a still image capturing function) is acquired. For example, instead of a device prepared in advance in a storage device such as the HDD 15, a device imported from the outside via a network may be used. Further, it is not always necessary to use color image data, and can be applied to monochrome image data.

It is explanatory drawing which shows schematic structure of the hardware of the computer system to which one Example of this invention is applied. It is explanatory drawing which shows an example of application window WD. It is a flowchart which shows the camera-shake correction process performed by CPU11. It is explanatory drawing which shows an example of the [designation of attention area] window WD1. It is explanatory drawing which shows an example of the [designation of attention area] window WD1 after designation of attention area SA. 10 is a flowchart showing details of a camera shake direction / degree detection routine. It is explanatory drawing which shows a horizontal direction Sobel filter. It is explanatory drawing which shows a vertical direction Sobel filter. It is explanatory drawing which shows the relationship between total value Th and Tv, edge direction (theta), and degree m. It is a flowchart which shows the detail of the camera-shake correction routine about attention image data GS. It is explanatory drawing which shows an example of the motion blur filter F1. It is explanatory drawing which shows notionally the processing content according to the camera-shake correction routine about attention image data GS. It is explanatory drawing which shows an example of the [camera shake correction] window WD2. It is a flowchart which shows the detail of a manual correction routine. It is explanatory drawing which shows an example of the [manual correction] window WD3. It is a graph which shows the relationship between the extent m1 of camera shake, and the display magnification R. It is explanatory drawing which expanded the periphery of graphics tool TL. It is explanatory drawing which shows direction (theta) 2 and the degree m2 of camera shake designated by graphics tool TL.

Explanation of symbols

10 ... Personal computer 11 ... CPU
12 ... Bus 13 ... Memory 14 ... Display image memory 15 ... Hard disk drive 16 ... Input control unit 17 ... Display control unit 18 ... Output control unit 20 ... Display 22 ... Keyboard 24 ... Mouse 26 ... Digital Camera 28 ... CD Drive 29 ... Printer 30 ... Image Stabilizer 32 ... Interface 32a ... Enlarged Display before Correction 32b ... Shake direction / degree input part Pr ... Computer program F1, F2 ... Motion blur filter WD ... Application window FD1 ... Image display field FDW ... Work field SA ... Attention Area GS ... attention image data TGS ... corrected attention image data WD1 ... [Specify attention area] window WD2 ... [Image stabilization] window FD11 ... [original image] display field FD1 2. [After correction] display field BT26 ... [Manual correction] button WD3 ... [Manual correction] window FD21 ... [Original image] display field FD22 ... [After correction] display field TL. ..Graphics tool MK1 ... mark MK2 ... mark LN ... straight line θ1, θ2 ... direction of camera shake m1, m2 ... degree of camera shake

Claims (18)

A camera shake correction device that corrects camera shake in a photographed image obtained by photographing with a photographing device,
A camera shake correction unit that receives an input of the direction and degree of the camera shake, and performs camera shake correction of the captured image based on the input;
A window representing the pre-correction image and the post-correction image by the camera shake correction means for the whole or a part of the photographed image is displayed on the display device, and an operation command using the input device from the operator for the window is accepted. Interface means, and
The interface means includes
A pre-correction image enlargement display means for displaying the pre-correction image at a higher display magnification than the post-correction image;
The captured image is displayed based on an operation command using an input device from an operator for the component while superimposing it on the uncorrected image displayed by the uncorrected image enlargement display means and displaying a predetermined graphics component. A camera shake image correction apparatus comprising: a camera shake direction / degree input means for inputting the direction and the degree of camera shake for input to the camera shake correction means. The camera shake image correction apparatus according to claim 1,
A camera shake image correction apparatus in which the predetermined graphics component is constituted by three components: a start point, an end point, and a straight line connecting both. The camera shake image correction device according to claim 1 or 2,
A camera shake direction / degree detection means for detecting the direction and degree of the camera shake based on the captured image;
The interface means includes
A camera shake unit provided with means for displaying the corrected image corrected by the camera shake correction unit based on the direction and level of the camera shake detected by the camera shake direction / level detection unit during the initial display of the window; Image correction device. The camera shake image correction apparatus according to claim 3,
The hand shake direction / degree input means is:
A camera shake correction apparatus comprising: means for determining the display of the predetermined graphics component based on the direction and degree of the camera shake detected by the camera shake direction / degree detection means at the time of initial display of the window. The camera shake image correction apparatus according to claim 3 or 4,
The pre-correction image enlargement display means includes
A camera shake image correction apparatus configured to increase the display magnification as the degree of camera shake detected by the camera shake direction / degree detection unit is smaller. The camera shake image correction apparatus according to any one of claims 3 to 5,
The hand shake direction / degree detection means is:
Each pixel camera shake detection means for detecting the direction and degree of camera shake for each pixel of the captured image;
Edge detecting means for detecting an edge portion having the largest degree of camera shake detected by each pixel camera shake detecting means;
A camera shake image correction apparatus comprising: a camera shake determination unit that determines a direction and a degree of camera shake of the edge portion detected by the edge detection unit as a direction and a level of camera shake of the entire captured image. The camera shake image correction apparatus according to claim 6,
The pre-correction image enlargement display means includes
A camera shake image correction apparatus configured to enlarge and display a region including at least an edge portion detected by the edge detection means. The camera shake image correction apparatus according to claim 7,
The hand shake direction / degree input means is:
A camera shake image correction apparatus configured to display the predetermined graphics component on the edge portion displayed by the pre-correction image enlargement display unit. The camera shake image correction apparatus according to any one of claims 1 to 8,
The camera shake correction means includes:
Filter setting means for setting a motion blur filter for applying motion blur based on the input direction and degree of hand shake;
Using the set motion blur filter, filter arithmetic means for performing arithmetic processing on the captured image;
Image difference calculation means for calculating a difference between the captured image and the image obtained by the filter calculation means;
A camera shake image correction comprising: an image composition unit configured to generate, as the post-correction image, an image that is blurred in the direction opposite to the camera shake direction with respect to the captured image by combining the difference with the captured image. apparatus. A camera shake image correction method for correcting camera shake of a photographed image obtained by photographing with a photographing device,
(A) a process of receiving an input of the direction and degree of the camera shake, and performing a camera shake correction of the captured image based on the input;
(B) A window representing the pre-correction image and the post-correction image in the step (a) for all or a part of the photographed image is displayed on the display device, and an operation for the window using an input device from the operator And a process for receiving a command,
The step (b) is:
(B-1) a step of displaying the uncorrected image at a display magnification higher than that of the corrected image;
(B-2) A predetermined graphics component is displayed by being superimposed on the pre-correction image displayed in the step (b-1), and based on an operation command using an input device from the operator for the component. And a step of inputting a direction and a degree of camera shake of the photographed image for input to the step (a). In a computer program for correcting camera shake of a photographed image obtained by photographing with a photographing device,
(A) a function of receiving an input of the direction and degree of the camera shake and executing a camera shake correction of the captured image based on the input;
(B) A window representing the pre-correction image and the post-correction image by the function (a) for the whole or a part of the photographed image is displayed on the display device, and the operation using the input device from the operator for the window In addition to realizing a function to accept commands on a computer,
The function (b) is
(B-1) a function of displaying the pre-correction image at a higher display magnification than the post-correction image;
(B-2) Superimposed on the pre-correction image displayed by the function (b-1) to display a predetermined graphics component and based on an operation command using an input device from the operator for the component And a function for inputting the direction and degree of camera shake of the photographed image for input to the function (a). A computer program according to claim 11,
A computer program in which the predetermined graphics part is composed of a start point, an end point, and a straight line connecting the two. A computer program according to claim 11 or 12,
(C) a function of detecting the direction and degree of the camera shake based on the recorded image;
The function (b) is
A computer program having a function of displaying the corrected image corrected by the function (a) based on the direction and degree of the camera shake detected by the camera shake direction / degree detection means at the time of initial display of the window . A computer program according to claim 13,
The function (b-2) is
A computer program having a function of determining display of the predetermined graphics component based on the direction and degree of the camera shake detected by the function (c) at the time of initial display of the window. A computer program according to claim 13 or 14,
The function (b-1) is
A computer program configured to increase the display magnification as the degree of camera shake detected by the function (c) is smaller. A computer program according to any one of claims 13 to 15,
The function (c) is:
(C-1) a function of detecting the direction and degree of camera shake for each pixel of the captured image;
(C-2) a function of detecting an edge portion having the largest degree of camera shake detected by the function (c-1);
(C-3) A computer program comprising: a function for determining the direction and degree of camera shake of the edge portion detected by the function (c-2) as the direction and degree of camera shake of the entire photographed image. A computer program according to any one of claims 11 to 16,
The function (a) is:
(A-1) a function of setting a motion blur filter for applying motion blur based on the input direction and degree of hand shake;
(A-2) a function of performing arithmetic processing on the captured image using the set motion blur filter;
(A-3) a function for calculating a difference between the captured image and the image obtained by the function (a-2);
(A-4) A computer having a function of generating, as the corrected image, an image that is blurred on the opposite side of the direction of camera shake with respect to the captured image by combining the difference with the captured image. program.   The computer-readable recording medium which recorded the computer program in any one of Claim 11 thru | or 17.

Images