JP2007295373A - Image processing device, method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing device which can produce a comparatively good image using a correction signal produced based on a trajectory of deviance in an optical axis, even in shooting a moving photographic subject relatively to a background; and further to provide its method and its program. <P>SOLUTION: The image processing device includes an imaging element 11 which produces an image signal carrying an image of the photographic subject when the photographic subject is shot, an amplifier 12 which amplifies the image signal, a deviance trajectory detection circuit 18 which detects the trajectory of the deviance in the optical axis of a lens when the photographic subject is shot, a correction signal generating circuit 19 which generates a correction signal based on the trajectory of the deviance in the optical axis of the lens, an amplitude control circuit 20 which regulates amplitude of the correction signal, and a correction arithmetic circuit 14 which practices image processing of the image signal amplified using the correction signal whose amplitude has been regulated. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, an image processing method, and an image processing program that correct an image according to blurring of an optical axis.

  As shown in FIG. 10, the conventional image processing apparatus includes an imaging device 1 that generates a video signal showing an image of a subject, an amplification circuit 2 that amplifies the video signal and generates an amplified video signal, An analog-to-digital conversion circuit (hereinafter simply referred to as an A / D conversion circuit) 3 that generates a digital video signal from the amplified video signal, and white balance processing or interpolation processing (when the image sensor 1 is a single plate) on the digital video signal Is necessary to perform interpolation processing to secure each RGB data for each pixel), an image buffer memory 5 for storing a plurality of frames of digital image data, and an image of the first captured frame A position shift detection circuit 6 for comparing the digital image data with the digital image data of a plurality of frames captured thereafter and detecting a position shift on the image of the subject; A switch 8 for switching the memory area in which the digital image data is stored, and a CPU7 for correcting the digital image data on the basis of the positional deviation of the image of the subject (e.g., see Patent Document 1) for each.

  With reference to FIGS. 11A to 11G, the operation of the conventional image processing apparatus will be described.

  As shown in FIG. 11A, when generating an image of one frame at the exposure time t, it is assumed that the optical axis moves from L1 to L2 and a positional shift of the subject on the image occurs by the width W1. On the other hand, as shown in FIG. 11B, when a four-frame image is generated at an exposure time t / 4, the optical axis moves from L3 to L7, and the position on the subject image by a width W2 for each frame. Assume that a deviation occurs.

As compared in FIGS. 11A and 11B, if the exposure time is shortened, the positional deviation of the subject on the image can be suppressed to ¼, but if the exposure time is shortened, the signal level is lowered to ¼. Therefore, it is amplified by a factor of 4, and 4 frames of digital image data are stored in the image buffer memory 5. On the other hand, a position shift on the subject image is detected from the four frames of digital image data read from the image buffer memory 5, and one frame digital image data in which the position shift on the subject image is corrected is generated. .
JP 2004-266648 A

  However, the conventional image processing apparatus has a problem that when one frame of digital image data is generated from four frames of digital image data in which the positional relationship of the subject with respect to the background is different, the image is blurred four times.

  The present invention has been made to solve the conventional problems, and an image processing apparatus, an image processing method, and an image processing apparatus capable of generating a relatively good image even with a subject moving with respect to the background. An image processing program is provided.

  When the subject is imaged through a lens, the image processing apparatus of the present invention includes a video signal generating unit that generates a video signal showing an image of the subject, an amplifying unit that amplifies the video signal, and the subject , A blur locus detecting means for detecting a deviation locus of the optical axis of the lens, a correction signal generating means for producing a correction signal based on the deviation locus of the optical axis of the lens, and the amplitude of the correction signal And a correction calculation means for executing image processing of the amplified video signal using the correction signal whose amplitude has been adjusted.

  With this configuration, it is possible to generate a relatively good image with the correction signal generated based on the deviation locus of the optical axis.

  In the image processing apparatus of the present invention, the amplitude control unit adjusts the amplitude of the correction signal based on a gain by which the video signal is amplified.

  With this configuration, a relatively good image can be generated without visually conspicuous noise.

  The image processing apparatus of the present invention has a configuration in which the amplitude control means decreases the amplitude of the correction signal as the gain at which the video signal is amplified increases.

  With this configuration, even a dark subject image can generate a relatively good image without visually conspicuous noise.

  The image processing apparatus of the present invention includes a light / dark ratio detection unit that detects a light / dark ratio for each pixel of the image, and the amplitude control unit adjusts the amplitude of the correction signal based on the light / dark ratio. ing.

  With this configuration, it is possible to generate a relatively good image without visually conspicuous noise even at a location where there is little change in brightness.

  The image processing apparatus of the present invention has a configuration in which the amplitude control means decreases the amplitude of the correction signal as the brightness ratio decreases.

  With this configuration, it is possible to generate a relatively good image without visually conspicuous noise even at a location where there is little change in brightness.

  The image processing apparatus of the present invention has a configuration in which the amplitude control means reduces the amplitude of the correction signal when the gain at which the video signal is amplified is large and the contrast ratio is small.

  With this configuration, it is possible to generate a relatively good image without making noise visually noticeable even in a dark subject image where there is little change in brightness.

  In the image processing apparatus of the present invention, the relationship between the gain at which the video signal is amplified and the amplitude of the correction signal is defined by a function, and the amplitude control means determines the gain and the function at which the video signal is amplified. Based on this, the amplitude of the correction signal is adjusted.

  With this configuration, the amplitude of the correction signal can be calculated from the gain by which the video signal is amplified.

  The image processing apparatus of the present invention has a configuration in which the slope of the function is negative.

  With this configuration, it is possible to generate a correction signal having a small amplitude when the gain at which the video signal is amplified is large, and a correction signal having a large amplitude when the gain at which the video signal is amplified is small.

  The image processing apparatus according to the present invention further includes a light / dark ratio detecting unit that detects a light / dark ratio for each pixel of the image, wherein a relationship between the light / dark ratio and the amplitude of the correction signal is defined by a function, and the amplitude control is performed. The means has a configuration for adjusting the amplitude of the correction signal based on the light / dark ratio and the function.

  With this configuration, the amplitude of the correction signal can be calculated from the light / dark ratio.

  The image processing apparatus of the present invention has a configuration in which the slope of the function is positive.

  With this configuration, it is possible to generate a correction signal having a small amplitude at a location where the change in brightness is large, and a correction signal having a large amplitude at a location where the change in brightness is small.

  In the image processing apparatus of the present invention, a window including adjacent pixels is defined for each pixel of the image, and the brightness / darkness ratio detecting unit is configured to determine the maximum and minimum luminance values in the window for each pixel of the image. It has a configuration for calculating the light / dark ratio by value.

  With this configuration, the amplitude of the correction signal can be adjusted for each pixel with the light / dark ratio calculated for each pixel.

  In the image processing apparatus of the present invention, the correction calculation unit adds the correction signal to the video signal.

  With this configuration, it is possible to emphasize a portion where the change in brightness is large.

  The image processing method of the present invention includes a video signal generation step for generating a video signal showing an image of the subject when the subject is imaged through a lens, an amplification step for amplifying the video signal, and the subject A blur locus detecting step for detecting a shift locus of the optical axis of the lens, a correction signal generating step for generating a correction signal based on the shift locus of the optical axis of the lens, and an amplitude of the correction signal And a correction calculation step for executing image processing of the amplified video signal using the correction signal whose amplitude has been adjusted.

  With this configuration, it is possible to generate a relatively good image with the correction signal generated based on the deviation locus of the optical axis.

  The image processing method of the present invention has a configuration in which the amplitude control step adjusts the amplitude of the correction signal based on a gain by which the video signal is amplified.

  With this configuration, a relatively good image can be generated without visually conspicuous noise.

  The image processing method of the present invention has a configuration in which, in the amplitude control step, the amplitude of the correction signal is reduced as the gain at which the video signal is amplified increases.

  With this configuration, even a dark image can generate a relatively good image without visually conspicuous noise.

  The image processing method of the present invention includes a light / dark ratio detection step for detecting a light / dark ratio for each pixel of the image, and the amplitude control step has a configuration for adjusting the amplitude of the correction signal based on the light / dark ratio. ing.

  With this configuration, it is possible to generate a relatively good image without visually conspicuous noise even at a location where there is little change in brightness.

  The image processing method of the present invention has a configuration in which the amplitude of the correction signal is reduced as the light / dark ratio is reduced in the amplitude control step.

  With this configuration, it is possible to generate a relatively good image without visually conspicuous noise even at a location where there is little change in brightness.

  In the image processing method of the present invention, the amplitude control step has a configuration in which the amplitude of the correction signal is reduced when the gain for amplifying the video signal is large and the contrast ratio is small.

  With this configuration, it is possible to generate a relatively good image without visually conspicuous noise even at a location where there is little change in brightness.

  In the image processing method of the present invention, the relationship between the gain at which the video signal is amplified and the amplitude of the correction signal is defined as a function. In the amplitude control step, the gain at which the video signal is amplified and the amplitude The amplitude of the correction signal is adjusted based on a function.

  With this configuration, the amplitude of the correction signal can be calculated from the gain by which the video signal is amplified.

  The image processing method of the present invention has a configuration in which the slope of the function is negative.

  With this configuration, it is possible to generate a correction signal having a small amplitude when the gain at which the video signal is amplified is large, and a correction signal having a large amplitude when the gain at which the video signal is amplified is small.

  The image processing method of the present invention further includes a light / dark ratio detection step for detecting a light / dark ratio for each pixel of the image, wherein a relationship between the light / dark ratio and the amplitude of the correction signal is defined as a function, and the amplitude control is performed. In the step, the amplitude of the correction signal is adjusted based on the light / dark ratio and the function.

  With this configuration, the amplitude of the correction signal can be calculated from the light / dark ratio.

  The image processing method of the present invention has a configuration in which the slope of the function is positive.

  With this configuration, it is possible to generate a correction signal having a small amplitude at a location where the change in brightness is large, and a correction signal having a large amplitude at a location where the change in brightness is small.

  In the image processing method of the present invention, a window including adjacent pixels is defined for each pixel of the image, and in the light / dark ratio detection step, the maximum value of the luminance in the window is determined for each pixel of the image. The light / dark ratio is calculated with the minimum value.

  With this configuration, the amplitude of the correction signal can be adjusted for each pixel with the light / dark ratio calculated for each pixel.

  The image processing method of the present invention has a configuration in which the correction signal is added to the video signal in the correction calculation step.

  With this configuration, it is possible to emphasize a portion where the change in brightness is large.

  The image processing program according to the present invention includes a correction signal generation unit that generates a correction signal based on a blur locus and an amplitude control unit that adjusts the amplitude of the correction signal based on a gain by which the video signal is amplified. And a correction calculation means for performing image processing of the video signal using the correction signal whose amplitude has been adjusted.

  With this configuration, it is possible to generate a relatively good image with a correction signal generated based on the shift locus of the optical axis in the computer.

  Further, the image processing program of the present invention includes a video signal acquisition step for acquiring a video signal, a gain acquisition step for acquiring a gain obtained by amplifying the video signal, and a blur locus acquisition step for acquiring a blur locus. A correction signal generating step for generating a correction signal based on the blur locus, an amplitude control step for adjusting the amplitude of the correction signal based on a gain obtained by amplifying the video signal, and a correction signal with the amplitude adjusted And a correction calculation step for executing image processing of the video signal.

  With this configuration, it is possible to generate a relatively good image with a correction signal generated based on the shift locus of the optical axis in the computer.

  The present invention provides a video signal generating means for generating a video signal showing an image of a subject when the subject is imaged through a lens, an amplifying means for amplifying the video signal, and a lens when the subject is imaged. A blur locus detecting means for detecting a deviation locus of the optical axis, a correction signal generating means for generating a correction signal based on the deviation locus of the optical axis of the lens, an amplitude control means for adjusting the amplitude of the correction signal, and an amplitude of And a correction calculation unit that executes image processing of the video signal amplified using the adjusted correction signal, thereby generating a relatively good image with the correction signal generated based on the deviation locus of the optical axis. It is possible to provide an image processing apparatus having an effect of being able to be performed.

  Hereinafter, an image processing apparatus according to an embodiment of the present invention will be described with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing the configuration of the image processing apparatus according to the first embodiment of the present invention.

  As shown in FIG. 1, the image processing apparatus includes an image pickup device 11 that generates a video signal indicating an image of a subject when the subject is imaged through a lens, an amplification circuit 12 that amplifies the video signal, A gain control circuit 17 that controls the gain by which the video signal is amplified, an A / D conversion circuit 13 that converts the amplified video signal from analog to digital and generates a digital video signal, and when a subject is imaged, A blur locus detection circuit 18 that detects a deviation locus of the optical axis of the lens, a correction signal generation circuit 19 that generates a correction signal based on the deviation locus of the optical axis of the lens, and an amplitude control circuit 20 that adjusts the amplitude of the correction signal. A correction arithmetic circuit 14 that performs image processing of the digital video signal using the correction signal whose amplitude is adjusted, and signal processing such as gamma correction and edge enhancement on the video signal (the image sensor 11 is a single plate). In this case, a signal processing circuit 15 that executes interpolation processing for securing RGB data for each pixel), an image display unit 16 that displays an image represented by the signal-processed digital video signal on the screen, and It has.

  The amplitude control circuit 20 acquires the gain at which the video signal is amplified from the gain control circuit 17, and adjusts the amplitude of the correction signal based on the gain at which the video signal is amplified.

  Further, as shown in FIG. 2, the relationship between the gain at which the video signal is amplified and the amplitude of the correction signal is defined by a linear function, for example, and the amplitude control circuit 20 is based on the gain and function at which the video signal is amplified. Thus, the amplitude of the correction signal is adjusted. The slope of this function is negative, and the amplitude of the correction signal is reduced as the gain at which the video signal is amplified increases.

  In this embodiment, the relationship between the gain at which the video signal is amplified and the amplitude of the correction signal is defined as a function. However, as the gain at which the video signal is amplified increases, the amplitude of the correction signal is reduced, and noise is reduced. Define the function so that it doesn't stand out.

  The correction arithmetic circuit 14 adds a correction signal to the digital video signal.

  Next, operations of the image processing apparatus according to the first embodiment of the present invention will be described with reference to FIGS.

  When the optical axis is blurred, it is generally known that the high-frequency component of the point spread function is attenuated. Filter processing with the inverse characteristic of the point spread function is performed, and the high-frequency component of the attenuated point spread function is reduced. A correction apparatus is disclosed in Japanese Patent Application Laid-Open No. 59-75040. Japanese Patent Application Laid-Open No. 59-75040 discloses a filter characteristic for recovering high frequency components.

  When the optical axis is blurred, the image sensor 11 outputs a video signal (see FIG. 3B) having a gentler gradient than the video signal when the optical axis is not blurred (see FIG. 3A). Is done. Next, digital image data is generated by the A / D conversion circuit 13 from the video signal amplified by the amplifier circuit 12.

  In particular, since the video signal when the subject is imaged in a dark place has a small amplitude, is amplified with a large gain, and noise is also amplified, the correction signal generated from the video signal (see FIG. 3C) Noise is also noticeable.

  When a correction signal containing a large amount of high frequency components (see FIG. 3C) is added to the video signal (see FIG. 3B), noise becomes conspicuous as in the video signal (see FIG. 3D). Therefore, the amplitude of the correction signal is adjusted using the gain obtained by amplifying the video signal.

  In particular, since the video signal when the subject is imaged in a dark place has a small amplitude, the video signal is amplified with a large gain, but the noise is also amplified and the deterioration of the image quality becomes remarkable. Therefore, as shown in FIG. 2, when the gain of the amplifier circuit 12 increases from G1 to G2, the amplitude control circuit 20 controls the amplitude of the correction circuit so as to reduce the amplitude of the correction circuit from g1 to g2, and the comparison is performed without conspicuous noise. A good image can be generated.

  As described above, the image processing apparatus according to the first embodiment of the present invention includes an image sensor that generates a video signal indicating an image of a subject when the subject is imaged through the lens, and the video signal. An amplification circuit that amplifies the image, a blur locus detection circuit that detects a deviation locus of the optical axis of the lens when a subject is imaged, and a correction signal generation circuit that generates a correction signal based on the deviation locus of the optical axis of the lens The optical axis shift locus includes an amplitude control circuit that adjusts the amplitude of the correction signal, and a correction arithmetic circuit that performs image processing of the video signal from the amplifier circuit using the correction signal with the adjusted amplitude. A relatively good image can be generated with the correction signal generated based on the above.

  Further, the amplitude control circuit decreases the amplitude G of the correction signal when the gain g at which the video signal is amplified increases, and increases the amplitude G of the correction signal when the gain g at which the video signal is amplified decreases. Therefore, a relatively good image can be obtained without conspicuous noise.

  In the image processing apparatus of the present embodiment, the relationship between the gain at which the video signal is amplified and the amplitude of the correction signal is defined by a function, and the amplitude control circuit is based on the gain and function at which the video signal is amplified. Therefore, the amplitude of the correction signal can be easily adjusted from the gain by which the video signal is amplified.

  Also, since the image processing apparatus of the present embodiment has a negative function slope, a correction signal having a small amplitude is obtained when the gain at which the video signal is amplified is large, and a correction signal having a large amplitude is obtained when the gain at which the video signal is amplified is small. A signal can be generated.

  In the image processing apparatus according to the present embodiment, since the correction arithmetic circuit adds the correction signal to the video signal, the high-frequency component is shifted due to the deviation of the optical axis while there is a change in brightness such as the contour of the subject. It is possible to emphasize the lowered part.

  The components of the image processing apparatus according to the present embodiment may be replaced with a CPU (computer).

  The image processing program includes: a correction signal generating unit that generates a correction signal based on a blur locus; an amplitude control unit that adjusts the amplitude of the correction signal based on a gain by which the video signal is amplified; And correction correction means for performing image processing of the video signal amplified using the corrected signal.

  The image processing program may be defined as follows.

  The image processing program causes the computer to acquire a video signal acquisition step for acquiring a video signal from the image sensor 11 via the amplifier circuit 12 and the A / D converter circuit 13 and a gain obtained by amplifying the video signal from the amplifier circuit 12. A gain acquisition step, a blur trajectory acquisition step of acquiring a blur trajectory from the blur trajectory detection circuit 18, a correction signal generation step of generating a correction signal based on the blur trajectory, and a correction based on the gain by which the video signal is amplified. An amplitude control step for adjusting the amplitude of the signal and a correction calculation step for executing image processing of the video signal using the correction signal having the adjusted amplitude are executed.

  Next, the operation of the image processing apparatus when it is replaced with a CPU will be described with reference to FIG.

  The gain obtained by amplifying the video signal is acquired from the amplifier circuit 12 (step S41). Next, a blur locus is acquired from the blur locus detection circuit 18 (step S42). Next, a blur correction function is generated from the blur locus (step S43). Next, a correction signal is generated from the blur correction function and the video signal (step S44). Next, the amplitude of the correction signal is calculated (step S45). Next, the amplitude of the correction signal is adjusted (step S46). Finally, the correction signal is added to the video signal (step S47).

  As described above, the image processing program according to the present embodiment causes the computer to acquire the video signal from the image sensor 11 via the amplifier circuit 12 and the A / D converter circuit 13, and the amplification. A gain acquisition step for acquiring a gain obtained by amplifying the video signal from the circuit 12, a blur locus acquisition step for acquiring a blur locus from the blur locus detection circuit 18, and a correction signal generation step for generating a correction signal based on the blur locus; Since the amplitude control step of adjusting the amplitude of the correction signal based on the gain by which the video signal is amplified and the correction calculation step of executing image processing of the video signal using the correction signal having the adjusted amplitude are executed. A blurred image can be corrected to a relatively good image using a correction signal generated based on the deviation locus of the optical axis.

(Second Embodiment)
The configuration of the image processing apparatus according to the second embodiment of the present invention will be described with reference to FIG.

  The components of the image processing apparatus according to the second embodiment are the same as those of the image processing apparatus according to the first embodiment except for the light / dark ratio detection circuit 27. The same components as those of the image processing apparatus are denoted by the same reference numerals, and description thereof is omitted.

  As shown in FIG. 5, the image processing apparatus includes an imaging device 11, an amplifier circuit 12, an A / D conversion circuit 13, a correction arithmetic circuit 14, a signal processing circuit 15, an image display unit 16, and a blur locus. A detection circuit 18, a correction signal generation circuit 19, a light / dark ratio detection circuit 27, and an amplitude control circuit 28 are provided.

  The light / dark ratio detection circuit 27 acquires the digital video signal from the A / D conversion circuit 13, calculates the light / dark ratio R for each pixel, and outputs the calculated light / dark ratio R to the amplitude control circuit 28.

  In this embodiment, as shown in FIG. 8, a window of horizontal 3 pixels × vertical 3 lines is defined with the pixel at the center, and the light / dark ratio R of the pixel is calculated by Expression (1).

Light / dark ratio R = (maximum value of luminance among pixels a to i)
/ (Minimum value of luminance among pixels a to i) (1)
On the other hand, the correction signal generation circuit 19 acquires the digital video signal from the A / D conversion circuit 13, generates a correction signal from the optical axis shift locus and the digital video signal, and outputs the generated correction signal to the amplitude control circuit 28. It is supposed to be.

  The amplitude control circuit 28 has data indicating the relationship between the light / dark ratio R and the gain G (see FIG. 6), and the amplitude of the correction signal with the gain G corresponding to the light / dark ratio R acquired from the light / dark ratio detection circuit 27. And a correction signal whose amplitude has been corrected is output to the correction arithmetic circuit 14.

  The correction calculation circuit 14 acquires a digital video signal from the A / D conversion circuit 13 and adds the correction signal to the digital video signal.

  Next, a gain control operation of the image processing apparatus according to the second embodiment of the present invention will be described with reference to FIG.

  When the optical axis is blurred, the image sensor 11 outputs a video signal (see FIG. 7B) having a gentler gradient than the video signal when the optical axis is not blurred (see FIG. 7A). Is done. Next, digital image data is generated by the A / D conversion circuit 13 from the video signal amplified by the amplifier circuit 12. 7A and 7B, the horizontal direction represents the space direction, and the vertical direction represents the level of the video signal.

  On the other hand, the blur locus of the optical axis is detected by the blur locus detection circuit 18. Next, a blur correction function is generated from the blur locus of the optical axis, and a correction signal (see FIG. 7C) is generated from the blur correction function by the correction signal generation circuit 19. Next, the amplitude of the correction signal is adjusted according to the light / dark ratio, and a correction signal (see FIG. 7E) whose amplitude is adjusted is output to the correction arithmetic circuit 14. Next, the correction calculation circuit 14 adds the correction signal to the video signal, and outputs a noise-reduced video signal (see FIG. 7F) obtained by adding the correction signal.

  When a correction signal containing a large amount of high frequency components (see FIG. 7C) is added to the video signal (see FIG. 7B), noise becomes conspicuous as in the video signal (see FIG. 7D). Therefore, the amplitude of the correction signal is adjusted for each pixel in accordance with the light / dark ratio.

  In particular, since the video signal when the subject is imaged in a dark place has a small amplitude, is amplified with a large gain, and noise is also amplified, the correction signal generated from the video signal (see FIG. 7C) Noise is also noticeable.

  When a correction signal containing a large amount of high frequency components (see FIG. 3C) is added to the video signal (see FIG. 3B), noise becomes conspicuous as in the video signal (see FIG. 3D). Therefore, the amplitude of the correction signal is adjusted for each pixel in accordance with the light / dark ratio.

  In particular, since the video signal when the subject is imaged in a dark place has a small amplitude, the video signal is amplified with a large gain, but the noise is also amplified and the deterioration of the image quality becomes remarkable. Therefore, as shown in FIG. 6, when the light / dark ratio increases from R1 to R2, the amplitude control circuit 20 controls the amplitude of the correction circuit to increase from G2 to G1, and it is relatively good without conspicuous noise. An image can be generated.

  As described above, in the image processing apparatus of the present embodiment, the correction signal generation circuit generates a correction signal from the optical axis shift locus and the digital video signal, and the amplitude control circuit has a gain corresponding to the light / dark ratio R. Since the amplitude of the correction signal is corrected with G, a relatively good image can be generated with this correction signal.

  The components of the image processing apparatus according to the present embodiment may be replaced with a CPU (computer).

  The image processing program adjusts the amplitude of the correction signal based on the light / dark ratio, the correction signal generating means for generating a correction signal based on the blur locus, the light / dark ratio detecting means for detecting the light / dark ratio for each pixel. The amplitude control means and the correction calculation means for performing image processing of the video signal amplified using the correction signal whose amplitude is adjusted are caused to function.

  The image processing program may be defined as follows.

  An image processing program includes a computer that acquires a video signal from an imaging device via an amplifier circuit and an A / D conversion circuit, a light / dark ratio detecting step that detects a light / dark ratio for each pixel, and a blur locus A blur trajectory acquisition step for acquiring a blur trajectory from the detection circuit, a correction signal generation step for generating a correction signal based on the blur trajectory, an amplitude control step for adjusting the amplitude of the correction signal based on the light / dark ratio, and an amplitude adjustment And a correction calculation step for executing image processing of the video signal using the corrected signal.

  Next, the operation of the image processing apparatus when it is replaced with a CPU will be described with reference to FIG.

  A blur locus is acquired from the blur locus detection circuit 18 (step S91). Next, the light / dark ratio is calculated for each pixel in a window of 3 horizontal pixels × 3 vertical lines (step S92). Next, a blur correction function is generated from the blur locus (step S93). Next, a correction signal is generated from the blur correction function and the video signal (step S94). Next, the amplitude of the correction signal is adjusted for each pixel according to the contrast ratio (step S95). Finally, the correction signal is added to the video signal (step S96).

  As described above, the image processing program of the present embodiment causes the computer to acquire the video signal from the image sensor via the amplification circuit and the A / D conversion circuit, and the contrast ratio for each pixel. Brightness ratio detection step for detecting a blur locus, a blur locus acquisition step for acquiring a blur locus from the blur locus detection circuit, a correction signal generation step for generating a correction signal based on the blur locus, and an amplitude of the correction signal based on the contrast ratio The amplitude control step for adjusting the image and the correction calculation step for executing the image processing of the video signal using the correction signal having the adjusted amplitude are executed. Therefore, the comparison is performed with the correction signal generated based on the deviation locus of the optical axis. A good image can be generated.

  In the present embodiment, the light / dark ratio is obtained by Expression (1), but the method for calculating the light / dark ratio is not limited to Expression (1). A window of 3 pixels × 3 lines in which the light / dark ratio is calculated is an example.

  In this embodiment, the correction signal is added to the video signal. However, the present invention is not limited to adding the correction signal to the video signal.

  The blur locus detection circuit may be constituted by an angular velocity sensor or the like.

  The image processing apparatus, the imaging method, and the image processing program according to the present invention can correct a relatively good image with a correction signal generated based on a shift locus of the optical axis even if the subject is a moving object. It is useful for mobile phones and digital cameras with camera functions.

1 is a block diagram showing a configuration of an image processing apparatus according to a first embodiment of the present invention. FIG. 5 is a diagram illustrating an example of a relationship between a gain at which a video signal is amplified and an amplitude of a correction signal in the image processing apparatus according to the first embodiment of the present invention. The figure which showed correcting the part with remarkable change of brightness, such as a to-be-photographed object's outline, by the image processing of the image processing apparatus which concerns on the 1st Embodiment of this invention The flowchart when the image processing apparatus which concerns on the 1st Embodiment of this invention is comprised with CPU. The block diagram in which the structure of the image processing apparatus which concerns on the 2nd Embodiment of this invention was shown FIG. 7 is a diagram showing an example of the relationship between the light / dark ratio and the amplitude of the correction signal in the image processing apparatus according to the second embodiment of the present invention. The figure which showed correcting the part with remarkable brightness changes, such as the outline of a to-be-photographed object, by the image processing of the image processing apparatus which concerns on the 2nd Embodiment of this invention The figure by which the image processing apparatus which concerns on the 2nd Embodiment of this invention showed an example of the window from which a light / dark ratio is calculated for every pixel Flowchart when the image processing apparatus according to the second embodiment of the present invention is configured by a CPU. Block diagram showing a schematic configuration of a conventional image correction apparatus A diagram schematically showing the operation of a conventional image correction apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image pick-up element 2 Amplifying circuit 3 A / D conversion circuit 4 Signal processing circuit 5 Image buffer memory 6 Position shift detection circuit 7 CPU
8 switch 11 imaging device (video signal generating means)
12 Amplification circuit (amplification means)
13 A / D conversion circuit 14 Correction calculation circuit (correction calculation means)
DESCRIPTION OF SYMBOLS 15 Signal processing circuit 16 Image display part 17 Gain control circuit 18 Blur locus detection circuit (blur locus detection means)
19 Correction signal generation circuit (correction signal generation means)
20, 28 Amplitude control circuit (amplitude control means)
27 Light / dark ratio detection circuit (light / dark ratio detection means)

Claims (26)

A video signal generating means for generating a video signal showing an image of the subject when the subject is imaged through the lens;
Amplifying means for amplifying the video signal;
A blur locus detection means for detecting a deviation locus of the optical axis of the lens when the subject is imaged;
Correction signal generating means for generating a correction signal based on a shift locus of the optical axis of the lens;
Amplitude control means for adjusting the amplitude of the correction signal;
An image processing apparatus comprising: a correction calculation unit that performs image processing of the amplified video signal using the correction signal with the adjusted amplitude. The image processing apparatus according to claim 1, wherein the amplitude control unit adjusts an amplitude of the correction signal based on a gain by which the video signal is amplified. The image processing apparatus according to claim 1, wherein the amplitude control unit decreases the amplitude of the correction signal as the gain at which the video signal is amplified increases. A light / dark ratio detecting means for detecting a light / dark ratio for each pixel of the image,
The image processing apparatus according to claim 1, wherein the amplitude control unit adjusts an amplitude of the correction signal based on the light / dark ratio. The image processing apparatus according to claim 4, wherein the amplitude control unit decreases the amplitude of the correction signal as the light / dark ratio decreases. The image processing apparatus according to claim 4, wherein the amplitude control unit reduces the amplitude of the correction signal when the gain at which the video signal is amplified is large and the contrast ratio is small. The relationship between the gain by which the video signal is amplified and the amplitude of the correction signal is defined as a function,
The image processing apparatus according to claim 1, wherein the amplitude control unit adjusts an amplitude of the correction signal based on a gain by which the video signal is amplified and the function. The image processing apparatus according to claim 7, wherein a slope of the function is negative. A light / dark ratio detecting means for detecting a light / dark ratio for each pixel of the image,
The relationship between the contrast ratio and the amplitude of the correction signal is defined as a function,
The image processing apparatus according to claim 1, wherein the amplitude control unit adjusts an amplitude of the correction signal based on the light / dark ratio and the function. The image processing apparatus according to claim 9, wherein a slope of the function is positive. A window including adjacent pixels is defined for each pixel of the image,
11. The image processing apparatus according to claim 9, wherein the light / dark ratio detection unit calculates a light / dark ratio based on a maximum value and a minimum value of luminance in the window for each pixel of the image. The image processing apparatus according to claim 1, wherein the correction calculation unit adds the correction signal to the video signal. A video signal generation step of generating a video signal indicating an image of the subject when the subject is imaged through the lens;
An amplification step of amplifying the video signal;
A blur locus detecting step for detecting a deviation locus of the optical axis of the lens when the subject is imaged;
A correction signal generating step for generating a correction signal based on a shift locus of the optical axis of the lens;
An amplitude control step of adjusting the amplitude of the correction signal;
And a correction calculation step of performing image processing of the amplified video signal using the correction signal with the amplitude adjusted. The image processing apparatus according to claim 13, wherein the amplitude control unit adjusts an amplitude of the correction signal based on a gain by which the video signal is amplified. 14. The image processing method according to claim 13, wherein, in the amplitude control step, the amplitude of the correction signal is decreased as the gain for amplifying the video signal increases. A light / dark ratio detection step for detecting a light / dark ratio for each pixel of the image,
The image processing method according to claim 13, wherein in the amplitude control step, an amplitude of the correction signal is adjusted based on the light / dark ratio. The image processing method according to claim 16, wherein in the amplitude control step, the amplitude of the correction signal is reduced as the light / dark ratio is reduced. 17. The image processing method according to claim 16, wherein in the amplitude control step, the amplitude of the correction signal is reduced when the gain for amplifying the video signal is large and the contrast ratio is small. The relationship between the gain by which the video signal is amplified and the amplitude of the correction signal is defined as a function,
14. The image processing method according to claim 13, wherein in the amplitude control step, the amplitude of the correction signal is adjusted based on a gain by which the video signal is amplified and the function. The image processing method according to claim 19, wherein the slope of the function is negative. A light / dark ratio detection step for detecting a light / dark ratio for each pixel of the image,
The relationship between the contrast ratio and the amplitude of the correction signal is defined as a function,
The image processing method according to claim 13, wherein in the amplitude control step, an amplitude of the correction signal is adjusted based on the light / dark ratio and the function. The image processing method according to claim 21, wherein the slope of the function is positive. A window including adjacent pixels is defined for each pixel of the image,
23. The image processing method according to claim 21, wherein, in the light / dark ratio detection step, the light / dark ratio is calculated for each pixel of the image using a maximum value and a minimum value of luminance in the window. The image processing method according to claim 13, wherein in the correction calculation step, the correction signal is added to the video signal. A correction signal generating means for generating a correction signal based on a blur locus, an amplitude control means for adjusting an amplitude of the correction signal based on a gain by which the video signal is amplified, and a correction signal with the amplitude adjusted; An image processing program for causing a correction operation means for executing image processing of the video signal to function. A computer receives a video signal acquisition step for acquiring a video signal, a gain acquisition step for acquiring a gain obtained by amplifying the video signal, a blur trajectory acquisition step for acquiring a blur trajectory, and a correction signal based on the blur trajectory. A correction signal generating step for generating, an amplitude control step for adjusting the amplitude of the correction signal based on the gain obtained by amplifying the video signal, and image processing of the video signal using the correction signal with the adjusted amplitude. An image processing program for executing a correction calculation step to be executed.

Images