JP2007243579A - Imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus having an image blurring correction control function capable of preventing the image blurring of an object intended to be photographed by a user. <P>SOLUTION: A photographing optical system (ICS) forms an optical image of an object (P1) by a plurality of lens groups (101a, 101b) including an image blurring preventing lens (1) for preventing image blurring by controlling movement vertical to an optical axis. An image pickup element (106) picks up the optical image of the object (P1), converts the optical image into an electric image signal (Sv) and an image processing part (107) displays and stores output image signals (Sv1, Sv2) of the image pickup element (106). An image blurring control part (104a) is constituted of an image blurring correction error calculation part (39) for calculating an image blurring correction error (ISe) and an image correction part (107) for correcting the segmentation position of the image signal (Sv1) on the basis of the image blurring correction error (ISe) to control the movement of image blurring preventing lenses (1; 102). <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a small and lightweight imaging device including an imaging optical system having an image blur correction function for correcting image blur.

  In recent years, with the widespread use of imaging devices such as digital still cameras and video movies, the size and weight of devices have been reduced. Furthermore, with the improvement in image quality of imaging devices, there is an increasing demand for an image blur correction function.

  As an example of a conventional imaging apparatus having an image blur correction function (Patent Document 1), first and second motion detection units that detect a blur amount of the imaging apparatus based on different information, and first and second A third motion detecting means for outputting third motion information by calculating based on the first and second motion information outputted from the first motion detecting means; and a third motion detecting means outputted from the third motion detecting means. 2. Description of the Related Art There is known a device including correction means for controlling the position of an optical system to correct a shake amount based on motion information.

  In the imaging apparatus, a plurality of pieces of motion information (for example, camera motion information detected by various external sensors such as sensors for detecting acceleration, speed, displacement, etc.) with different detection targets are obtained by image processing of a video signal. The blur correction signal is optimized by performing a comparison operation with the motion vector of the obtained image. In this way, it is intended to provide an imaging apparatus having a shake correction function that is excellent in various characteristics such as responsiveness and sensitivity by preventing variation in detection accuracy and malfunction due to image patterns.

  Further, the above-described conventional imaging apparatus extracts the motion information of the external sensor and the video camera based on a method of extracting the motion vector of the image by performing image processing on the imaging signal from the imaging unit, Means for comparing and calculating the motion vector of the image and the motion information of the video camera. Then, by obtaining the shake correction amount based on the calculation result, the responsiveness is improved with higher accuracy and higher sensitivity than other conventional imaging devices that obtain the shake correction amount based only on the external sensor. Yes.

Note that the movement of the image caused by the relative movement between the subject and the video camera can be separated into a movement caused by the movement of the subject and a movement caused by the movement of the video camera. Therefore, by identifying the image motion to be corrected and the image motion that should not be corrected, errors in the blur correction system can be greatly reduced. Also, when it is determined that the camera is not moving by determining the magnitude of the motion vector of the camera, the motion compensation system operation is stopped to prevent malfunction due to the movement of the subject.
Japanese Patent Laid-Open No. 2-75284

As described above, the imaging apparatus proposed in Patent Document 1 has higher accuracy and higher sensitivity and improved responsiveness compared to other conventional imaging apparatuses that calculate the blur correction amount based only on the external sensor. ing. The image capturing apparatus intends to distinguish image blur caused by subject motion from video camera motion. However, in this imaging apparatus, there are many cases where the user cannot correct blurring of a subject for imaging purposes. Specifically, the moving subject is not necessarily the subject that the user really intends to capture, and therefore the user does not intend, for example, the moving subject in the background such as a passing car or a person An erroneous operation is caused with respect to blur correction for a subject intended as an imaging target.
In view of the above problems, the present invention provides an imaging apparatus having an image blur correction control function that prevents image blur of a subject that a user wants to shoot.

An imaging apparatus that outputs an electrical image signal of a subject, and includes a plurality of lens groups including an image blur prevention lens that prevents image blur by controlling movement perpendicular to the optical axis. An imaging optical system for forming an image;
An image sensor that captures an optical image of the subject and converts it into the electrical image signal;
Image processing means for displaying and storing the output image signal of the image sensor;
Image blur control means for controlling movement of the image blur prevention lens,
The image blur control unit includes an image blur correction error calculation unit that calculates an image blur correction error, and an image correction unit that corrects a cutout position of the image signal based on the image blur correction error. An imaging device.

  ADVANTAGE OF THE INVENTION According to this invention, the imaging device provided with the image blur correction control which prevents the image blur of the subject which a user intends to image | photograph can be provided.

(First embodiment)
With reference to FIG. 1, the structure of the imaging device according to the first embodiment of the present invention will be described. The imaging device ICD1 includes a lens barrel 100, an imaging optical system ICSa, an operation unit 110, a display unit 111, a memory card 112, and a system controller 120. The imaging optical system ICSa includes a zoom lens system 101, an image blur correction lens unit 102a (hereinafter referred to as “OIS unit 102a”), and a focus lens unit 103.

  The zoom lens system 101 includes a zoom lens group 101a and a zoom lens group 101b. Note that OIS is an abbreviation consisting of an acronym for Optical Image Stabilizer.

  The lens barrel 100 holds the imaging optical system ICSa. The imaging optical system ICSa, in order from the subject side, a zoom lens system 101 that moves along the optical axis at the time of zooming, an OIS unit 102a that moves perpendicularly to the optical axis to perform image blur correction, and focusing An optical image of the imaging object is generated by the focus lens unit 103 that moves along the optical axis to adjust the state.

  The system controller 120 includes an OIS unit controller 104a, a focus driver 105, a CCD 106 that is an image sensor, an image processor 107, and a focus information calculator 109a.

  The CCD 106 is an imaging element that captures an optical image generated by the imaging optical system ICSa at a predetermined timing, converts the optical image into an electrical image signal Sv, and outputs the electrical image signal Sv. The image processing unit 107 performs predetermined image processing such as white balance correction and γ correction on the image signal Sv output from the CCD 106, and cuts out an image at a predetermined address to generate an image signal. As necessary, the image signals Sv output from the CCD 106 and the image processing unit 107 are referred to as a first image signal Sv1 and a second image signal Sv2, respectively, and are identified. The image processing unit 107 can bidirectionally access the memory card 112 that can be attached and detached by the user.

  The display unit 111 is preferably configured by a liquid crystal display, and displays the second image signal Sv2 output from the image processing unit 107 as a visible image to the user based on a command Cmd output from the system controller 120. The memory card 112 stores the second image signal Sv2 output from the image processing unit 107 based on the command Cmd output from the system controller 120. The memory card 112 supplies the stored second image signal Sv2 to the display unit 111 via the image processing unit 107. As described above, the first image signal Sv1 is an electrical signal representing a captured image of the object by the CCD 106, and the second image signal Sv2 is an actual image captured by the display unit 111 or the like based on the first image signal Sv1. It is an electric signal showing the display image displayed on.

  The operation unit 110 is provided outside the imaging apparatus main body, and controls the overall operation of the imaging apparatus ICD1 in response to an operation by the user. The operation unit 110 includes a power switch, a shutter button, and the like.

  Hereinafter, the operation of the focus driving unit 105 will be described. When the system controller 120 detects the half-pressed state when the shutter button of the operation unit 110 is half-pressed, the system controller 120 focuses the first image signal Sv1 output from the CCD 106 via the image processing unit 107. The data is transferred to the information calculation unit 109a.

  The focus information calculation unit 109a is configured to use the defocus amount Vdf based on the contrast information Ic included in the transferred first image signal Sv1 and the position information Ipf of the focus lens unit 103 output from the focus driving unit 105. (Not shown) is calculated. The focusing information calculation unit 109 a generates a control signal Sc for controlling the position of the focus lens unit 103 based on the calculated defocus amount Vdf, and outputs the control signal Sc to the focus driving unit 105.

  The focus driving unit 105 outputs position information Ip when the focus lens unit 103 is driven to the in-focus state calculation unit 109a. The focus drive unit 105 also has a function of outputting a drive signal Sdr for driving the focus lens unit 103 in the optical axis direction based on a command Cmd (not shown) from the system controller 120. Note that the focus driving unit 105 may have a function of driving the zoom lens system 101 in the optical axis direction in accordance with a user's operation of a zoom lever (not shown).

  Next, the OIS unit 102a will be described in detail with reference to FIG. 2, FIG. 3, FIG. 4, and FIG. 2 shows a state where the assembled OIS unit 102a is viewed obliquely from above, FIG. 3 shows a state in which the main part of the OIS unit 102a is disassembled, FIG. 4 shows the back of the pitching moving frame 2, and FIG. Shows a VV cross section in FIG.

  As shown in FIG. 2, a yawing movement frame 4 is supported on the fixed frame 5 so as to be movable in the left-right direction via a shaft (not shown) in the left-right direction. The yawing movement frame 4 is provided with a vertical shaft 4a and a guide groove 4b.

  As shown in FIG. 3, the main body 2a of the pitching moving frame 2 is provided with a guide member 3b slidably fitted to the shaft 4a and a shaft 3a slidably fitted to the guide groove 4b. Thus, the pitching moving frame 2 that holds the image blur prevention lens 1 of the OIS unit 102a is held by the yawing moving frame 4 so as to be movable in the vertical direction. In this manner, the image blur prevention lens 1 (OIS unit 102a) is movable in the vertical and horizontal directions with respect to the fixed frame 5 shown in FIG. 2 via the pitching moving frame 2 and the yawing moving frame 4. It is supported.

  A plurality of layers, for example, a four-layer laminated substrate 6 on which a yawing coil pattern 7A and a pitching coil pattern 7B for driving the image blur prevention lens 1 (OIS unit 102a) are formed is attached to the main body 2a of the pitching moving frame 2. It has been. Hall elements (magnetic sensors) 8A and 8B, which are position detection sensors for detecting the position of the image blur prevention lens 1 (OIS unit 102a), are attached to the multilayer substrate 6.

  The Hall elements 8A and 8B are fitted into positioning holes 6a and 6b punched with a mold simultaneously with the reference holes 6c and 6d of the laminated substrate 6 in order to position and fix with high accuracy. The positioning holes 6a and 6b are formed slightly smaller than the outer shapes of the Hall elements 8A and 8B so that the Hall elements 8A and 8B (FIG. 3) can be lightly press-fitted. The Hall elements 8A and 8B are lightly press-fitted into the positioning holes 6a and 6b, respectively, so that the Hall elements 8A and 8B are positioned in the positioning holes 6a and 6b with high accuracy without rattling.

  As shown in FIG. 4, the multilayer substrate 6 is provided with a flexible printed board 9 on which a connection pattern 9d is formed. The flexible printed board 9 includes a fixed portion 9a, a movable portion 9b, and a terminal portion 9c. The fixed portion 9a is attached to the back surface of the multilayer substrate 6, the movable portion 9b is led out from the fixed portion 9a and connected to the fixed frame 5 (see FIGS. 3 and 5), and the terminal portion 9c is the movable portion. It is attached to the end of 9b and is used for feeding and signal transmission on the fixed frame 5 side.

  Further, sensor land portions 13a and 13b are provided in the fixing portion 9a of the flexible printed board 9 and in the vicinity of the positioning holes 6a and 6b, respectively. Then, by fitting the hall elements 8A and 8B into the positioning holes 6a and 6b, respectively, the terminal sides 8b (see FIG. 5) of the hall elements 8A and 8B come into contact with the sensor lands 13a and 13b. As a result, when soldering, it is not necessary to press and hold the Hall elements 8A and 8B, and the work is easy, so the productivity is good.

  The laminated substrate 6 is formed with land portions 6e and 6f connected to the coiling pattern 7A for pitching and the coil pattern 7B for yawing, respectively. The land portions 6e and 6f are connected to the land portions 14a and 14b formed corresponding to the fixing portion 9a of the flexible printed board 9 by soldering. The land portions 6e and 6f are connected to the connector 15 via the terminal portion 9c by a connection pattern 9d formed on the fixed portion 9a and the movable portion 9b of the flexible printed board 9. As a result, transmission / reception of electric signals to / from the hall elements 8A and 8B and transmission to the coil patterns 7A and 7B from the connector 15 on the fixed frame 5 (see FIG. 2) to the movable yawing movement frame 4 (see FIG. 2). Power supply can be performed.

  As shown in FIGS. 3, 4, and 5, magnets 10 </ b> A and 10 </ b> B facing coil patterns 7 </ b> A and 7 </ b> B are attached to yokes 11 </ b> A and 11 </ b> B on fixed frame 5. In order to position the Hall elements 8A and 8B in a precise manner so that the center position of the movement range of the Hall elements 8A and 8B coincides with the boundary between the magnets 10A and 10B magnetized with two poles, the fixed frame 5 includes the magnets 10A and 10B. Positioning convex portions (positioning portions) 12a and 12b that are in contact with at least one of the upper and lower positions and at least one of the left and right positions are provided. The magnets 10A and 10B are in contact with the positioning protrusions 12a and 12b and are regulated in position.

Returning to FIG. 1, the function of the OIS unit controller 104a will be described. The operating conditions of the OIS unit controller 104a are mainly considered to be the following three cases: Case 1, Case 2, and Case 3.
<Case 1>
When the shutter button of the operation unit 110 is half-pressed, the system controller 120 detects that the shutter button is half-pressed, and sets the OIS unit control unit 104a to the monitor screen image blur correction mode. When the shutter button is fully pressed, the system controller 120 detects that the shutter button is fully pressed, and changes the OIS unit controller 104a from the monitor screen image blur correction mode to the imaging screen image blur correction mode. Switch to. Further, the system controller 120 causes the CCD 106 to output the first image signal Sv1 and stores the first image signal Sv1 in the memory card 112 as the second image signal Sv2 via the image processing unit 107. The operation of the OIS unit controller 104a is terminated.

<Case 2>
When the shutter button of the operation unit 110 is fully pressed, the system controller 120 detects that the shutter button is fully pressed, and immediately before the first image signal Sv1 is output from the CCD 106, the OIS The unit controller 104a is activated. After the first image signal Sv1 is output from the CCD 106, the system controller 120 stores the second image signal Sv2 in the memory card via the image processing unit 107, and then the operation of the OIS unit control unit 104a is performed. Terminate.

<Case 3>
When the power switch of the operation unit 110 is turned on and the imaging device ICD1 is in the shooting mode, the system controller 120 detects that the imaging device ICD1 is in the shooting mode, and activates the OIS unit control unit 104a. Then, the power switch is turned off, the second image signal Sv2 stored in the memory card 112 is supplied to the display unit 111 via the image processing unit 107, and an image is displayed on the display unit 111. In a mode other than the shooting mode, the system controller 120 ends the operation of the OIS unit controller 104a.

  The three conditions of case 1, case 2, and case 3 may be switched by a menu button (not shown) attached to the main body of the imaging device ICD1. Alternatively, the case may be automatically switched according to the photographing mode such as case 1 or case 2 when photographing a still image and case 3 when photographing a moving image.

  With reference to FIG. 6, the image blur correction function according to the present embodiment will be described. The gift correction function is realized by the OIS unit 102a and the OIS unit controller 104a. The OIS unit 102a includes OIS actuators 31x and 31y and position detection sensors 32x and 32y. The OIS actuator 31x includes a coil pattern 7B that moves in the left-right direction (the yawing direction) together with the image blur prevention lens 1 (OIS unit 102a), a magnet 10B that is fixed to the fixed frame 5, and a yoke 11B. The position detection sensor 32x is formed by a Hall element 8B.

  The OIS actuator 31y includes a coil pattern 7A that moves in the vertical direction (pitching direction) together with the image blur prevention lens 1 (OIS unit 102a), a magnet 10A that is fixed to the fixed frame 5, and a yoke 11A. The position detection sensor 32y includes a hall element 8A.

  The OIS unit control unit 104a includes gain correction units 33x and 33y, angular velocity sensors 34x and 34y, integrators 35x and 35y, gain correction units 36x and 36y, comparison units 37x and 37y, an OIS unit drive unit 38x and 38y and image shift amount calculation units 39x and 39y.

  The angular velocity sensor 34x detects an angular velocity Ax in a direction corresponding to the OIS actuator 31x that moves the image blur prevention lens 1 (OIS unit 102a) in the left-right direction (the yawing direction). The integrator 35x integrates the angular velocity Ax output from the angular velocity sensor 34x and outputs angle information IAx. The OIS unit drive unit 38x supplies power to the coil pattern 7B. The gain correction unit 33x doubles the position information IPx of the movable part output from the position detection sensor 32x by a predetermined gain K1. The gain correction unit 36x doubles the angle information IAx output from the integrator 35x with a predetermined gain K2.

  The comparison unit 37x compares the position information K1 * IPx of the movable unit output from the gain correction unit 33x with the angle information K2 * IAx of the imaging apparatus main body output from the gain correction unit 36x. The comparison result is output from the comparison unit 37x as a control signal Scx for the OIS unit drive unit 38x and the image shift amount calculation unit 39x. That is, based on the control signal Scx, the OIS unit drive unit 38x controls the position of the movable unit of the OIS actuator 31x. In addition, the image shift amount calculation unit 39x includes the control signal Scx (that is, K1 · IPx which is position information in the x direction of the OIS unit 102 output from the gain adjustment unit 33x and the imaging device output from the gain adjustment unit 36x). X-direction image shift amount ISx (hereinafter referred to as “x-direction image shift amount ISx”) based on the difference K2 · IAx−K1 · IP) from the x-direction angular shake information K2 · IAx.

  Similarly, the angular velocity sensor 34y detects an angular velocity Ay in a direction corresponding to the OIS actuator 31y that moves the image blur prevention lens 1 (OIS unit 102a) in the vertical direction (pitching direction). The integrator 35y integrates the angular velocity Ay output from the angular velocity sensor 34y and outputs angle information IAy. The OIS unit driving unit 38y supplies power to the coil pattern 7A. The gain correction unit 33y doubles the position information IPy of the movable part output from the position detection sensor 32y by a predetermined gain K1. The gain correction unit 36y doubles the angle information output from the integrator 35y with a predetermined gain K2.

  The comparison unit 37y compares the position information K1 · IPy of the movable part output from the gain correction unit 33y and the angle information K2 · IAy of the imaging apparatus main body output from the gain correction unit 36x. The comparison result is output from the comparison unit 37x as a control signal Scy for the OIS unit drive unit 38y and the image shift amount calculation unit 39y. That is, based on the control signal Scy, the OIS unit driving unit 38y controls the position of the movable unit of the OIS actuator 31y. In addition, the image shift amount calculation unit 39y outputs the control signal Scy (that is, the position information K1 • IPy in the y direction of the OIS unit 102a output from the gain adjustment unit 33y and the y of the imaging device output from the gain adjustment unit 36y). The y-direction image shift amount ISy (hereinafter referred to as “y-direction image shift amount ISy”) is calculated based on the difference K2 · IAy−K1 · IPy from the direction angular shake information K2 · IAy.

  Hereinafter, as necessary, the OIS actuators 31x and 31y are collectively referred to as the OIS actuator 31, the position detection sensors 32x and 32y are collectively referred to as the position detection sensor 32, and the gain correction units 33x and 33y are collectively referred to as the gain correction unit 33. The angular velocity sensors 34x and 34y are collectively referred to as the angular velocity sensor 34, the integrators 35x and 35y are collectively referred to as the integrator 35, the gain correction units 36x and 36y are collectively referred to as the gain correction unit 36, and the comparison units 37x and 37y are compared with the comparison unit 37. OIS unit drive units 38x and 38y are collectively referred to as OIS unit drive unit 38, and image shift amount calculation units 39x and 39y are collectively referred to as image shift amount calculation unit 39. As described above, the OIS actuator 31, the position detection sensor 32, the gain correction unit 33, the comparison unit 37, and the OIS unit driving unit 38 constitute a control loop gain.

  In the OIS unit 102a and the OIS unit controller 104a configured as described above, the image blur correction function is realized as follows. That is, the angular shake information K2 · IAx in the x direction, which is the basis for correcting the image blur for the lateral shake of the imaging device ICD1, is output from the gain correction unit 36x through the angular velocity sensor 34x and the integrator 35x. In a state where there is no left-right shake, a predetermined reference voltage is output from the gain correction unit 36x as x-direction angular shake information K2 · IAx. The position of the image blur prevention lens 1 is controlled by the OIS unit drive unit 38x, the OIS actuator 31x, the position detection sensor 32x, and the gain correction unit 33x in accordance with the reference voltage of the angular shake information K2 · IAx in the x direction. That is, in this state, the voltage output from the comparison unit 37x to the OIS unit driving unit 38x is substantially 0, and the center of the image blur prevention lens 1 is a vertical line passing through the substantial center of the imaging optical system ICSa other than the image blur prevention lens 1. Matches.

  In a state in which the imaging apparatus ICD1 is shaken in the left-right direction, a voltage based on the rotation angle in the x direction of the imaging optical system ICSa is output from the gain correction unit 36x. With this voltage, the image blur prevention lens 1 is moved in a direction in which no image blur occurs by the rotation angle in the left-right direction. Therefore, the gain correction unit 33x and the gain correction unit 36x move to a position where no image blur occurs with respect to the output (angle shake information K2 · IAx in the x direction) detected by the position detection sensor 32x. The power necessary for the adjustment is adjusted so as to be output from the OIS unit driver 38x to the OIS actuator 31x. Specifically, the adjustment is performed when the imaging device ICD1 is shipped from the factory.

  On the other hand, the angular shake information K2 · IAy in the y direction, which is the basis for correcting image blur due to the shake in the vertical (y) direction of the imaging device ICD1, is output from the gain correction unit 36y through the angular velocity sensor 34y and the integrator 35y. In a state where there is no up-down vibration, a predetermined reference voltage is output as a control command signal from the gain correction unit 36y. The position of the image blur prevention lens 1 is controlled by the OIS unit driving unit 38y, the OIS actuator 31y, the position detection sensor 32y, and the gain correcting unit 33y so as to coincide with the reference voltage of the angular shake information K2 · IAy in the y direction. . That is, in this state, the voltage output from the comparison unit 37y to the OIS unit driving unit 38y is substantially 0, and the center of the image blur prevention lens 1 is a horizontal line passing through the substantial center of the imaging optical system ICSa other than the image blur prevention lens 1. Match.

  In a state where the imaging device ICD1 is shaken in the vertical direction, the gain correction unit 36y outputs a voltage based on the rotation angle of the imaging device ICD1 in the y direction. By the voltage based on the vertical rotation angle, the image blur prevention lens 1 is moved in a direction in which no image blur occurs by the vertical rotation angle. Therefore, in the gain correction unit 33y and the gain correction unit 36y, the power necessary for moving the image blur prevention lens 1 in a direction in which image blur is not generated with respect to the output detected by the position detection sensor 32y is generated by the OIS unit driving unit. The output is adjusted from 38y to the OIS actuator 31y. Specifically, the adjustment is performed when the imaging device ICD1 is shipped from the factory.

  Next, the image processing unit 107 will be described with reference to FIG. The image processing unit 107 includes an image reading unit 41, an image cutting unit 42, an image composition unit 43, and an image memory 44. The image processing unit 107 mainly has an electronic image blur correction function. The image reading unit 41 reads image data for one frame from the first image signal Sv1 output from the CCD 106, and outputs the image data to the focusing information calculation unit 109a and the image cutout unit 42 as first image data Di1. To do. The focusing information calculation unit 109a calculates contrast information by using the first image data Di1 as an evaluation value for driving the focus lens unit 103 to focus.

  The image cutout unit 42 could not be corrected by the OIS actuator 31 based on the first image data Di1 and the x-direction image shift amount ISx and the y-direction image shift amount ISy corresponding to the first image data Di1. The second image data Di2 is cut out from the first image data Di1 so as to correct the image blur, and is output to the image composition unit 43. That is, the first image data Di1 is 1-frame image data of a captured image (first image signal Sv1) captured by the CCD 106 in a state in which image blurring is optically prevented by the OIS actuator 31 before capturing. The image data Di2 is one-frame image data that has been captured with optical image blur prevention and further subjected to electronic image blur correction.

  That is, the first image data Di1 has an optical image blur that may be caused by the movement of the image blur prevention lens 1 (imaging optical system ICSa) of the imaging apparatus ICD that occurs during imaging from the previous frame to the current frame. The image data is captured while being prevented. The second image data Di2 is further corrected by performing image processing (adjusting the cutout address in pixel units) on image blurring that cannot be completely prevented by the optical image blurring prevention function in the first image data Di1. Image data.

  In this sense, the first image data Di1 and the second image data Di2 are referred to as optical image blurring prevention photographed image data and optical image blurring prevention photographing / electronic image blurring correction image data, respectively, as necessary. Identify with Further, the first image data Di1 and the second image data Di2, that is, the images represented by the optical image blurring prevention captured image data Di1 and the optical image blurring prevention photographing / electronic image blurring correction image data Di2, are respectively optically displayed. These are referred to as a target image blur prevention photographed image I1 and an optical image blur prevention photograph / electronic image blur correction image I2.

  The image synthesizing unit 43 stores optical image blurring prevention / electronic image blurring correction image data Di2 for a plurality of captured images input via the CCD 106, the image reading unit 41, and the image cutout unit 42 in the image memory 44. Remember me. The image synthesis unit 43 performs image synthesis by averaging the plurality of electronic image blur correction image data Di2 stored in the image memory 44 after the imaging by the imaging device ICD image blur prevention lens 1 is completed. Third image data Di3 is generated. The first image data Di1, the second image data Di2, and the third image data Di3 are collectively referred to as image data Di.

  Then, the image composition unit 43 transfers the third image data Di3 to the display unit 111 or the memory card 112. Note that a plurality of pieces of image data (second image data Di2) is one frame at the timing of a synchronization signal (30 to 120 [Hz]) output from the system controller 120, with one piece of image data as one frame unit. Processed one by one.

  With reference to FIGS. 8 and 9, the electronic image blur correction for the optical image blur prevention captured image I1 will be described. FIG. 8 shows an example of the pixel arrangement in the optical image blur prevention captured image I1 (first image data Di1). FIG. 9 shows the positions of the optical image blur prevention photographed image I1 (first image data Di1) photographed by the CCD 106 and the electronic image blur correction image I2 (second image data Di2) read by the image reading unit 41. Showing the relationship.

  Specifically, in FIG. 8, r (0,0), g (1,0), b (1,1), etc. are pixel units represented by the number of (m + 1) × (n + 1) pixels. Represents. In other words, () shows the coordinates of individual pixels constituting a rectangular image that is displayed as an optical image blur prevention photographed image I1 or cut out as an optical blur prevention photograph / electronic image blur correction image I2. Yes. In other words, in this example, the optical image blur prevention captured image I1 includes two-dimensional position information in a pixel matrix of m + 1 columns from 0 to m sequentially from the left and n + 1 rows from 0 to n sequentially from the top. For example, m = 2559 and n = 1919 for a CCD with 5 million pixels, and m = 2303 and n = 1727 for a CCD with 4 million pixels.

  r (0,0), g (1,0) and b (1,1) can be generalized as r (m, n), g (m, n) and b (m, n), respectively. In other words, when one pixel is represented by 256 gradations, r (m, n) stores a numerical value representing red information in 256 gradations. g (1,0) stores a numerical value representing green information in 256 gradations. b (1,1) stores a numerical value representing blue information in 256 gradations. That is, in FIG. 8, in the pixel arrangement of the optical image blur prevention captured image I <b> 1, pixels represented by m coordinates 0 and m and n coordinates 0 and n, that is, r (0,0), g (m , 0), b (m, n), g (0, n), and r (0, 0) in order, the outer frame represents the contour of the optical image blur prevention captured image I1. Yes.

  In FIG. 9, rectangles Oi1 (1), Oi1 (2), Oi1 (3), and Oi1 (4) represented by solid lines are four consecutive frames of an optical image blur-captured photographed image generated by the CCD 106. The contours of I1 (1), I1 (2), Ii (3), and Ii (4) are shown. In this example, the optical image blur prevention captured images I1 (1), I1 (2), Ii (3), and Ii (4) are the first, second, third, and fourth frames, respectively. This represents an optical image blur prevention photographed image. In the optical image blur prevention captured images I1 (1) to I1 (4), the symbol P represents a subject. In addition, rectangles Oi2 (1), Oi2 (2), Oi2 (3), and Oi2 (4) represented by alternate long and short dash lines are optical image blur prevention captured images I1 (1) and I1 (2), respectively. , I1 (3), and I1 (4) show the outlines of the optical blur prevention photographing / electronic image blur correction images I2 (1), I2 (2), I2 (3), and I2 (4) ing.

  Each of the optical blur prevention photographing / electronic image blur correction images I2 (1), I2 (2), I2 (3), and I2 (4) has the same size. However, the optical image blur prevention captured / electronic image blur corrected images I2 (1), I2 (2), I2 (3), and I2 (4) are respectively optical image blur preventive captured images I1 (1), I1 ( 2) The positions in Ii (3) and Ii (4) are different.

  That is, the position where the optical image blur prevention / electronic image blur correction image I2 is cut out from the optical image blur prevention captured image I1 is set in the x direction or so that the image blur in the optical image blur prevention captured image I1 is corrected. Shifted in the y direction. In the figure, reference numerals with 1, 2, 3, and 4 in circles (hereinafter referred to as reference numeral 1, reference numeral 2, reference numeral 3, and reference numeral 4) are optical blur prevention photographing / electronic images. In order to describe the shift amount of the shake correction image I2, index points arbitrarily selected to indicate a position change representing a specific part of the subject P1 with respect to the contour Oi1 of the optical image shake prevention captured image I1 are shown. ing.

  In the following, optical image blur prevention captured images I1 (1) to I1 (4) relating to the four consecutive frames described above, and optical blur prevention captured / electronic image blur correction images I2 (1) to I2 (4). ), An image blur correction error output from the OIS unit control unit 104a is an image blur that cannot be prevented by the optical image blur correction process by the image blur prevention lens 1 within the exposure period. An electronic image blur correction that further electronically corrects using the information ISe will be described.

<First frame>
In the optical image blur prevention photographed image I1 (1) of the first frame output from the CCD 106, the subject P is located substantially at the center of the optical image blur prevention photographed image I1 (1). Therefore, the optical blur prevention photograph / electronic image blur correction image I2 (1) is cut out substantially concentrically with respect to the optical image blur prevention photograph image I1 (1). In this way, second image data Di2 (1) for the first frame is generated from first image data Di1 (1) for the first frame. It should be noted that the index point of the subject P1 in the optical image blur prevention photographed image I1 (1) is the position of reference numeral 1 that is the initial position.

<Second frame>
In the optical image blur prevention photographed image I1 (2) of the second frame, the outline Oi1 (1) and the subject P of the optical image blur prevention photographed image I1 (1) are represented by dotted lines. Compared to the optical image blur prevention photographed image I1 (1), in the optical image blur prevention photographed image I1 (2), the subject P1 is tilted to the left, that is, the index point is from the position of reference numeral 1 to reference numeral 2. Moved to position. Therefore, the optical blur prevention photographing / electronic image blur correction image I2 (2) is an optical image so that the subject P1 is positioned substantially at the center of the optical blur prevention photographing / electronic image blur correction image I2 (2). It is cut out from the shake-prevented photographed image I1 (2).

  The processing at this time will be specifically described below. When the interval between the first frame and the second frame is 1/120 [second], the index point has moved from the position of code 1 to the position of code 2 during 1/120 [second]. The indicated vector value is output as image blur correction error information ISe. The image blur correction error information ISe is expressed by an x-direction image shift amount ISx calculated by the image shift amount calculation unit 39x shown in FIG. 6 and a y-direction image shift amount ISy calculated by the image shift amount calculation unit 39y. Is done.

  That is, the x-direction image shift amount ISx is the difference between the position information in the x direction of the OIS unit 102a output from the gain adjustment unit 33x and the angle shake information in the x direction of the imaging device ICD1 output from the gain adjustment unit 36x ( In other words, the image shift amount calculation unit 39x calculates the image blur that cannot be corrected by the optical image blur correction. The y-direction image shift amount ISy is the difference between the y-direction position information of the OIS unit 102a output from the gain adjustment unit 33y and the y-direction angle shake information of the imaging device ICD1 output from the gain adjustment unit 36y. In other words, the image shift amount calculation unit 39y calculates the image shift that cannot be corrected by the optical image blur correction.

<3rd frame>
In the optical image blur prevention photographed image I1 (3) of the third frame, the outline Oi1 (2) and the subject P of the optical image blur prevention photographed image I1 (2) are represented by dotted lines. In other words, in the optical image blur prevention photographed image I1 (3), the subject P1 is in a lower direction than the case of the optical image blur prevention photographed image I1 (2). It has moved to position 3. Therefore, based on the image blur correction error information ISe, the optical blur prevention shooting / electronic image blur is performed so that the subject P1 is positioned at the approximate center of the optical blur prevention shooting / electronic image blur correction image I2 (3). The corrected image I2 (3) is cut out from the optical image blurring prevention captured image I1 (3).

<4th frame>
In the optical image blur prevention photographed image I1 (4) of the fourth frame, the outline Oi1 (3) and the subject P of the optical image blur prevention photographed image I1 (3) are represented by dotted lines. In the optical image blur prevention photographed image I1 (4), the subject P1 is in the right direction, that is, from the position of the index point 3, compared with the optical image blur prevention photographed image I1 (3) indicated by the dotted line. It has moved to the position of reference number 4. Therefore, based on the image blur correction error information ISe, the optical blur prevention shooting / electronic image blur is performed so that the subject P1 is positioned at the approximate center of the optical blur prevention shooting / electronic image blur correction image I2 (4). The corrected image I2 (4) is cut out from the optical image blur-prevented photographed image I1 (4).

  As described above, the range in which the image data is cut out from the CCD 106 is shifted to generate the second image data Di2. (Hereinafter referred to as “shift cutout”). As described above, the second image data Di2 (1) to Di2 (4) for the shift-cut frame is separately stored in the image memory 44.

  Then, with respect to the second image data Di2 (1) of the optical blur prevention photographing / electronic image blur correction image I2 (1) cut out from the optical image blur prevention photographing image I1 (1) of the first frame. Second image data Di2 (2) of the second image data Di2 (2) of the optical blur prevention photographed / electronic image blur correction image I2 (2) cut out from the second frame of the optical image blur prevention photographed image I1 (2), the third frame The second image data Di2 (3) of the optical image blur prevention photograph / electronic image blur correction image I2 (3) cut out from the optical image blur prevention photograph image I1 (3) of the first and the fourth frame optical The second image data Di2 (4) of the optical blur prevention photographing / electronic image blur correction image I2 (4) cut out from the image blur prevention photographing image I1 (4) is superimposed. That is, data is added for each pixel on the same address in the four frames, and each added pixel data is represented by 1024 gradations.

  Specifically, the coordinates of the position of reference numeral 1 of the index point of the subject P1 of the first frame are r (20, 20), g (21, 20), g (20, 21), and b (21, 21). Represented by The coordinates of the position of reference numeral 2 of the index point of the subject P1 in the second frame are represented by r (16, 16), g (17, 16), g (16, 17), and b (17, 17). The coordinates of the position of reference numeral 3 of the index point of the subject P1 in the third frame are represented by r (16, 24), g (17, 24), g (16, 25), and b (17, 25). The coordinates of the index point 4 of the index point of the subject P1 in the fourth frame are represented by r (24, 24), g (25, 24), g (24, 25), and b (25, 25). In this case, R (20, 20), G (21, 20), G (20, 21), and B (represented by the following formulas (1), (2), (3), and (4), respectively: 21 and 21) image data represented by 1024 gradations is generated.

R (20,20) = r (20,20) + r (16,16) + r (16,24)
+ R (24, 24) (1)
G (21,20) = g (21,20) + g (17,16) + g (17,24)
+ G (25, 24) (2)
G (20,21) = g (20,21) + g (16,17) + g (16,25)
+ G (24, 25) (3)
B (21,21) = b (21,21) + b (17,17) + b (17,25)
+ B (25, 25) (4)

  In this way, the same calculation is performed for all the pixels of the second image data Di2 (1) to Di2 (4). For example, assuming that the number of pixels of the CCD 106 is 5 million pixels, optical blur prevention photographing / electronic image blurring is performed. Contour Oi2 () obtained by connecting the corrected image I2 (1) in the order of r (8,8), g (2551,8), b (2551,1911), g (8,1911), r (8,8). It is defined as a pixel area included in 1). Then, the pixels of the first frame, the second frame, the third frame, and the fourth frame of the optical blur prevention photographing / electronic image blur correction images I2 (1) to I2 (4) are expressed by the following equations (5), The third image data Di3 is generated by sequentially adding as represented by (6), (7), and (8).

R (8,8) = r (8,8) + r (4,4) + r (4,12)
+ R (12,12) (5)
G (9,8) = g (9,8) + g (5,4) + g (5,12)
+ G (13, 12) (6)
G (2551,8) = g (2551,8) + g (2547,4)
+ G (2547,12) + g (2555,12) (7)
B (2551, 1911) = b (2551, 1911) + b (2547, 1907)
+ B (2547, 1915) + b (2555, 1915)
.... (8)

  The fourth image data Di4 (not shown) generated by performing predetermined image processing such as white balance correction and γ correction on the third image data Di3 calculated based on the above formula is displayed on the display unit 111. The image is transferred to display an image or transferred to the memory card 112. In addition, instead of the generated image data subjected to the white balance correction and the γ correction as described above, the added third image data Di3 before such processing is displayed or stored in the memory. It may be transferred to the card 112. Alternatively, each of the third image data Di3 or the fourth image data Di4 may be divided by 4 and transferred without using the fifth image data Di5 (not shown) having 256 gradations. Note that the image signals corresponding to the third image data Di3, the fourth image data Di4, and the image data Di5 are the third image signal Sv3, the fourth image signal Sv4, and the fifth image signal, respectively. It shall be identified as Sv5.

  Next, the operation of the OIS unit controller 104a by the system controller 120 will be described with reference to the flowchart shown in FIG. In short, the system controller 120 detects a state in which the shutter button of the operation unit 110 is fully pressed, and the OIS unit immediately before the CCD 106 outputs the first image signal Sv1 (first image data Di1). The control unit 104a is activated. The system controller 120 outputs the first image signal Sv1 from the CCD 106 and performs the above-described electronic image blur correction via the image processing unit 107, and then performs the above-described third image data Di3, A description will be given of an example in which the image signal Sv (Sv3, Sv4, or Sv5) conceived for the fourth image data Di4 or the image data Di5 is stored in the memory card 112, and then the operation of the OIS unit controller 104a is terminated. Note that the processing shown in this flowchart is started when a state where the shutter button of the operation unit 110 is fully pressed is detected.

  First, in step S101, the operation of the OIS unit controller 104a is started. Then, the control loop described above functions to hold the image blur correction lens unit (or OIS unit) 102 at the reference position, and the shake angle information of the image pickup apparatus in which the output of the angular velocity sensor 34 is integrated is obtained. Optical image blur prevention functions as a command. Then, optical image blur prevention photographing is performed.

  In step S <b> 102, the first image signal Sv <b> 1 of the optical image blurring prevention captured image I <b> 1 for one frame is output from the CCD 106 to the image processing unit 107.

  In step S103, image blur correction error information ISe output from the OIS unit control unit 104a is image blur that cannot be corrected by the optical image blur correction processing by the image blur correction lens unit (OIS unit) 102 described above. Are calculated as the x-direction and y-direction image shift amounts. In the case of a 5 million pixel CCD, the image is composed of 2560 × 1920 pixels, and if the angle of view corresponding to 2560 pixels in the x direction is 50 degrees, it is expressed as an angle with 51.2 [pixel / degree] as a coefficient. The corrected error information can be converted into an image shift amount.

  In step S104a, the image cutout unit 42 cuts out the second image data Di2 of the optical blur prevention photographing / electronic image blur correction image I2 for one frame based on the shift amounts in the x direction and the y direction, Stored in the image memory 44.

  In step S105, the second image data Di2 (1), the second image data Di2 (2), the second image data Di2 (3), and the second image data Di2 (4) for four frames as described above. It is determined whether or not the storage in the image memory 44 of 4) is completed. That is, if the processing up to step S104a is for the first, second, and third frames, it is determined No in this step, and the control returns to step S102 described above. If the process up to step S104a is for the fourth frame, it is determined Yes in this step, and control proceeds to the next step S106.

  In step S106, as described above, the addition processing of the second image data Di2 for four frames is performed. In other words, by performing the cut-out and addition processing of the second image data Di2 based on the image blur correction error information ISe, an electronic image blur is obtained with respect to an image blur that cannot be completely removed by the optical image blur prevention process. Correction processing is performed, and image composition is performed. As a result, third image data Di3 is generated.

  In step S107, the third image data Di3 synthesized in step S106 is output to the display unit 111 or the memory card 112. Then, the photographing process is terminated. After the image processing in step S106, predetermined image processing is further performed on the third image data Di3 as described above, the fourth image data Di4 and further the image data Di5 are stopped, and the third image data Di3. Needless to say, it may be output in the same manner as.

(Second Embodiment)
Hereinafter, an imaging apparatus according to the second embodiment of the present invention will be described with reference to FIGS. 11, 12, and 13. The imaging device ICD2 according to the present embodiment is the same as the imaging device ICD1 according to the first embodiment shown in FIG. 1, except that the OIS unit 102a is replaced with the OIS unit 102b, and the OIS unit control unit 104a is replaced with the OIS unit control unit. 104b, the focus information calculation unit 109a is replaced with the focus information calculation unit 109b, and a feature point extraction unit 122 is newly provided. Therefore, unless otherwise required, features unique to the imaging device ICD2 will be described mainly.

  The feature point extraction unit 122 is connected to the image processing unit 107, the OIS unit control unit 104b, and the focusing information calculation unit 109b. Based on the second image data Di2 included in the second image signal Sv2 input from the image processing unit 107, the feature point extraction unit 122 generates an optical blur prevention / electronic image blur correction image I2 based on the user's intention. It is determined whether there is a subject P1 to be referred to, and the position of the feature point of the subject P1 is extracted. The feature point extraction unit 122 generates feature point motion vector information IVf based on the extracted position of the feature point.

  The OIS unit control unit 104b is one of image blur correction error information ISe including shake angle information of the main body of the imaging device ICD2 input from the OIS unit 102b and feature point motion vector information IVf input from the feature point extraction unit 122. Select. Then, the OIS unit control unit 104b performs optical image blur prevention photographing by controlling the movement of the blur correction lens unit (OIS unit) 102 based on the selected information. Then, the image processing unit 107 calculates the image shift amount based on the image blur correction error information image ISe so as to electronically correct the image blur that cannot be optically prevented in the optical image blur prevention captured image I1. To do.

  The focusing information calculation unit 109b includes at least the contrast information included in the second image signal Sv2 input from the image processing unit 107 via the feature point extraction unit 122 and the focus lens unit input from the focus driving unit 105. A function of calculating a defocus amount based on the position information 103 and outputting the calculated defocus amount to the focus driving unit 105 is provided. Then, when the feature point extraction unit 122 extracts the position information of the feature point of the subject P1, the focus information calculation unit 109b performs calculation using the contrast information in the vicinity of the feature point as an evaluation value.

  If there is no feature point, the focusing information calculation unit 109b performs an operation using contrast information as an evaluation value from a predetermined range. In addition, the feature point may be specified for the captured image displayed on the display unit 111 by using an input unit such as a touch panel.

  Next, the feature point extraction unit 122 will be described in detail with reference to FIG. The feature point extraction unit 122 includes an image division unit 71, a color information calculation unit 72, a reference position calculation unit 73, a reference color information storage unit 74, and an evaluation value calculation unit 75. Based on the second image signal Sv2 output from the image processing unit 107, the image dividing unit 71 sets the second image data Di2 (optical blur prevention photographing / electronic image blur correction image I2) in a plurality of areas. To divide. For example, 32 × 24 division or 16 × 12 division is performed.

  The color information calculation unit 72 calculates color information for each second image data Di2 divided by the image division unit 71. Specifically, the hue information IH is generated by calculating the hue H according to the following program. A circuit that can obtain the same effect as the execution result by the program may be configured, and the hue H may be obtained by the circuit.

V = max (r, g, b)
d = V−min (r, g, b)
S = d * 255 / V
if (S = 0) {H = 0}
else {if (V = r) H = (g−b) * 60 / d
if (V = g) H = (br−r) * 60 / d + 120
if (V = b) H = (r−g) * 60 / d + 240}
if (H <0) {H = H + 360}

  In the above program, r, g, and b are numerical values that represent each pixel described with reference to FIG. 8 in 256 gradations. Further, the above processing is performed in units of pixels included in a square defined by four points r (0,0), g (1,0), g (0,1), and b (1,1). May be. Note that g (1, 0) and g (0, 1) may be selected by selecting the larger one, or may be an average value. Hereinafter, units of r (2,0), g (3,0), g (2,1), and b (3,1), r (4,0), g (5,0), g (4 , 1), b (5, 1) units,..., The above processing may be performed in units of pixels included in a square defined by four points. Further, in the case of a 5 million pixel CCD composed of 2560 × 1920 pixels, the average values of r, g, and b are calculated in units of 80 pixels divided by 32 × 24 by the image dividing unit 71, The hue H may be calculated.

  In the reference color information storage unit 74, the feature point of the subject P1 intended by the user displayed on the display unit 111 among the hue information IH calculated by the color information calculation unit 72 (for example, reference numerals 1 and 2 shown in FIG. 9). , 3 and 4) are stored in advance. As a specific example, the reference color information is obtained when the user operates the operation unit 110 on the subject P1 displayed on the display unit 111 and points the cursor on the feature point and the intended image. Color information can be stored in the storage unit 74.

  The reference position calculation unit 73 compares the color information included in the image information to be captured by monitoring with the display unit 111 with the color information stored in advance, and whether or not there is a feature point of the subject intended by the user. If it exists, the position information IP is calculated and output to the OIS unit controller 104b and the evaluation value calculator 75. Note that a plurality of color information stored in advance exist as defaults and may be selected from them.

  Next, the OIS unit 102b will be described with reference to FIG. In the OIS unit 102b, motion vector detection units 60x and 60y, gain correction units 61x and 61x, and switches 62x and 62y are added to the OIS unit 102a shown in FIG. The switches 62x and 62y are labeled “SW” in the drawing for the sake of space.

  The motion vector detection unit 60x detects the motion vector Vx in the x direction from the position information IP in the x direction of the feature points calculated by the reference position calculation unit 73. The gain correction unit 61x converts the gain for the shake angle information from the motion vector Vx in the x direction. For example, if the angle of view corresponding to 2560 pixels in the x direction is 50 degrees with a 5 million pixel CCD and 2560 × 1920 pixels, 1 / 51.2 [degrees / pixel] is expressed as an angle with a coefficient K3. Convert to information.

  The switch 62x is connected to the gain correction unit 36x and the gain correction unit 61x. Then, based on the x-direction target position selection signal STx input from the system controller 130, either the gain correction unit 36x or the gain correction unit 61x is selected and connected to the comparison unit 37x. Specifically, when hue information IH that substantially matches the hue information IH already stored in the reference color information storage unit 74 exists in the image data, the gain correction unit 61x is selected, and the matching hue information IH Is not present in the image data, the gain correction unit 36x is selected.

  The motion vector detection unit 60y detects a motion vector Vy in the y direction from the position information IP in the y direction of the feature point calculated by the reference position calculation unit 73. The gain correction unit 61y converts the gain for the shake angle information from the motion vector Vy in the y direction. For example, if the angle of view corresponding to 1920 pixels in the y direction is 37.5 degrees with a 5 million pixel CCD and 2560 × 1920 pixels, 1 / 51.2 [degrees / pixel] is a coefficient K3 in terms of angle. Convert to the information represented.

  The switch 62y is connected to the gain correction unit 36y and the gain correction unit 61y. Based on the y-direction target position selection signal STy input from the system controller 130, either the gain correction unit 36y or the gain correction unit 61y is selected based on the position information IP output from the reference position calculation unit 73. And connected to the comparison unit 37y. Specifically, when hue information IH that substantially matches the hue information IH already stored in the reference color information storage unit 74 exists in the image data, the gain correction unit 61y is selected, and the matching hue information IH Is not present in the image data, the gain correction unit 36y is selected.

  Note that an example in which the selection operation of the switch 62x and the switch 62y is performed based on whether or not the feature point of the subject intended by the user exists is described. However, the selection operation of the switch 62x and the switch 62y may be performed by a user operating a menu button (not shown) provided in the operation unit 110.

  FIG. 14 shows two-dimensional static absolute coordinates in space with respect to the screen displayed on the display unit 111. For example, assuming that the origin (upper left corner) is 0 in the x direction and 0 in the y direction, the coordinates of the area B0 shown in the same figure are defined as (11, 8).

  The image blur correction function will be described with reference to FIG. In the figure, based on the first image signal Sv1 output from the CCD 106, four consecutive frames of the optical image blurring prevention captured images I1 (1) to I1 (4) displayed on the display unit 111 are illustrated. This is illustrated on the two-dimensional static absolute coordinate shown in FIG. The head of the subject P1 is set as a feature point and recognized as areas B1 (1) to B1 (4). Note that the relative position of the subject P1 in the optical image blur prevention captured images I1 (2) to I1 (4) is the same as the relative position of the subject P1 in the optical image blur prevention captured image I1 (1). is there.

  Regarding the first frame, the optical image blur prevention captured image I 1 (1) is located at the lower left corner of the screen of the display unit 111. The subject P1 is displayed in a substantially left half region of the optical image blur prevention captured image I1 (1). Note that the coordinates of the area B1 (1), which is the feature point of the subject P1 in this frame, are (5, 7).

  For the second frame, the optical image blur prevention photographed image I1 (2) moves by +2 and −1 coordinates in the x and y directions, respectively, compared to the optical image blur prevention photographed image I1 (1). ing. As a result, the coordinates of area B1 (2) are (7, 6).

  For the third frame, the optical image blur prevention captured image I1 (3) moves +2 coordinates and −1 coordinates in the x direction and the y direction, respectively, compared to the optical image blur prevention captured image I1 (2). ing. As a result, the coordinates of area B1 (3) are (9, 5).

  For the fourth frame, the optical image blur prevention photographed image I1 (4) moves further by +2 coordinates and −1 coordinates in the x direction and the y direction, respectively, compared to the optical image blur prevention photographed image I1 (3). is doing. As a result, the coordinates of area B1 (3) are (11, 4). That is, between the first frame and the fourth frame, the subject P1 moves on the two-dimensional static coordinates in space in the x and y directions in the +6 and -3 coordinates, respectively. This is also a state in which the imaging device ICD is moved in directions corresponding to −6 coordinates and +3 coordinates in the x direction and the y direction, respectively, when photographing the stationary subject P1.

  As described above, the feature point extraction unit 122 detects the feature points of the subject P1 as their positions as indicated by the areas B1a, B1b, B1c, and B1d, so that the x direction is +2 coordinates and the y direction for each frame. The motion vector of the feature point for -1 coordinate is detected. The movement vector V is used to move and control the image blur prevention lens 1 to perform optical image blur prevention photographing. Furthermore, as described with respect to the first embodiment, by performing electronic image blur correction based on the image blur correction error information ISe that could not be corrected, it is possible to improve the followability to the intended subject. The performance of image blur correction with respect to the subject to be improved can be improved.

  Next, with reference to FIG. 16, the image blur correction operation according to the present embodiment will be described. In the present embodiment, a program for causing the imaging apparatus ICD to execute the operation shown in FIG. Also in the present embodiment, as in the first embodiment described above, the system controller 130 detects from the CCD 106 when detecting that the shutter button of the operation unit 110 is fully pressed. Immediately before the image signal is output, the OIS unit control unit 104b is activated, and the CCD 106 outputs the first image signal Sv1 (optical image blur prevention captured image I1), and the image processing unit 107 outputs the first image signal Sv1. On the other hand, the electronic image blur correction is performed to generate the second image signal Sv2 (optical blur prevention photographing / electronic image blur correction image I2), and the second image signal Sv2 (second image data Di2) is generated. ) Is stored in the memory card 111 and then the operation of the OIS unit control unit 104a is terminated.

  Therefore, in step S201, the color information close to the reference color information (hue information IH) stored in advance in the first image data Di1 (first image signal Sv1) output from the CCD 106 by the feature point extraction unit 122 ( It is determined whether or not an area having the hue information IH) exists in each area divided by the image dividing unit 71 in which the color information is calculated.

  If there is no area having color information close to the reference color information, the control proceeds to step S101 described above, and the subsequent processing is the deflection angle of the photographing apparatus main body as described with reference to FIG. 15 in the first embodiment. An image blur correction photographing process based on the above is performed. On the other hand, if there is an area having color information close to the reference color information, the process proceeds to step S202.

  In step S202, the x-direction target position selection signal STx and the y-direction target position selection signal STy are output from the system controller 130 to the switches 62x and 62y. Then, the control proceeds to the next Step S203.

  In step S203, the motion vector V based on the feature point of the subject P1 intended by the user and output from the motion vector detection unit 60 is output from the switch 62x and the switch 62y as target position command information. Then, the control proceeds to step S101 described above, and the subsequent processing performs the optical image blur prevention described with respect to the first embodiment based on the target position command information. Then, based on the image blur correction error information ISe, electronic image blur correction is further performed on the image blur that could not be completely prevented from optical image blur. As described above, in the invention, the optical image blur prevention photographing means and the electronic image blur correction means constitute the image blur correction means for preventing the image blur of the subject that the user intends to photograph.

  As described above, as described in the embodiment of the present invention, it is possible to realize image blur correction control means for preventing image blur of a subject intended to be photographed by a user. In particular, in a small and lightweight imaging device such as a mobile camera that has the advantage of casual shooting, image blurring is likely to occur depending on the user's usage such as shooting while walking or one-handed shooting, and an optical image blur correction function is provided. In addition, by providing an electronic image blur correction function, the image blur correction effect can be greatly improved.

  Also, feature points of a subject to be photographed in advance are stored in the imaging apparatus main body, and when the stored feature points exist, an optical image is obtained using the motion vector as target position information so that the feature points are not blurred. By performing blur correction and further performing electronic image blur correction on correction errors that could not be corrected, the image blur correction effect of the subject intended by the user can be improved.

In the present embodiment, the configuration of the electronic image blur correction function may be realized by a circuit, or may be configured by software that performs processing by a microcomputer or the like. An example in which correction errors that could not be optically prevented after optical image blur prevention are further electronically described is specifically described. However, it is easy for those skilled in the art to configure the electronic correction before the optical image blur prevention, and to perform the optical image blur prevention and the electronic correction in parallel. It is clear that it is both effective and effective.

  The present invention is suitable for an imaging apparatus such as a digital still camera and a digital video camera.

1 is a block diagram showing a configuration of an imaging apparatus according to a first embodiment of the present invention. The perspective view which shows the structure of the OIS unit of FIG. 2 is an exploded perspective view of the main part of the OIS unit of FIG. Rear view of the pitching movement frame of FIG. VV sectional view in FIG. The block diagram which shows the structure of the image blurring correction function in the imaging device concerning the 2nd Embodiment of this invention The block diagram which shows the structure of the image process part of FIG. Image data arrangement explanatory diagram in Embodiment 1 of the present invention Operation explanatory diagram of the image blur correction function in the first embodiment of the present invention The block diagram of the imaging device in Embodiment 2 of this invention Detailed block diagram of feature point extraction unit in Embodiment 2 of the present invention Configuration block diagram of an image blur correction function in Embodiment 2 of the present invention Spatial coordinate explanatory diagram in Embodiment 2 of the present invention Operation explanatory diagram of the image blur correction function in Embodiment 2 of the present invention Operation Flowchart of Image Blur Correction Function in Embodiment 1 of the Present Invention Operation Flowchart of Image Blur Correction Function in Embodiment 2 of the Present Invention

Explanation of symbols

ICD1, ICD2 Imaging devices 31, 31x, 31y OIS actuators 32, 32x, 32y Position detection sensors 33, 33x, 33y Gain correction units 34, 34x, 34y Angular velocity sensors 35, 35x, 35y Integrators 36, 36x, 36y Gain correction units 37, 37x, 37y Comparison unit 38, 38x, 38y IS unit drive unit 39, 39x, 39y Image shift amount calculation unit 71 Image division unit 72 Color information calculation unit 73 Reference position calculation unit 74 Reference color information storage unit 75 Reinforcement value calculation Unit 100 lens barrel 101 zoom lens system 102a, 102b OIS unit 103 focus lens unit 104a, 104b OIS unit control unit 105 focus drive unit 106 CCD
107 Image processing units 109a and 109b Focus information calculation unit 110 Operation unit 111 Display unit 112 Memory card 120 System controller 122 Feature point extraction unit

Claims (10)

An imaging device that outputs an electrical image signal of a subject,
An imaging optical system that forms an optical image of the subject by a plurality of lens groups including an image blur prevention lens that controls image blur by controlling movement perpendicular to the optical axis;
An image sensor that captures an optical image of the subject and converts it into the electrical image signal;
Image processing means for displaying and storing the output image signal of the image sensor;
Image blur control means for controlling movement of the image blur prevention lens,
The image blur control unit includes an image blur correction error calculation unit that calculates an image blur correction error, and an image correction unit that corrects a cutout position of the image signal based on the image blur correction error. An imaging device. The image blur correction error calculating means is
Swing detection means for detecting blur information of the imaging optical system;
Position control means for performing movement control of the image blur prevention lens based on the blur information and detecting position information of the image blur prevention lens,
The imaging apparatus according to claim 1, wherein a difference between the blur information and the position information is calculated as an image blur correction error. The image blur correction error calculating means is
Feature point extraction means for extracting feature points from an image signal and calculating positional information of the feature points;
Position control means for performing movement control of the image blur prevention lens based on the position information of the feature point, and detecting position information of the image blur prevention lens,
The imaging apparatus according to claim 1, wherein a difference between the position information of the feature point and the position information of the image blur prevention lens is calculated as an image blur correction error. The image correcting means includes
A memory for storing a plurality of image signals;
The imaging apparatus according to claim 1, further comprising a combining unit that combines the image signals. The feature point extraction means includes:
Color information calculating means for calculating color information from the image signal;
Reference color information setting means for setting reference color information in advance;
4. The reference color information is compared with the calculated color information, and based on the result, feature points are extracted and position information of the feature points is calculated. Imaging device.   The imaging device according to claim 5, wherein at least one of the color information and the reference color information includes at least one of information on hue and information on saturation.   The image blur correction error calculating means calculates a difference between the position information of the feature point and the position information of the image blur prevention lens as an image blur correction error when a feature point is included in the image signal. The imaging apparatus according to claim 1, wherein the imaging apparatus is characterized.   The image blur correction error calculating means calculates, as an image blur correction error, any one of a difference between the position information of the feature point and the position information of the image blur prevention lens and a difference between the blur information of the imaging device and the position information of the lens. The image pickup apparatus according to claim 1, wherein the image pickup device displays or stores whether the image is being recorded.   The image blur prevention lens is controlled to move by an actuator that moves the image blur prevention lens perpendicular to the optical axis and a position detection sensor that detects a position of the image blur prevention lens. The imaging device described. The image pickup apparatus according to claim 1, wherein the image blur control unit controls movement of the image blur prevention lens based on angular velocity information output from an angular velocity sensor.

Images