CN1732406B - Blur correction camera system - Google Patents
Blur correction camera system Download PDFInfo
- Publication number
- CN1732406B CN1732406B CN200380107765.5A CN200380107765A CN1732406B CN 1732406 B CN1732406 B CN 1732406B CN 200380107765 A CN200380107765 A CN 200380107765A CN 1732406 B CN1732406 B CN 1732406B
- Authority
- CN
- China
- Prior art keywords
- image
- jitter correction
- correction
- computing
- distribution function
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Studio Devices (AREA)
- Adjustment Of Camera Lenses (AREA)
Abstract
A blur correction camera system comprising a blur correction lens driven based on a vibration detection signal obtained from an angular velocity sensor to correct an image blur, a point spread function computing unit for computing a point spread function, and image restoration computing unit for image-restoring a picked up image by image processing using a point spread function to correct an image blur. Part of an image blur beyond correction by a blur correction lens is further corrected by image restoring to obtain a higher-quality image.
Description
The application is with Japanese patent application 2002-374644 number (application on Dec 25th, 2002), Japanese patent application 2002-374661 number (application on Dec 25th, 2002), Japanese patent application 2002-374687 number (application on Dec 25th, 2002), Japanese patent application 2002-374704 number (application on Dec 25th, 2002), Japanese patent application 2002-374724 number (application on Dec 25th, 2002), Japanese patent application 2002-374748 number (application on Dec 25th, 2002), Japanese patent application 2002-374739 number (application on Dec 25th, 2002), and Japanese patent application 2003-026098 number (application on February 3rd, 2003) merges to its content wherein as citation as the basis.
Technical field
The present invention relates to be applicable to camera etc., detect because the technology of the shake of vibration that hand shake etc. cause and correcting image.
Background technology
All the time, in order to prevent because the deterioration of the photographic images that the hand shake that produces when taking causes is well known that the camera with image shake correction function.As the method for correction of jitter, be roughly two kinds of methods shown below.
First kind of method of compensating for hand shake is optical profile type method of compensating for hand shake as described below: by the vibration of vibration detecting sensor detection camera such as angular-rate sensor, acceleration transducer, drive optical systems such as phtographic lens or variable apex angle prism according to its detection limit, carry out jitter correction (for example, the spy opens clear 61-240780 communique).
Second kind of method of compensating for hand shake is electronic type correction method as described below: try to achieve amount of jitter from image of taking and the difference that temporarily is stored in the preceding image the storer, carry out jitter correction (for example, the spy opens clear 63-187883 communique) when image is read.Any one all is the methods of carrying out jitter correction when photography in real time for these two kinds of methods.
On the other hand, as the technology known to so far in the method for compensating for hand shake different with said method, being well known that the deterioration image reverted to does not have hand shake or fuzzy image.For example, open the spy and to disclose following method in the clear 62-127976 communique: the image deterioration that the shake when representing to photograph as distribution function with point causes, reverting to as distribution function according to this not have the image shaken.In addition, be well known that following technology: blur detecting device record hand wobble information only is set on camera, utilizes this information to carry out image at playback time and recover to handle, thus correction of jitter (for example, the spy opens flat 6-276512 communique).
At this, the concrete grammar that image is recovered to handle describes.So-called image recovers to be meant: utilize wobble information to handle the image of shake, revert to shake image seldom.
Now, if (x, y) be position coordinates on the picture, image when not shaking (hereinafter referred to as original image) be o (x, y) because the shake and the image (hereinafter referred to as dither image) of deterioration is z (x, y), (x, y), then this three satisfies following relation for p owing to the information (hereinafter referred to as a transform) of shaking the some picture of expanding.
z(x，y)＝o(x，y)
*p(x，y) (1)
At this,
*Therefore the computing of expression convolution integral is expressed from the next particularly.
z(x，y)＝∫∫σ(x，y)p(x-x′，y-y′)dx′dy′ (2)
It is carried out Fourier transform is that (u, v) regional, then formula (1), (2) become following formula (3) to spatial frequency.
Z(u，v)＝O(u，v)·P(u，v) (3)
Wherein, Z (u, v), O (u, v), P (u, v) be respectively z (x, y), o (x, y), p (x, frequency spectrum y).In addition, in formula (3), (u v) is called the spatial frequency transport function to P especially.
At this, except dither image z (x, y) outside, can by any means learn a transform p (x in the time of y), calculates frequency spectrum separately, by utilization make following formula 4 after formula 3 distortion calculate the frequency spectrum O of original image (u, v).
In formula (4), (u v) is called inverse filter to 1/P especially.The frequency spectrum of being calculated by formula 4 is carried out inverse Fourier transform, just can in the hope of original image o (x, y).Fig. 6 (a)～(c), Fig. 7 (a)～(d) are the figure that the image of explanation prior art recovers.
At this,, shown in Fig. 6 (b), shake is taken place uniformly on an axle (X-axis) direction for easy.
Choose this section, shown in Fig. 7 (a) as distribution function.Fig. 7 (b) carries out Fourier transform with it, and this is the spatial frequency transport function of the shake shown in Fig. 6 (a).This transport function it should be noted that having several places value is 0 local this point.Shown in Fig. 7 (c), there is the infinitely-great place that becomes when being inverse filter.Be applied to formula (4), then about certain specific spatial frequency, become as shown in the formula shown in (5), the spectrum value of original image is uncertain.
So-called transport function is 0 to mean and exist because shake does not have the frequency content of transmission (=information dropout) that the frequency content that this formulate is lost can't be recovered.This means original image is recovered fully.
In addition, in fact, the S filter that following formula is represented is used for the image recovery, so that inverse filter can not become infinitely great.
Fig. 7 (d) is that to make S filter be chart.
By being S filter, can be as formula (5) O (u, it is uncertain v) to become.
But, in above-mentioned existing optical profile type jitter correction and image recovery, have problem shown below.
The problem of＜optical profile type jitter correction 〉
In the optical profile type jitter correction, generally use angular-rate sensor as the sensor that detects vibration.In order will to be angle from the detected angular transformation of angular-rate sensor, the output valve (reference value) the when sensor when needing operation is static, known this reference value be subjected to the influence of the drift that causes owing to temperature easily.With reference to Fig. 8 (a) and (b) this problem is elaborated.
Fig. 8 (a) (b) is that expression comprises that the angular-rate sensor of the composition that drift about is exported, the output of reference value, at the figure of the amount of jitter of image planes.
Fig. 8 (a) has represented the variation of the angular-rate sensor relative with the time, for convenience of description, is assumed to the situation that produces the hand shake with sine wave.In Fig. 8 (a), the output of the shake sensor when waveform e0 represents with the shake of sine wave generation hand.In addition, any one all is reference values with low pass filter operation for waveform e1, e2, and the blocking frequency of waveform e1 is set to lower than waveform e2.In Fig. 8 (a), output valve is because the influence of environmental baseline and along with the departing from through the centre of oscillation of associating of time, thereby drift occurs.
Image planes amount of jitter when Fig. 8 (b) expression utilizes the angular-rate sensor output of Fig. 8 (a) and reference value to carry out jitter correction.Waveform f0, f1 among Fig. 8 (b), f2 are corresponding with waveform e0, e1, e2 among Fig. 8 (a) respectively, the amount of jitter of the image planes when waveform f0 represents that jitter correction is not carried out fully.Waveform f1 and waveform f2 relatively owing to use the reference value e1 of low blocking frequency, radio-frequency component is cut off and along with effluxion shake quantitative change is big.On the contrary, the blocking frequency ratio waveform f1 height of the reference value of waveform f2, therefore drift is littler than f1, but can not remove because the radio-frequency component that the hand shake produces.
So, removing the influence as shake and minimizing drift that produces owing to the hand shake is opposite problem, proofreaies and correct as the blocking frequency of shake and setting low-pass filter very difficult with the influence that reduces drift fully.Therefore have following problem: in detected amount of jitter, must detect error, the optical profile type jitter correction is also residual in the image that obtains a shake even carry out.
And then, in the optical profile type blurring compensation device, the switch of the ON/OFF that switches the jitter correction operation is set mostly, also there is following problem in this situation: forget that making this switch is ON, and when photography, do not carry out the jitter correction operation, thereby taken the image of picture shake.
The problem that＜image recovers 〉
Next, the problem that image is recovered describes.
Be well known that all the time: thus utilize S filter that dither image is recovered to handle the image that obtains, compare resolution with original image and raise.But,
Spatial frequency (u ', v ') in because the value of wave filter becomes big, when therefore the clutter that is comprised in image comprised this spatial frequency composition, the clutter composition was exaggerated.Its result appears at the unnecessary striped of generation in the image and makes the problem of image quality reduction.This striped can not become very big problem when original shake is very little, but shake will become clearly when very big, therefore becomes the just many of problem.
In addition, be provided with the camera that existing image recovers processing capacity, do not have to proofread and correct optically, just write down output data simply, recover processing according to these wobble information at playback time from shake sensors such as angular-rate sensors.Therefore, if the shake of image is excessive, carry out image recovery processing because the influence of above-mentioned striped etc. also can't improve the problem of image quality even will produce.
And then, image recovers needed some transform, come computing according to information such as angular-rate sensor outputs, carry out image according to its operation result and recover computing, but it is very many from the data volume of angular-rate sensor output, need carry out very a large amount of computings, have that operation efficiency is poor, a problem of needs arithmetic processing section at a high speed.
And then, even recover computing and just image recovered needed data recording to recording medium etc. or when sending to the outside not carrying out a transform computing and image, also there is following problem: as mentioned above because data volume is very big, therefore need jumbo recording medium, or the recording unit of needs high speed and communication facilities at a high speed etc., realize relatively difficulty, become the reason of cost up.
Summary of the invention
The following formation of the present invention.
(1) blur correction camera system of the present invention comprises: vibration detecting part, detect vibration and output vibration detection signal; The jitter correction optical system is driven according to vibration detection signal, proofreaies and correct the picture shake; Image pickup part is taken the picture that is formed by the photographic optical system that comprises the jitter correction optical system; Recover operational part with image, by Flame Image Process the image of being taken by image pickup part is carried out image and recover, proofread and correct the picture shake.Preferably, also have the computing point as the point of distribution function as the distribution function operational part, image recovers operational part, carries out image and recovers by handling image with point as distribution function.Preferably, also have the reference value operational part of the reference value of computing vibration detection signal, point is as the distribution function operational part, according to the operation result computing point of reference value operational part as distribution function.Preferably, blur correction camera system comprises: camera has vibration detecting part, jitter correction optical system, image pickup part, the some image recording portion as distribution function operational part, reference value operational part and document image; And external device (ED), have image and recover operational part, be the device that separates with camera, by importing the image that writes down by image recording portion and putting, carry out image and recover as distribution function.
Blur correction camera of the present invention comprises: vibration detecting part, detect vibration and output vibration detection signal; The jitter correction optical system is driven according to vibration detection signal, proofreaies and correct the picture shake; Image pickup part is taken the picture that is formed by the photographic optical system that comprises the jitter correction optical system; Image recording portion, the image that record is taken by image pickup part; With point as the distribution function operational part, image recovered computing is needed carries out computing as distribution function.Preferably, also have a little, utilize image recording portion or communication facilities, will output to the outside as the point of distribution function operational part computing as distribution function by point as the distribution function output device.Preferably, also have the reference value operational part of the reference value of computing vibration detection signal, point is as the distribution function operational part, and according to the operation result of reference value operational part, computing point is as distribution function.
Image recovery device of the present invention comprises: data input part, via with the communicating by letter and/or medium of outside, receive view data and the point that when view data is taken, obtains as distribution function; Recover operational part with image,, carry out image and recover, proofread and correct the picture shake by as distribution function view data being carried out Flame Image Process with point.
The computer program product that can computing machine reads in of the present invention has the jitter correction control program, and this control program has: data entry command, receive view data and the point that when view data is taken, obtains as distribution function; Recover the computing order with image,, carry out image and recover, proofread and correct the picture shake by as distribution function view data being carried out Flame Image Process with point.Preferably, computer program product is the recording medium that has write down control program.The control program of computer program product also can be to be used as data-signal and the carrier wave that comprises.
(2) blur correction camera system of the present invention comprises: vibration detecting part, detect vibration and output vibration detection signal; The reference value operational part, the reference value of computing vibration detection signal; The jitter correction optical system is driven according to vibration detection signal and reference value, proofreaies and correct the picture shake; Image pickup part is taken the picture that is formed by the photographic optical system that comprises the jitter correction optical system; Point utilizes reference value or vibration detection signal as the distribution function operational part, and computing point is as distribution function; Recover operational part with image,, carry out image and recover, proofread and correct the picture shake by as distribution function the image of being taken by image pickup part being carried out Flame Image Process with point.Preferably, also have a little, between following two kinds of situations, switch: utilize reference value or utilize vibration detection signal, put computing as the distribution function operational part as distribution function by point as distribution function computing switching part.Point also can be also used as switching and whether carry out the jitter correction operating and setting portion that jitter correction is operated by the jitter correction optical system as distribution function computing switching part.Preferably, when being carried out the jitter correction operation by the jitter correction optical system, point utilizes reference value computing point as distribution function as the distribution function operational part.When not carrying out the jitter correction operation by the jitter correction optical system, point also can utilize vibration detection signal computing point as distribution function as the distribution function operational part.Preferably, blur correction camera system comprises: camera has vibration detecting part, jitter correction optical system, image pickup part, the some image recording portion as distribution function operational part, reference value operational part and document image; And external device (ED), have image and recover operational part, be the device that separates with camera, by importing the image that writes down by image recording portion and putting, carry out image and recover as distribution function.
Blur correction camera of the present invention comprises: vibration detecting part, detect vibration and output vibration detection signal; The reference value operational part, the reference value of computing vibration detection signal; The jitter correction optical system is driven according to vibration detection signal and reference value, proofreaies and correct the picture shake; Image pickup part is taken the picture that is formed by the photographic optical system that comprises the jitter correction optical system; Image recording portion, the image that record is taken by image pickup part; With the point as the distribution function operational part, utilize reference value or vibration detection signal, computing point is as distribution function.Preferably, also have a little, utilize image recording portion or communication facilities, will output to the outside as the point of distribution function operational part computing as distribution function by point as the distribution function output device.
(3) blur correction camera of the present invention comprises: vibration detecting part, detect vibration and output vibration detection signal; The reference value operational part, the reference value of computing vibration detection signal; The jitter correction optical system is driven according to vibration detection signal and reference value, proofreaies and correct the picture shake; Image pickup part is taken the picture that is formed by the photographic optical system that comprises the jitter correction optical system; Point is as the distribution function operational part, and is needed as distribution function according to reference value arithmograph picture recovery computing; With quantity of information minimizing portion, be used in a little as the reference value of the computing of distribution function and/or the point after the computing quantity of information and reduce as distribution function.Preferably, quantity of information minimizing portion by the data of the point after extraction reference value and/or the computing as distribution function, reduces quantity of information.Preferably, quantity of information minimizing portion reduces quantity of information and recovers the needed quantity of information of computing to guarantee image.
(4) blur correction camera system of the present invention comprises: vibration detecting part, detect vibration and output vibration detection signal; Image pickup part will be taken as original image by the picture that the photographic optical system that comprises the jitter correction optical system forms; Original image preservation portion preserves original image; Image recovers operational part, can change the parameter relevant with Flame Image Process, utilizes parameter by Flame Image Process original image to be carried out image and recovers, and makes the recovery image of having proofreaied and correct the picture shake; With restoration result preservation portion, will be used for parameter and/or recovery image that image recovers the Flame Image Process of operational part, set up related and preservation with original image.Preferably, also have the computing point as the point of distribution function as the distribution function operational part, image recovers operational part, carries out image and recovers by handling image with point as distribution function, parameter comprises a little as distribution function.Preferably, restoration result preservation portion can preserve with many groups and recover the corresponding a plurality of parameters of image and/or a plurality of recovery image.Preferably, blur correction camera system comprises: camera has vibration detecting part, is actuated to proofread and correct the jitter correction optical system, image pickup part, point of picture shake reference value operational part, the original image preservation portion as the reference value of distribution function operational part, computing vibration detection signal according to vibration detection signal; And external device (ED), have image and recover operational part and restoration result preservation portion, be the device that separates with camera, by importing the original image that writes down by original image preservation portion and putting, carry out image and recover as distribution function.
Image recovery device of the present invention comprises: data input part, via with the communicating by letter and/or medium of outside, resulting when receiving original digital image data and original digital image data and taking as distribution function; Image recovers operational part, can change the parameter relevant with Flame Image Process, utilizes to comprise a little and by Flame Image Process original digital image data to be carried out image and to recover as the parameter of distribution function, makes the recovery image of having proofreaied and correct as shaking; With restoration result preservation portion, will be used for parameter and/or recovery image that image recovers the Flame Image Process of operational part, set up related and preservation with original image.
The computer program product that can computing machine reads in of the present invention has the jitter correction control program, and this control program comprises: data entry command, and resulting when receiving original digital image data and original digital image data and taking as distribution function; Image recovers the computing order, can change the parameter relevant with Flame Image Process, utilizes to comprise a little and by Flame Image Process original digital image data to be carried out image and to recover as the parameter of distribution function, makes the recovery image of having proofreaied and correct as shaking; With the restoration result hold-over command, will be used for parameter and/or recovery image that image recovers the Flame Image Process of operational part, set up related and preservation with original image.Preferably, computer program product is the recording medium that has write down control program.The control program of computer program product also can be to be used as data-signal and the carrier wave that comprises.
(5) blur correction camera of the present invention comprises: vibration detecting part, detect vibration and output vibration detection signal; The optics blur correcting device drives the jitter correction optical system according to vibration detection signal, proofreaies and correct the picture shake; Point is as the distribution function operational part, and the picture shake is needed carries out computing as distribution function to recovering by Flame Image Process; Recover judging part with image, judge whether to carry out image recovery mode, this image recovery mode is recovered to carry out jitter correction by image, or is used for recovering to carry out the preparation of jitter correction by image.Preferably, image recovers judging part, judges whether that according to vibration detection signal needs carry out image recovery mode.Image recovers judging part, also can judge whether that needs carry out image recovery mode according to shutter speed.Image recovers judging part, can judge whether that also needs carry out image recovery mode according to the focal length of photographic optical system.Image recovers judging part, also can judge whether that as distribution function needs carry out image recovery mode according to point.Can also further have announcement apparatus,, notify this information when image recovers judgement section judges when not needing to carry out image recovery mode.When image recovers judgement section judges when not needing to carry out image recovery mode, also can not carry out image recovery mode.When image recovers judgement section judges when not needing to carry out image recovery mode, also the savepoint picture is not distinguished function.
(6) blur correction camera of the present invention comprises: vibration detecting part, detect vibration and output vibration detection signal; The reference value operational part, the reference value of computing vibration detection signal; The jitter correction optical system is driven according to reference value and vibration detection signal, proofreaies and correct the picture shake; Drive control part, according to vibration detection signal and reference value, the operation of control jitter correction optical system; Point is as the distribution function operational part, according to reference value, the image of the shake of proofreading and correct picture by Flame Image Process recovered needed carry out computing as distribution function; With the tremble correction mode selection portion, selection is carried out the optical profile type jitter correction operation of jitter correction except utilizing the jitter correction optical system, whether carry out image recovery mode, this image recovery mode, recover to carry out jitter correction by image, or be used for recovering to carry out the preparation of jitter correction, drive control part by image, according to the selection mode of tremble correction mode selection portion, change the control content of jitter correction optical system.Preferably, drive control part according to the selection mode of tremble correction mode selection portion, changes the operational method of reference value, thereby changes the control content of correcting optical system.Preferably, the reference value operational part utilizes the low pass filter operation reference value, and drive control part by changing the cutoff frequency of low-pass filter, changes the control content of jitter correction optical system.Preferably, drive control part carries out the cutoff frequency of the selection mode that image recovers with the tremble correction mode selection portion, is set at the high frequency of cutoff frequency of not carrying out the selection mode that image recovers than tremble correction mode selection portion.
(7) blur correction camera comprises: vibration detecting part, detect vibration and output vibration detection signal; The optical profile type blur correcting device drives the jitter correction optical system according to vibration detection signal, proofreaies and correct the picture shake; Point is as the distribution function operational part, and it is needed as distribution function that the arithmograph picture recovers, and this image recovers, and by Flame Image Process the shake of not proofreaied and correct fully by the optical profile type blur correcting device is recovered; With the tremble correction mode selection portion, utilizing the optical profile type calibration equipment to carry out selecting between the optical profile type tremble correction mode of jitter correction and the image recovery mode, image recovery mode, recover to carry out jitter correction by image, or be used for recovering to carry out the preparation of jitter correction by image, the tremble correction mode selection portion when selecting image recovery mode, is also selected the optical profile type tremble correction mode simultaneously.
Blur correction camera of the present invention comprises: vibration detecting part, detect vibration and output vibration detection signal; The optical profile type blur correcting device drives the jitter correction optical system according to vibration detection signal, proofreaies and correct the picture shake; Point is as the distribution function operational part, and it is needed as distribution function that the arithmograph picture recovers, and this image recovers, and by Flame Image Process the shake of not proofreaied and correct fully by the optical profile type blur correcting device is recovered; With the tremble correction mode selection portion, utilizing the optical profile type calibration equipment to carry out selecting between the optical profile type tremble correction mode of jitter correction and the image recovery mode, image recovery mode, recover to carry out jitter correction by image, or be used for recovering to carry out the preparation of jitter correction by image, the tremble correction mode selection portion under the state of not selecting the optical profile type tremble correction mode, can't be selected image recovery mode.
Blur correction camera of the present invention comprises: vibration detecting part, detect vibration and output vibration detection signal; The optical profile type blur correcting device drives the jitter correction optical system according to vibration detection signal, proofreaies and correct the picture shake; Point is as the distribution function operational part, and it is needed as distribution function that the arithmograph picture recovers, and this image recovers, and by Flame Image Process the shake of not proofreaied and correct fully by the optical profile type blur correcting device is recovered; With the tremble correction mode selection portion, utilizing the optical profile type calibration equipment to carry out selecting between the optical profile type tremble correction mode of jitter correction and the image recovery mode, image recovery mode, recover to carry out jitter correction by image, or be used for recovering to carry out the preparation of jitter correction by image, the tremble correction mode selection portion is under the state of not selecting the optical profile type tremble correction mode, when selecting image recovery mode, warn.
Blur correction camera of the present invention comprises: vibration detecting part, detect vibration and output vibration detection signal; The optical profile type blur correcting device drives the jitter correction optical system according to vibration detection signal, proofreaies and correct the picture shake; With the point as the distribution function operational part, it is needed as distribution function that the arithmograph picture recovers, this image recovers, by Flame Image Process the shake of not proofreaied and correct fully by the optical profile type blur correcting device is recovered, the point that is carried out as the distribution function operational part by point can be undertaken by operating optical formula blur correcting device as the computing of distribution function.
(8) blur correction camera system of the present invention comprises: the jitter correction optical system, proofread and correct the picture shake; Vibration detecting part detects vibration and output vibration signal;
The reference value operational part, the reference value of computing vibration signal; Drive division drives the jitter correction optical system; Position detection part, the position of detection jitter correction optical system, outgoing position signal; Control part, according to reference value, vibration signal and position signalling, the driving of control jitter correction optical system is to proofread and correct the shake of the body image that is taken that causes owing to vibration; Image pickup part is taken the picture that is formed by the photographic optical system that comprises the jitter correction optical system; Control position error efferent, the driving target location of the jitter correction optical system that will be obtained by control part and poor from the actual activation point of the jitter correction optical system of position detection part output are exported as the control position error; Recover operational part with image, carry out image and recover, proofread and correct the picture shake by the image of being taken by image pickup part having been added the Flame Image Process of control position error.Preferably, also comprise: point is as the distribution function operational part, image recovered computing is needed carries out computing as distribution function; With function correction portion, utilize control position error correction point as distribution function, image recovers operational part, carries out Flame Image Process by the point after proofreading and correct with function correction portion as distribution function, recovers and carry out image.Preferably, also comprise a little as the distribution function operational part, image recovered computing is needed carries out computing as distribution function, point is as distribution function, according to (a) reference value and control position error, (b) vibration signal and control position error, (c) reference value and vibration signal and control position error or (d) control position error, carry out computing, image recovers operational part, by carrying out Flame Image Process as distribution function, recover and carry out image with point.Preferably, blur correction camera system comprises: camera has vibration detecting part, jitter correction optical system, image pickup part, the some image recording portion as distribution function operational part, reference value operational part, document image at least; And external device (ED), have image at least and recover operational part, be the device that separates with camera, by importing the image that writes down by image recording portion and putting, carry out image and recover as distribution function.Blur correction camera system also can comprise: camera has the image recording portion of vibration detecting part, jitter correction optical system, image pickup part, reference value operational part, document image at least; And external device (ED), have at least a little and recover operational part as distribution function operational part and image, be the device that separates with camera, by importing the image that writes down by image recording portion and putting, carry out image and recover as distribution function.
Blur correction camera of the present invention comprises: the jitter correction optical system, proofread and correct the picture shake; Vibration detecting part detects vibration and output vibration signal; The reference value operational part, the reference value of computing vibration signal; Drive division drives the jitter correction optical system; Position detection part, the position and the outgoing position signal of detection jitter correction optical system; Control part, according to reference value, vibration signal and position signalling, the driving of control jitter correction optical system is to proofread and correct the shake of the body image that is taken that causes owing to vibration; Image pickup part is taken the picture that is formed by the photographic optical system that comprises the jitter correction optical system; Image recording portion, document image; Control position error efferent, the driving target location of the jitter correction optical system that will be obtained by control part and poor from the actual activation point of the jitter correction optical system of position detection part output are exported as the control position error; Point is as the distribution function operational part, image recovered computing is needed carries out computing as distribution function; Function correction portion utilizes control position error correction point as distribution function; And output peripheral equipment, utilize image recording portion or communication facilities, will output to the outside as distribution function by the point that correction unit is proofreaied and correct.
Blur correction camera of the present invention comprises: the jitter correction optical system, proofread and correct the picture shake; Vibration detecting part detects vibration and output vibration signal; The reference value operational part, the reference value of computing vibration signal; Drive division drives the jitter correction optical system; Position detection part, the position and the outgoing position signal of detection jitter correction optical system; Control part, according to reference value, vibration signal and position signalling, the driving of control jitter correction optical system is to proofread and correct the shake of the body image that is taken that causes owing to vibration; Image pickup part is taken the picture that is formed by the photographic optical system that comprises the jitter correction optical system; Image recording portion, document image; Control position error efferent, the driving target location of the jitter correction optical system that will be obtained by control part and poor from the actual activation point of the jitter correction optical system of position detection part output are exported as the control position error; Point is as the distribution function operational part, image recovered computing is needed carries out computing as distribution function; And output peripheral equipment, utilize image recording portion or communication facilities, to put and output to the outside as distribution function, point is as distribution function, according to (a) reference value and control position error, (b) vibration signal and control position error, (c) reference value and vibration signal and control position error or (d) control position error, carry out computing.
Blur correction camera of the present invention comprises: the jitter correction optical system, proofread and correct the picture shake; Vibration detecting part detects vibration and output vibration signal; The reference value operational part, the reference value of computing vibration signal; Drive division drives the jitter correction optical system; Position detection part, the position and the outgoing position signal of detection jitter correction optical system; Control part, according to reference value, vibration signal and position signalling, the driving of control jitter correction optical system is to proofread and correct the shake of the body image that is taken that causes owing to vibration; Image pickup part is taken the picture that is formed by the photographic optical system that comprises the jitter correction optical system; Image recording portion, document image; Control position error efferent, the driving target location of the jitter correction optical system that will be obtained by control part and poor from the actual activation point of the jitter correction optical system of position detection part output are exported as the control position error; And output peripheral equipment, utilize image recording portion or communication facilities, will put and output to the outside as distribution function.
Image recovery device of the present invention, comprise: data input part, via with the communicating by letter and/or medium of outside, receive according to the driving target location of jitter correction optical system and resulting as distribution function when control position error, view data and view data that the difference of the actual activation point of the jitter correction optical system of position detection part output is tried to achieve are taken; Function correction portion utilizes control position error correction point as distribution function; Recover operational part with image, as distribution function view data is carried out Flame Image Process, carry out image and recover, proofread and correct the picture shake by the point after proofreading and correct with function correction portion.
Image recovery device of the present invention, comprise: data input part, via with the communicating by letter and/or medium of outside, receive according to the driving target location of jitter correction optical system and when control position error, view data and view data that the difference of the actual activation point of the jitter correction optical system of position detection part output is tried to achieve are taken resulting vibration signal; Point is as the distribution function operational part, image recovered computing is needed carries out computing as distribution function; Function correction portion utilizes control position error correction point as distribution function; Recover operational part with image, as distribution function view data is carried out Flame Image Process, carry out image and recover, proofread and correct the picture shake by the point after proofreading and correct with function correction portion.
Image recovery device of the present invention, comprise: data input part, via with the communicating by letter and/or medium of outside, receive according to the driving target location of jitter correction optical system and when control position error, view data and view data that the difference of the actual activation point of the jitter correction optical system of position detection part output is tried to achieve are taken resulting vibration signal; Point is as the distribution function operational part, image recovered computing is needed carries out computing as distribution function; Recover operational part with image, by as distribution function view data being carried out Flame Image Process with point, carrying out image recovers, proofread and correct the picture shake, point is as distribution function, according to (a) reference value and control position error, (b) vibration signal and control position error, (c) reference value and vibration signal and control position error or (d) control position error, carry out computing.
The computer program product that can computing machine reads in of the present invention, has the jitter correction control program, this control program comprises: data entry command, via with the communicating by letter and/or medium of outside, receive according to the driving target location of jitter correction optical system and resulting as distribution function when control position error, view data and view data that the difference of the actual activation point of the jitter correction optical system of position detection part output is tried to achieve are taken; The function correction order utilizes control position error correction point as distribution function; Recover the computing order with image, as distribution function view data is carried out Flame Image Process, carry out image and recover, proofread and correct the picture shake by the point after proofreading and correct with function correction portion.
The computer program product that can computing machine reads in of the present invention, has the jitter correction control program, this control program comprises: data entry command, via with the communicating by letter and/or medium of outside, receive according to the driving target location of jitter correction optical system and when control position error, view data and view data that the difference of the actual activation point of the jitter correction optical system of position detection part output is tried to achieve are taken resulting vibration signal; Point is as distribution function computing order, image recovered computing is needed carries out computing as distribution function; The function correction order utilizes control position error correction point as distribution function; Recover the computing order with image, as distribution function view data is carried out Flame Image Process, carry out image and recover, proofread and correct the picture shake by the point after proofreading and correct with function correction portion.
The computer program product that can computing machine reads in of the present invention, has the jitter correction control program, this control program comprises: data entry command, via with the communicating by letter and/or medium of outside, receive according to the driving target location of jitter correction optical system and when control position error, view data and view data that the difference of the actual activation point of the jitter correction optical system of position detection part output is tried to achieve are taken resulting vibration signal; Point is as distribution function computing order, it is needed as distribution function that image is recovered computing, according to (a) reference value and control position error, (b) vibration signal and control position error, (c) reference value and vibration signal and control position error or (d) control position error, carry out computing; Recover the computing order with image,, carry out image and recover, proofread and correct the picture shake by as distribution function view data being carried out Flame Image Process with point.Computer program product is the recording medium that has write down control program.Control program is to be used as data-signal and the carrier wave that comprises.
Description of drawings
Fig. 1 is the block diagram of the system architecture of first embodiment of expression blur correction camera of the present invention.
Fig. 2 is an example of the frame arrangement plan of the blur correction camera in first embodiment.
The control block diagram that Fig. 3 describes for the control operation to the jitter correction control part of optical profile type corrective system.
The figure that Fig. 4 (a)～(c) recovers for the image in the explanation present embodiment.
The figure that Fig. 5 (a)～(d) recovers for the image in the explanation present embodiment.
Fig. 6 (a)～(c) is first figure of the image recovery of explanation prior art.
Fig. 7 (a)～(d) is second figure of the image recovery of explanation prior art.
Fig. 8 (a) (b) for the angular-rate sensor that expression comprises the composition that drift about is exported, the output of reference value, at the figure of the amount of jitter of image planes.
Fig. 9 is the block diagram of the system architecture of second embodiment of expression blur correction camera of the present invention.
Figure 10 is an example of the frame arrangement plan of the blur correction camera in second embodiment.
The block diagram that Figure 11 describes for the operation to the jitter correction control part in second embodiment.
Figure 12 is the process flow diagram of the operation of the camera in expression second embodiment.
Figure 13 is the exposure in expression second embodiment and the process flow diagram of image recovery operation.
Figure 14 is the block diagram of the system architecture of the 3rd embodiment of expression blur correction camera of the present invention.
The process flow diagram of the basic operation of the camera when Figure 15 carries out the jitter correction operation for expression.
The process flow diagram of the basic operation of the camera when Figure 16 is the optical profile type jitter correction operator scheme of representing in the 3rd embodiment.
The process flow diagram of the basic operation of the camera when Figure 17 is the image recovery operation pattern of representing in the 3rd embodiment.
Figure 18 judges whether that for detecting data according to shake in expression the 3rd embodiment image that carries out a transform computing recovers the process flow diagram of the detailed operation of judging part.
Figure 19 is at length having represented to obtain the process flow diagram of some transform computing with the operation of data.
Figure 20 is the process flow diagram of the basic operation of presentation video replay device.
Figure 21 is the figure of the operational example of concrete image demonstration of expression and various parameters.
Figure 22 (a)～(c) is the figure of the operational example of concrete image demonstration of expression and various parameters.
Figure 23 is a synoptic diagram of having represented the relation of recovery image, parameter and the original image preserved in S2110.
Figure 24 is the process flow diagram of the image recovery operation in expression the 4th embodiment.
Figure 25 is for judging whether to carry out the process flow diagram that the image image restored is recovered the detail operations of judging part according to a transform in expression the 4th embodiment.
Figure 26 is the block diagram of the system architecture of the 5th embodiment of expression blur correction camera of the present invention.
The process flow diagram that Figure 27 represents for the operation steps when taking to camera main-body in the 5th embodiment and lens changeable.
Figure 28 is for following Figure 27 process flow diagram that the operation steps when taking is represented to camera main-body in the 5th embodiment and lens changeable.
Embodiment
Below, with reference to accompanying drawing etc. embodiments of the present invention further are elaborated.
＜the first embodiment 〉
Fig. 1 is the block diagram of the system architecture of first embodiment of expression blur correction camera of the present invention.
The angular-rate sensor 10 of optical profile type corrective system 500 is the vibration detecting parts that detect the vibration that blur correction camera 1 is applied with magnitude of angular velocity.Angular-rate sensor 10 utilizes Coriolis force to detect angular velocity, and testing result is exported as voltage signal.
Utilize Fig. 2 that the processing of angular-rate sensor 10 and output signal thereof is described.
Angular-rate sensor 10 respectively being provided with one accordingly perpendicular to the X-axis of the optical axis I of phtographic lens and on perpendicular to the Y-axis of X-axis, is detected the vibration of blur correction camera 1 by respectively two-dimensionally.Angular-rate sensor 10 can be only carries out the detection of angular velocity during by power suppling part 90 supply powers.In addition, in Fig. 1, only represented an angular-rate sensor 10, in Fig. 2, represented angular-rate sensor 10a, the 10b of X-direction and Y direction in order to understand easily.
Enlarging section 420 is the enlarging section of the output of amplification angular-rate sensor 10.
A/D converter section 20 will be digital signal from analog signal conversion from the vibration signal of angular-rate sensor 10, and be sent to jitter correction control part 30 for being the converter of digital signal with analog signal conversion.
A/D converter 440 will be for being converted to the converter of digital signal from the positional information (simulating signal) that position detection part 60 transmits the jitter correction camera lens 70 that comes.The jitter correction lens location information of having changed is sent to jitter correction control part 30.
D/A converter 430 for be used for in 30 computings of jitter correction control part drive signal (digital signal) be converted to the D/A converter of simulating signal.Simulating signal after the conversion is sent to optical system drive division 50.
In general, because it is less from the output of angular-rate sensor 10, even directly handle with its digitizing and in microcomputer 460 by A/D converter 20, the capacity of decomposition of magnitude of angular velocity low excessively (magnitude of angular velocity of 1 correspondence is excessive) still can't be carried out correct vibration detection.Therefore can't improve the precision of jitter correction.So, before being input to A/D converter 20, amplify angular velocity signal by amplifier 420.So, the capacity of decomposition (magnitude of angular velocity of 1 correspondence is reduced) of the magnitude of angular velocity in microcomputer 460 can be improved, the precision of jitter correction can be improved.
In enlarging section 420, corresponding with angular-rate sensor 10a, 10b respectively two enlarging section 420a, 420b are set.In addition, at this, also can add low-pass filter, this low-pass filter not only carries out the amplification of signal, is purpose to reduce the high frequency clutter that comprises in the sensor output also.
In addition, as shown in Figure 2, A/D converter section 20, jitter correction control part 30, optical system drive division 50, position detection part 60, D/A converter 430 and A/D converter 440 comprise corresponding with X-direction and Y direction respectively 20a, 20b; 30a, 30b; 50a, 50b; 60a, 60b; 430a, 430b and 440a, 440b.Yet, because the X-direction and the operation in the Y direction of each one is identical, so followingly X-direction and Y direction are not carried out additional symbols.
Below, describe according to Fig. 1.
Jitter correction control part 30 is following part: according to by angular-rate sensor 10 detected vibration signals with by the positional information of position detection part 60 detected jitter correction camera lenses 70 described later, computing is used to drive the drive signal of jitter correction camera lens 70, and drive signal is outputed to optical system drive division 50.In addition, jitter correction control part 30 also has the effect as the control position error efferent of output error described later (control position error).
In jitter correction control part 30, comprise reference value operational part 31 (with reference to Fig. 3).The part of the reference value of reference value operational part 31 vibration signal that to be computings obtain from angular-rate sensor 10 in the present embodiment, is used wave digital lowpass filter (LPF), with the output of LPF as reference value.Control operation for being undertaken by jitter correction control part 30 describes afterwards.
Jitter correction camera lens 70 is parts of the photographic optical system of camera, is the jitter correction optical system that is made of the lens group single-lens or that formed by a plurality of camera lenses that can move in the plane of the optical axis I that is approximately perpendicular to photographic optical system.Jitter correction camera lens 70 is driven on the direction that is approximately perpendicular to optical axis I by optical system drive division 50, and makes the optical axis I deflection of photographic optical system.
The shake of photo iseikonia is because the vibration that hand shake etc. applies camera, produces thereby the image drift of imaging surface is moving in exposure.In the blur correction camera 1 of present embodiment, can detect the vibration that blur correction camera 1 is applied by angular-rate sensor 10.And, if detect the vibration that blur correction camera 1 is applied, just can learn the moving of picture of the imaging surface that causes by this vibration, therefore can drive jitter correction camera lens 70, be corrected into the moving of picture on the image planes promptly as shake to be suppressed to moving of picture on the image planes.
Control part 80 is control parts of the integrated operation of control blur correction camera 1, controls the various control computings of jitter correction control part 30, some transform operational part 100, exposure control part 150, focus lens position detection part 160, focal length test section 170, flash of light control part 180 etc. etc.
Point transform operational part 100 is following as the distribution function operational part: according to the various information that obtain from jitter correction control part 30, exposure control part 150, focus lens position detection part 160, focal length test section 170 etc., the some transform in the computing exposure (point is as distribution function).
When the optical profile type jitter correction that is undertaken by jitter correction camera lens 70 was complete, the some transform was 1 point, but optical profile type jitter correction and not exclusively in fact, therefore putting transform is not 1 point.That is, residual have by jitter correction camera lens 70 do not proofread and correct completely as shake (jitter correction remnants).In this some transform of calculating, when carrying out further jitter correction, do not use the jitter correction remnants that remain in fully on the imaging surface proofreading and correct by Flame Image Process afterwards by jitter correction camera lens 70.
The concrete mode of image recording portion 120 for example can be compact disk (コ Application パ Network ト デ イ ス Network) (trade mark), smart media (ス マ one ト メ デ イ ア) removable recording mediums such as (trade marks), also can be to carry out the memory buffer that image transmits.
Focus lens position detection part 160 is the parts that detect the position of not shown focus lens.By detecting the position of focus lens, the needed distance of computing that can the calculation level transform from imaging surface to the body that is taken.
Flash of light control part 180 is luminous parts of control flash light emission portion 181.
Operating portion 190 has half by switch (SW1) 191, press switch (SW2) 192 etc. entirely.
Thereby are the switches that partly are ON that make not shown release-push partly by the operation interlock by switch 191.By making this is ON by switch 191 partly, the photometry computing that beginning is undertaken by not shown photometric measurer, automatic focus driving etc.In addition, synchronous with this ON that partly presses switch 191 when half presses timer 195 for OFF, make partly to be ON by timer 195.
Thereby are the switches that are ON entirely by the operation interlock that make not shown release-push by switch 192 entirely.By making this be ON by switch 192 entirely, the image that carry out the switching of the shutter that undertaken by not shown tripper, is undertaken by imageing sensor a series of shooting operation such as write.
It is following part that image recovers operational part 210: according to the image recording portion 120 from blur correction camera 1 transmit the view data of coming, corresponding to the some transform information of view data and be used for image and recover the various parameters handled, the image that carries out the shake that comprised in the correcting image recovers processing.The image that recovers in the operational part 210 at image recovers to use the described S filter of formula (6) (ウ イ Na one Off イ Le タ), but be not limited to this in the processing, also can use other method.
Next, for the part of jitter correction control part 30 connections, comprise that the control of optical profile type jitter correction operation describes.
Fig. 3 is the control block diagram that the control operation to the jitter correction control part 30 of optical profile type corrective system 500 describes.
At first, detect the vibration that camera is applied by angular-rate sensor 10.Angular-rate sensor 10 uses the piezoelectric vibration formula angular-rate sensor that detects Coriolis force usually.The output of angular-rate sensor 10 is imported into reference value operational part (low-frequency component extraction) 31 via A/D converter 20.
Reference value operational part 31 is the parts according to the reference value of the output computing shake of angular-rate sensor 10.Usually the reference value of hand shake be that output (hereinafter referred to as zero output) value under the complete static state of angular-rate sensor 10 gets final product.But this zero output value changes according to environmental baselines such as drift or temperature, and therefore can't make reference value is fixed value.Therefore, the state that uses from reality, be cameraman's hand dither signal computing reference value, must try to achieve zero output.In the reference value computing, use wave digital lowpass filter (LFP).
It is low as far as possible that the cutoff frequency fc of wave digital lowpass filter preferably is set, but described in the explanation of prior art, when the mistake of cutoff frequency fc setting is hanged down, be subjected to the influence of sensor drift easily.In addition, set on the contrary higher the time, the frequency content that fc is following is not owing to carry out optical correction, therefore as the picture shake and residual.Tell about in detail afterwards, try to achieve a transform, the picture shake that recovers in optical correction, not obtain fully by aftertreatment by carrying out image to recover to handle but can be output as the basis with the reference value of not carrying out this optical correction.
Then, after the reference value computing, the shake detection signal that will deduct reference value from the shake detection signal from angular-rate sensor 10 sends to integration part 32.
In integration part 32, the shake detection signal with the angular velocity unit representation is carried out time integral, and be converted to the shake angle of camera.For example, carry out computing according to following formula (7).
θ(t)＝θ(t-1)+C·(ω(t)-ω
0(t)) (7)
In each mark of formula (7), θ (t) is the target drives position, and ω (t) is shake detection signal, ω
0(t) be reference value, t is time (round values), and C is the constant by the conditional decisions such as focal length of camera lens.
Target drives positional information by integration part 32 computings is sent to target drives position operational part 33.
In target drives position operational part 33, the shake angle information that comes transmitting from integration part 32, adding is from the lens focus f of focus detection portion 170, from the information such as the body distance D that is taken of focus lens position detection part 160, and computing is used to drive the target drives positional information of jitter correction camera lens 70.
In jitter correction control part 30, utilize known PID control etc., in order to move jitter correction camera lens 70 according to this target drives positional information, obtain target drives positional information and poor from the positional information of the position detection part 60 of jitter correction camera lens 70, send the drive signal that is used to drive optical system drive division 50.Via D/A converter 430 drive signal is sent to optical system drive division 50.Can be according to the coil midstream excess current of the drive signal of sending at optical system drive division 50, thus on perpendicular to the direction of optical axis, drive jitter correction camera lens 70.
In position detection part 60, monitor the position of jitter correction camera lens 70, and utilize detected lens location information, by jitter correction control part 30 FEEDBACK CONTROL jitter correction camera lenses 70.
Next, an operation of transform operational part 100 is described.
In the explanation of prior art, following problem is told about: also do not have complete correction of jitter even carry out jitter correction, and residual on image some shakes (generations of jitter correction remnants) (with reference to Fig. 8 (a) (b)) are arranged by optical profile type corrective system 500.The place that the remaining reason that produces of this jitter correction mainly is based on reference value is very big.Therefore, in the some transform operational part 100 of present embodiment, be the some transform of basic calculation jitter correction remnants with the reference value.
At this, the operational method of a transform is carried out simple declaration.
The point transform utilizes following formula to calculate.That is reference value ω, from obtaining
0In deduct reference value arithmetic average value ω
0Ave tries to achieve error angle θ (t) with its integration.And then try to achieve point in image planes as distribution function X (t) from focus information f.
ω
0ave＝∑ω
0(t)/N (8)
θ′(t)＝θ′(t-1)+C·(ω
0(t)-ω
0ave) (9)
X(t)＝f·θ(t) (10)
In addition, when teleconverter is installed, need change focal length according to the multiplying power of teleconverter.In addition, utilizing the body range information that is taken to proofread and correct time point increases as the precision of distribution function.At this moment, utilize following formula (11) to get final product.
X(t)＝β·Rf·θ(t) (11)
β: horizontal magnification
R: the body distance is taken
Respectively directions X, Y direction are carried out these computings, obtain a little as distribution function when it is launched on X-Y plane.
In addition, above-mentioned example for the computing of a transform, also can be utilized other method for an example of transform computing.
In this some transform of calculating, be sent to image and recover operational part 210.Image recovers operational part 210 and carries out image recovery computing according to the some transform of this transmission.By the picture shake of not proofreading and correct is fully proofreaied and correct, can obtain the effective images with high image quality of jitter correction in the jitter correction operation of jitter correction camera lens 70.
Being used for the data that existing image recovers processing, nearly all is directly to try to achieve the example that a transform is carried out the image recovery from detecting data by detected shakes such as angular-rate sensors.But, as described above, in this method, under the very big situation of the shake of image, carry out the problem that image recovers also not improve image quality even exist.But, according to present embodiment,, utilize the wobble information of this moment to carry out image recovery processing by optical profile type shake correction mechanism correction shake to a certain degree, can improve image quality significantly thus.
Fig. 4 (a)～(c) and Fig. 5 (a)～(d) are the figure that the image in the explanation present embodiment recovers.
In the present embodiment, carry out view data and wobble information behind the jitter correction, therefore the excessive problem of amount of jitter does not take place owing to utilize by the optical profile type shake correction mechanism.Can understand the effect of this point by comparison diagram 7 (a)～(d).Shaking the big more frequency content that does not have to transmit increases, and the recovery of image is just difficult more.Spatial frequency transport function shown in Fig. 5 (b) becomes 0 point will lack than Fig. 7 (b) as can be known.This expression:, therefore can carry out image effectively and recover owing to reduce the frequency content of not transmitting.
As above-mentioned detailed description, can play following effect according to this first embodiment.
Owing to having the jitter correction optical system of proofreading and correct the picture shake and the image of being taken by image pickup part being carried out the image recovery by Flame Image Process recover operational part with the image of proofreading and correct the picture shake, therefore can replenish the problem points of the problem points of jitter correction of the optics that has utilized the optical correction optical system and the image jitter correction in recovering, improve the jitter correction effect.
Have the computing point as the point of distribution function as the distribution function operational part, image recovers operational part, carry out image and recover by handling image as distribution function, so, just can carry out the image recovery any time after photography if computing and savepoint are as distribution function when photography according to point.
Point is as the distribution function operational part, according to the operation result computing point of reference value operational part as distribution function, so can be with the shake of in the jitter correction that is undertaken by the jitter correction optical system, not proofreading and correct fully as point as distribution function, can recover proofread and correct by image to the shake of in the jitter correction that is undertaken by the jitter correction optical system, not proofreading and correct fully.
＜the second embodiment 〉
Present embodiment is the structure that jitter correction operating selection switch 194 and signal circulation control part 452 are set in the system architecture of first embodiment.
Fig. 9 is the system architecture diagram of present embodiment, and Figure 10 is the frame arrangement plan of these structures.To playing the part with the first embodiment identical functions, be marked with identical label, suitably the repetitive description thereof will be omitted.
The block diagram that Figure 11 describes for the operation to jitter correction portion.As shown in figure 11, in the time of will passing out to a some transform operational part 100 from the output of reference value operational part 31, the signal circulation control part 452 whether switching carries out the jitter correction operation is set.
Jitter correction operating selection switch (VRSW) the 194th, the switch of the ON/OFF of the jitter correction operation of switchable optics.In addition, signal circulation control part 452 is that state according to VRSW 194 switches and sends to a section data of transform operational part 100.In addition, as shown in figure 10, this correct operation selector switch 194 is set at the peripheral part of the lens barrel 102 of lens changeable in lens changeable lens barrel camera.The following operation of carrying out based on the selector switch in the present embodiment 194.
When VRSW 194 is ON, drive jitter correction camera lens 70, carry out operations necessary for optical profile type correct operation and image recover.To recover to handle the data that needed image recovers usefulness in order to carry out image, send to a transform operational part 100 from reference value operational part 31.On the other hand, be under the state of OFF at VRSW 194, stop the driving of jitter correction camera lens 70, carry out the jitter correction operation of optics.Be used as the data that image recovers usefulness from the target drives position signalling of target drives position operational part 33 output and send to a transform operational part 100.In addition, no matter which kind of state the set condition of VRSW 194 is, all sends it to a transform operational part 100.
Next, the basic operation to the blur correction camera 1 of present embodiment describes.
Figure 12 is the process flow diagram that the basic operation to camera of the present invention describes.
Below, according to process flow diagram shown in Figure 12, the flow process of the camera operation of present embodiment is described.
In addition and since after the content of explanation be in the shared content of directions X Y direction, therefore do not indicate direction especially and describe.
In step S1010, judge whether be ON partly by switch SW 1.Half enters S1020 during for ON by switch SW 1, partly enter S1140 during for OFF by switch SW 1.
In S1020, counter reset T
SW1, making count value is 0.Counter T
SW1Be to be used to measure partly become the OFF counter in elapsed time afterwards by switch SW 1, count value is an integer.This counter half by switch SW 1 for ON during in be 0, only half by switch SW 1 by timer be for OFF and half ON during operate.
In S1030, judge whether be OFF partly by timer 195.Half enters S1040 during for OFF by timer 195, partly enter S1170 during for ON by timer 195.
In S1040, counter reset t, making count value is 0.Counter t is used to measure half by the counter of timer 195 for the time of ON.This counter is the round values counter, begins counting operation when half becomes ON by timer 195, half press timer 195 for ON during lasting counting operation.
In S1050, make partly to be ON by timer 195.In S1060, make angular-rate sensor 10 be ON, the detection that begins to vibrate.In addition, the conversion operations that is undertaken by A/D converter 20 also begins at this.In S1070, begin the computing of reference value according to output from angular-rate sensor 10.In S1080, begin to be used to drive the computing of the drive signal of jitter correction camera lens 70.In S1090, judge whether VRSW 194 is set to ON.When VRSW 194 is set to ON, enter S1100 in order to drive jitter correction camera lens 70.On the other hand, when VRSW 194 is set to OFF, enter S1130.
In S1100, the driving of beginning jitter correction camera lens 70.In S1100, carry out exposing operation, image recovery operation.Utilize Figure 13 that this operation is elaborated afterwards.In S1120, the half counter t that presses timer 195 is increased by 1.In S1130, stop the driving of jitter correction camera lens 70.In addition, when the driving at the moment jitter correction camera lens 70 that enters this step has stopped, directly continuing halted state.
In S1140, judge whether be ON partly by timer 195.Half enters S1150 during for ON by timer 195, half returns S1010 by timer 195 during for OFF, proceeds partly the detection by switch SW 1.In S1150, in the moment that enters this step, camera is in partly and is the state of ON for OFF, half by timer 195 by switch SW 1.In order to measure the time of this state continuance, with counter T
SW1Increase by 1.
In S1160, judge counter T
SW1Value whether also little than threshold value T_SW1.At this, threshold value T_SW1 is for being used to determine counter T
SW1The constant of the upper limit, decision becomes OFF from half by switch SW 1 and becomes time of OFF to half by timer 195.
Counter T
SW1During discontented threshold value T_SW1, promptly during affirmative determination, will half be made as OFF and just enter S1170 by timer 195.On the other hand, counter T
SW1When equating, promptly when this step negative evaluation, enter S1220, make partly to become the processing that OFF follows for the processing of OFF and half by timer 195 by timer 195 with this threshold value T_SW1.
In S1170, continuing angular-rate sensor 10 is the state of ON, the detection of vibrating.In addition, the also lasting conversion operations that is undertaken by A/D converter 20.In S1180, continue the computing of reference value.In S1190, from by the output of angular-rate sensor 10 with continue to be used to drive the computing of the drive signal of jitter correction camera lens 70 in the reference value of S1180 computing.
In S1200, judge whether VRSW 194 is set to ON.When VRSW 194 is set to ON, enter S1210 for the driving that continues jitter correction camera lens 70.When being set to OFF, VRSW194 enters S1130.
In S1210, continue the driving of jitter correction camera lens 70.In S1220, stop the driving of jitter correction camera lens 70.In S1230, stop the computing of reference value.In S1240, stop the power supply of angular-rate sensor 10 is supplied with, and make angular-rate sensor 10 be OFF.In S1250, make half by counter 195 for OFF and return S1010, carry out half state-detection by switch (SW1) 191.
Next, exposing operation and the image recovery operation to the camera of present embodiment describes.
Figure 13 is the exposing operation of the S1110 among expression Figure 12, the detailed process flow diagram of image recovery operation.
In S1500, judge whether complete be ON by switch (SW2) 192.Enter S1510 entirely by switch SW 2 during for ON, enter S1520 entirely by switch SW 2 during for OFF.
In S1510, judge whether the processing of exposure beginning is finished.Exposure begins processing and enters S1520 when having finished, and exposure begins processing and imperfect tense enters S1530.Complete is the switches that become the opportunity of exposing operation by switch SW 2.Just do not begin to expose if begin exposure when this switch is ON, if begun the control that exposes and just expose at this.
In S1520, judge whether to be in the exposure.Enter S1540 when being in the exposure, in exposure, just do not enter S1570.In S1530, carry out not shown catoptron rising, open be used to the to expose processing of beginning such as shutter.In S1540, judge whether VRSW 194 is ON.VRSW 194 enters S1550 during for ON, and VRSW 194 enters S1560 during for OFF.
In S1550 with the reference value integration.This carries out the computing equivalence with the shake to the picture do not proofreaied and correct fully by optics jitter correction operation.Value behind the integration is stored in storer etc., the computing of the some transform after being used to expose.
In S1560, read in the target drives position signalling, and be stored in storer etc.Utilize this behind end exposure, to carry out the computing of a transform.In S1570, judge whether the processing that is used to finish to expose is finished.Enter S1590 when finishing dealing with, handle imperfect tense entering S1580.In S1580, carry out catoptron decline, close the processing that shutter etc. is used for end exposure.
In S1590, whether the computing of judging point transform finishes.The computing of some transform enters S1610 when finishing, the computing of some transform enters S1600 when not finishing.
In S1600, the computing of beginning or lasting some transform.If do not have the computing of starting point transform just to begin computing, just continue this computing if begun computing in the moment that enters this step.
In S1610, judge whether the computing that image recovers finishes.The computing that image recovers enters S1120 when finishing, the computing that image recovers enters S1620 when not finishing.In S1620, the computing that beginning or lasting image recover.Just do not begin computing if begin the computing of image recovery in the moment that enters this step, if begun just lasting this computing of computing that image recovers.
In addition, when not carrying out the jitter correction operation of optics, can recover processing by the image after the photography and alleviate shake from the output computing point transform of angular-rate sensor 10.Therefore, even when any faults such as forgetting connection owing to battery deficiency, switch is not operated jitter correction camera lens 70, also can recover processing and alleviate shake by image.
As above-mentioned detailed explanation,, can play following effect according to the present invention.
Thereby because have the correcting optical system of proofreading and correct the picture shake, utilize reference value or vibration detection signal computing point as the point of distribution function as the distribution function operational part with the image taken by image pickup part is carried out Flame Image Process according to point as distribution function carry out image and recover to recover operational part with the image of proofreading and correct the picture shake, therefore no matter whether utilized the jitter correction of the optics of jitter correction optical system, can carry out image and recover.
Owing to have to utilizing reference value or utilize vibration detection signal cause point to put the point that switches as the computing of distribution function as distribution function computing switching part as the distribution function operational part, so selected element can carry out image effectively and recover as the operational method of distribution function in needs as required.
Point is as distribution function computing switching part, whether be also used as by the jitter correction optical system and carry out the jitter correction operating and setting portion of switching between the jitter correction operation, so can make the jitter correction operation interlock that is undertaken by the jitter correction optical system, change the operational method of point, can carry out having or not of the computing of corresponding optimum as distribution function with the jitter correction that is undertaken by the jitter correction optical system is operated as distribution function.
When the jitter correction operation of not carrying out being undertaken by the jitter correction optical system, point utilizes vibration detection signal computing point as distribution function as the distribution function operational part, therefore the point of computing is relevant with the shake of camera itself as distribution function, can by image recover to make result from this camera shake as shaking recovery.
Because have the jitter correction optical system of proofreading and correct the picture shake and utilize reference value or vibration detection signal computing point as the point of distribution function as the distribution function operational part, so no matter whether utilized the jitter correction of the optics of jitter correction optical system, can recover needed with the operational method arithmograph picture of the best, can carry out the image recovery to the image of taking effectively by external device (ED) etc. thereafter as distribution function.
＜the three embodiment 〉
The 3rd embodiment is the mode that image recovery device and camera main-body are separated.For the part that plays with the first embodiment identical functions, attached with identical label, suitably the repetitive description thereof will be omitted.
Below, with reference to accompanying drawing embodiments of the present invention further are elaborated.Figure 14 is the block diagram of system architecture of the 3rd embodiment of expression blur correction camera of the present invention.
The blur correction camera main body 1 of present embodiment, function correction portion 105, interface portion 130, image are set on the structure of first embodiment recover judging part 140, image recover that operational part 210 becomes as the part of image playback apparatus 2 and with camera main-body 1 separated structures.
Image playback apparatus 2 is an image recovery device as described below: utilize connection layout such as transmitting cable as recording portion 120 or blur correction camera 1 and replay device, and the image of resetting and taking by blur correction camera 1, and can carry out image and recover.
Function correction portion 105 utilizes the position signalling of the jitter correction camera lens 70 that obtains from position detection part 60 to come the part of check point transform.More specifically, utilize position signalling according to carrying out the correction of a transform as the control position error of the difference that drives target location and position signalling (actual activation point).
Interface portion 130 is to have had the communication facilities that is connected the terminal that transmits cable 300 when connecting blur correction camera 1 with image playback apparatus 2 grades.
Stube cable 300 is cables of the communication port (for example RS-232C, USB, parallel port, IEEE1394 etc.) of the connector and the image playback apparatus 2 of connecting interface portion 130.Between blur correction camera 1 and image playback apparatus 2, carry out the transmitting-receiving of data via this stube cable 300.
It is to whether carrying out the part that judgment processing is carried out in a transform computing that image recovers judging part 140.That is, judge whether the output data from the reference value operational part of jitter correction control part 30 is carried out a part of transform computing according to information such as shutter speed or amount of jitter.
Owing to recover the necessity of judging part 140 judging point transform computings by image, therefore can make the information that is kept at image recording portion 120 is the data that need as far as possible, can reduce meaningless arithmetic operation and memory span.
Operating portion 190 has half by switch (SW) 191, press switch (SW) 192, tremble correction mode selector switch (SW) 194 etc. entirely.
Tremble correction mode selector switch 194 is the functional units that carry out the combination selection of optical profile type correct operation pattern and image recovery mode.In the present embodiment, as the switch of the jitter correction operator scheme that can select 3 patterns, its operation is as follows.
When having selected " jitter correction OFF pattern ", do not carry out optical profile type correction and image and recover.That is, stop the driving of jitter correction camera lens 70, the jitter correction operation is not all carried out, and image recovers the recorded and stored of the data of usefulness not to carry out yet.
When having selected " optical profile type correct operation pattern ", only carry out the optical profile type correct operation, drive jitter correction camera lens 70 and look like the jitter correction operation, but be not used for the recorded and stored etc. of the data of computing that image recovers the some transform handled, image recovery usefulness.
When having selected " image recovery operation pattern ", carry out optical profile type correct operation and image and recover necessary operations.Image is recovered to handle the data that needed image recovers usefulness, recover judging part 140 from optical profile type corrective system 500 via image and send to a transform operational part 100.
Next, image playback apparatus 2 is described.
Image playback apparatus 2 comprises that carrying out image recovers the image recovery operational part of handling 210, the image displaying part 220 and the restoration result preservation portion 230 of display image.
Image playback apparatus 2 in the present embodiment utilizes PC, will comprise the application software that image recovers the jitter correction program of needed special use and be installed on this PC, and it is worked as image playback apparatus 2.
In this jitter correction program, recover the image recovery operational part of processing except carrying out image
Outside (image recovery operation program), comprise that also view data that reception transmits from the phase pusher side, point are as the data input part (data entry program) of distribution function and various parameters and the configuration part of carrying out the parameter setting of pusher side mutually from the image playback apparatus side etc.
In addition, image playback apparatus 2 is not limited to utilize the situation of PC, for example both can be used as special-purpose replay device, also it can be assembled in the camera.
It is parts as described below that image recovers operational part 210: transmit the view data of coming, the some transform information corresponding with view data and be used for image according to the image recording portion 120 from blur correction camera 1 and recover the various parameters handled, carry out the image recovery processing of the shake that comprised in the correcting image.
The image that recovers in the operational part 210 for image recovers to handle, and has used the described S filter of formula (6), but has been not limited thereto, and also can use additive method.
Restoration result preservation portion 230 be with recover by image operational part 210 carry out the recovery image after image recover to be handled and carry out image when recovering to handle used parameter set up the related also part of preservation with original image.
Next, the basic operation to the blur correction camera 1 of present embodiment describes.
Figure 15 is the process flow diagram that the basic operation of jitter correction when operation camera is carried out in expression.
In step S210, half enters S220 during for ON by switch 191.In S220, differentiate the state of tremble correction mode selector switch 194.Enter the optical profile type correct operation flow process of S230 when " optical profile type correct operation pattern ", the image that carries out operation of optical profile type jitter correction and image recovery processing operation that enters S240 when " image recovery operation pattern " recovers treatment scheme.Enter S250 when having selected " jitter correction OFF pattern ".
In S250, owing to selected " jitter correction OFF pattern ", therefore as mentioned above, not carrying out optical profile type correction and image recovers, stop the driving of jitter correction camera lens 70, the jitter correction operation is not all carried out, and does not carry out the recorded and stored that image recovers the data of usefulness yet.
Below, the operation to the blur correction camera 1 under the situation of " optical profile type correct operation pattern " and " image recovery operation pattern " describes respectively.
The operation of the blur correction camera during at first, to " optical profile type correct operation pattern " describes.
The process flow diagram of the basic operation of the camera when Figure 16 is expression optical profile type jitter correction operator scheme.
In S400, the cutoff frequency fc that will be used for the LPF portion of reference value operational part 31 is made as fc=0.1Hz.In S410, make angular-rate sensor 10 be ON as vibration detecting part.In S420, remove the locking of blocked jitter correction camera lens 70.In S430, the operation of beginning jitter correction.Be meant optical profile type jitter correction as described below operation at this jitter correction that begins: according to the output of angular-rate sensor 10,, jitter correction camera lens 70 is moved being approximately perpendicular on the direction of optical axis direction, come correction of jitter in order to eliminate its picture shake.
In S440, detect half and press the state of timer, if be that OFF just enters S450 partly, if be that ON just enters S470 partly by timer by timer.In S450, stop the jitter correction operation, locking corrective lens 70 finishes the optical correction pattern in S460.In S470, detect the state of pressing switch 192 entirely, if just enter S480 by switch 192 for ON entirely, if just return S440 by switch 192 for OFF entirely.
In S480, carry out the operation placed in the middle of jitter correction camera lens 70 after, begin jitter correction once again.Under the state that does not drive by optical system drive division 50, the optical axis I of photographic optical system may not be consistent with the optical axis of jitter correction camera lens 70.Usually, jitter correction camera lens 70 is in the state of the end that has moved to its movable range mostly, when directly carrying out the jitter correction operation, the direction that generation can't drive, so drive jitter correction camera lens 70, with roughly consistent according to the optical axis I of optical axis that should operation placed in the middle makes jitter correction camera lens 70 and photographic optical system.
In S490, carry out the shutter opening operation, begin exposure to image pickup part 110.In S500, (SB) the whether luminous judgement of glistening, glisten luminous the time enter S510, do not glisten luminous the time enter S520.What glisten in S510 is luminous.In S520, close shutter, finish exposure.Thereafter, turn back to S440 half by the timer determining program.
The operation of the blur correction camera during next, to " image recovery operation pattern " describes.
The process flow diagram of the basic operation of the camera when Figure 17 is presentation video recovery operation pattern.
In S600, the cutoff frequency fc that will be used for the LPF portion of reference value operational part 31 is set at fc=1Hz.With respect to fc=0.1Hz when above-mentioned " optical profile type correct operation pattern ", when this " image recovery operation pattern ", improve cutoff frequency fc.
By setting like this, when " image recovery operation pattern ", compare with " optical profile type correct operation pattern ", can make in the vibration of blur correction camera 1, the composition that is occurred by the some transform of transform operational part 100 computing increases, and makes to drive the composition that jitter correction camera lens 70 carries out jitter correction and reduce.Thus, can reduce the drive amount that drives jitter correction camera lens 70, can make jitter correction camera lens 70 in the scope that can drive, hold driving of surplus.At this moment, the amount of jitter of being proofreaied and correct by optical profile type jitter correction operation reduces, the amount of jitter of the image of shooting increases, but for this shake that has increased, recover to proofread and correct by image later on, so finally can obtain jitter correction effect height, as shake or the considerably less image of picture shake.
So, when " image recovery operation pattern ", compare during with " optical profile type correct operation pattern " and increase the cutoff frequency that is used for the reference value computing, the composition of jitter correction be will carry out and optical profile type jitter correction and image recovery distributed to, thereby compare with " optical profile type correct operation pattern " time, even the shake of bigger hand also can be carried out suitable jitter correction.
Flow process among Figure 17 from S610 to S670, identical with the operation in the flow process from S410 to S470 among Figure 16, so omit detailed explanation at this.
In S680, recover to handle and judge.The detailed description of judging is handled in the recovery that utilizes Figure 18 to carry out this S680 later on.Handle judgement by the recovery in this step, be not judged as when needing image to recover to handle and enter S690, be judged as and enter S720 when needing image to recover to handle.
In S690, the same with S480 among Figure 16, after the operation placed in the middle of carrying out jitter correction camera lens 70, begin jitter correction once again.In S700, carry out the shutter opening operation, begin exposure to image pickup part 110.In S710, close shutter, finish exposure.Thereafter, turn back to S640 half by the timer determining program.In S720, the same with S480 among Figure 16, after the operation placed in the middle of carrying out jitter correction camera lens 70, begin jitter correction once again.
In S730, carry out the shutter opening operation, begin exposure to image pickup part 110.In S740, between exposure period, carry out a data that the transform computing is used and obtain.As a data that the transform computing is used, comprise according to from the reference value of the output computing of angular-rate sensor 10 with according to the control information of the positional information computing of the jitter correction camera lens 70 that obtains by position detection part 60.The data of utilizing Figure 19 that the some transform computing among this S740 is used later on obtain and are elaborated.
In S745, close shutter, finish exposure.In S750, obtain a transform computing with data after, the data that utilization obtains are carried out the computing of a transform.For the computing example of a transform, owing to be illustrated in the first embodiment thereby omit.In S755, utilize error information to proofread and correct the some transform of computing in S740 (operation of being undertaken by function correction portion 105).
At this, the bearing calibration of the some transform of having utilized error information is described.
As the function of time t the driving target location of jitter correction camera lens 70 is made as lc (t), actual activation point is made as lr (t), then the control position error e (t) on X-direction and Y direction respectively obtains (as the operation of control position error efferent) by following formula.
ex(t)＝lcx(t)-lrx(t) (12)
ey(t)＝lcy(t)-lry(t) (13)
To launch function behind these formula (12), (13) two-dimensionally is made as e (x, y), (x, (x y), obtains according to following formula the point transform p ' after then proofreading and correct y) can to utilize the some transform p shown in the mathematical expression 1.
p’(x，y)＝p(x，y)+e(x，y) (14)
After having proofreaied and correct the some transform, in S760, image is recovered process object image additional dither mark.
In S770, the some transform of having proofreaied and correct as the wobble information record, is turned back to S640.
Next, processing and the computing of some transform from the wobble information of optical profile type corrective system 500 output are described with obtaining of data.
Figure 18 is that expression judges whether that according to shake detection data the image that carries out a transform computing recovers the process flow diagram of the detailed operation of judging part 140 (S680 among Figure 17).
According to the judgement that this image recovers judging part 140, judge whether that document image recovers needed shake and detects data.
In S310,, judge that image recovers the validity of handling according to the size of shake detection limit.In this step, preestablish the condition and range that can image recovers according to wobble information and camera shooting information, and whether can recover to handle correction of jitter effectively by carry out image from target drives position operation result according to this condition judgment.
For example, during amount of jitter excessive (maximum figure amount of jitter), recover to handle even carry out image, striped is also apparent in view in image, can't avoid the image quality deterioration that is caused by this striped.In addition, during amount of jitter too small (minimum limit amount of jitter), recover it also not to occur and improve effect even carry out image.
Therefore, in advance by getting these boundary amount of jitter of setting according to experiment or experience.
In S320, judge that according to shutter speed (time shutter) image recovers the necessity of handling.In this step, predict the size of amount of jitter to a certain degree according to shutter speed, judge whether that according to the amount of jitter of this prediction the needs image recovers to handle.When shutter speed is very fast, also be very little amount of jitter even for example produce shake, judgement is can be for the image of appreciating.The amount of jitter of this moment, these two is tried to achieve from focal length and shutter speed.When not carrying out the optical profile type jitter correction, generally be meant the shutter speed slow situation of the generation of hand shake than (1/ focal length).But, in the present embodiment, owing to also carry out the optical profile type jitter correction, therefore for example only under the situation that satisfies following formula (15), carry out image and recover to handle.
(A/ focal length)＜shutter is (time shutter) (15) during second
At this, " A " in (formula 15) both can be predetermined value, also can be the variable that changes according to other conditions.
Shutter speed in S310, S320 is judged and the judgement of shake detection limit is judged as in the time of need recovering to handle jointly, becomes the step of exposure with the S330 that recovers processing, enters the S720 among Figure 17.
On the other hand, any one that the shutter speed among S310, the S320 is judged or the shake detection limit is judged all is judged as when need not to recover to handle, and enters S340, the information that the image recovery operation is not carried out in warning, demonstration (notice).Notice for example can be warning tones, the also demonstration that can be scheduled to.
Carried out after the S340, the nothing that becomes S350 is recovered the step of exposure of processing, enters the S690 among Figure 17.
As shown in figure 18, be used for the wobble information amount that image recovers processing, can carry out the reduction of memory span by judging whether to need image to recover, can alleviating.
Figure 19 is the process flow diagram of the operation (S740 among Figure 17) of having represented that at length the computing of some transform obtains with data.
In the present embodiment, the saving of memory span etc. as fundamental purpose, is carried out extraction shown in Figure 19 and handled (as the processing of quantity of information minimizing portion).
After the exposure beginning, counter reset in S910.Specifically, establish N=1, K=0.Wherein, N is that K is the counter as the timer of computing time as the counter of the additional numbering in order to distinguish a plurality of reference values.
In S920, preserve ω as the output of initial baseline value
0(1).
In S925, calculate error e (1) and the preservation of this moment.Wherein, so-called error, be meant by the driving target location of the jitter correction camera lens 70 of target drives position operational part 33 computings with from poor (the control position error) of the actual activation point of the jitter correction camera lens 70 of position detection part 60 outputs, carry out computing by jitter correction control part 30.In jitter correction control part 30, output drive signal drives the poor of target location and actual activation point to supply, but jitter correction camera lens 70 is not followed the driving target fully sometimes, produces error this moment.
In S930, calculate the mean value ω of reference value output according to following formula
0Ave.
ω
0ave＝{ω
0(N)+ω
0ave×(N-1)}/N (16)
In S940, carry out the affirmation of counter.Enter S950 during K=100, under the situation in addition, enter S970.In S950, preserve reference value output ω
0(N).
In S955, calculate error e (N) and the preservation of this moment.In S960, establish K=0 replacement timer counter.In the present embodiment,, therefore preserve reference value output, extract reference value output so become every 0.1sec because the sample frequency of angular-rate sensor 10 is 1KHz.In S970, confirm that whether shutter closes, and just enters S990 if shutter is opened, if shutter close just enters S980.
In S980, preserve last reference value output ω
0(N).This is because making shutter during second when very fast because the extraction of reference value output is preserved, avoided only preserving the initial point that reference value is exported.For example, be in the present embodiment because, owing to when sample frequency is 1KHz, preserve reference value output, so, can't constitute a transform faster under the shutter speed, only having preserved initial reference value output than 1/10sec every 0.1sec.In addition, in this S980, also be kept at the mean value ω of the reference value output of computing among the S930 simultaneously
0Ave.
In S985, calculate error e (N) and the preservation of this moment.In S990 and S1000, increase counting, return S930, carry out the mean value computing of reference value output.
At this, above-mentioned extraction processing is described.
In the present embodiment, be used for the some transform that image recovers processing, export according to reference value and calculate.Reference value output is the LPF output with cutoff frequency of 1Hz (when carrying out the flow process of Figure 17 that image recovers) as mentioned above, and therefore the frequency content than the hand shake is low.Therefore, also can reduce the data number that is used for a transform computing.
When carrying out a some transform computing, when the shake of sending from optical profile type corrective system 500 is detected the total data computing point transform of data, operand and memory span that needs are very big.
The shake that obtains from the target location operation result detects the number of data, and for example when the sample frequency of reference value computing was 1KHz, 1 second reference value data number was N=1000, is very many data volumes.The frequency of hand shake is about 0.1～10Hz, and the cutoff frequency of the low-pass filter that is provided with on the reference value operational part 31 of the reference value of calculating the hand shake is about 1Hz.That is, in a transform operational part 100,1Hz or its following frequency are principal ingredients.For the frequency of expression 1Hz, with about its 10 times, be that the data in 0.1sec cycle are just enough.Therefore, can proceed to the extraction of 1/100 data to the data of 1KHz sampling.
In addition, when changing the cutoff frequency of the LPF that is used for reference value output computing, need to change extraction amount from this cutoff frequency.
By this processing, can shorten the time of calculation process, the capacity of conserve memory etc.
After extract handling, in order to be undertaken image to recover to handle by image playback apparatus in recording medium record dither information, and data are sent to image playback apparatus 2.In the present embodiment, recovering to handle needed minimum data number, can play very big effect to the saving of shortening, the particularly memory span of delivery time, calculation process time thus by extract handling record and transmitted image.
At this, the operation of the some transform operational part 100 that carries out among the S750 of Figure 17 is described.
In the explanation of prior art, put down in writing following problem: even undertaken by optical profile type corrective system 500 that jitter correction does not have complete correction of jitter yet and residual on image some shakes (generations of jitter correction remnants) are arranged.The position that the remaining reason that produces of this jitter correction mainly is a reference value and at the activation point of the reality of jitter correction camera lens with to drive the position of the error that produces between the target bigger.Therefore, in the some transform operational part 100 of present embodiment, according to reference value calculation level transform, in function correction portion 105, by this transform of error correction.Be sent to image in this some transform of having proofreaied and correct and recover operational part 210.Image recovers operational part 210, carry out image according to the some transform after the correction of this transmission and recover computing, can obtain the effective images with high image quality of jitter correction by proofreading and correct the picture shake of in the jitter correction operation of jitter correction camera lens 70, not proofreading and correct fully.
Next, the operation to image playback apparatus 2 describes.
Figure 20 is the process flow diagram of the basic operation of presentation video replay device 2.
In image playback apparatus 2, the jitter correction program that is used to carry out the image recovery has been installed.
Shown in before, in the present embodiment, the view data of phase pusher side is sent in the image playback apparatus 2 via transmitting cable 300.
In Figure 20, carried out the transmission of image, beginning jitter correction (image recovers to handle) program is carried out menu screen and is shown.
In S2010, recover treatment button etc. by clicking by input medias such as mouses, enter and carry out the flow process that image recovers.In S2020, for being judged as being the image that recovers the process object image in advance at the phase pusher side, therefore the additional dither mark line item of going forward side by side is only read at playback time, display image reads in the operation beginning and by the image of additional this shake mark.In S2030, seeing that shaking relevant various parameters with image or picture selects simultaneously, shows that the user carries out the image that image recovers processing.
In S2040, more detailed demonstration and the shake track data and the some picture shake that as image recover parameters needed relevant with the image of selection.More specifically, on image displaying part (display) 220, show shake track data, the shake of some picture etc. by the control information of blur correction camera 1 record and photographic information etc., the operator can be on image displaying part 220 the suitable shake track data of direct control.
Figure 21 and Figure 22 (a)～(c) are the figure of the operational example of concrete image demonstration of expression and various parameters.Figure 22 (a) expression shake track data, the shake track data in Figure 22 (b) expression coarse regulation operator scheme, the shake track data in Figure 22 (c) expression inching operator scheme.
In S2050, at random change, set the above-mentioned parameter when carrying out the image recovery.In S2060, recover to handle according to the parameter of in S2050, setting.In S2070, dither image before relatively demonstration recovers to handle on the image displaying part 220 of image playback apparatus 2 and the recovery image after the recovery processing.In S2080,, judge whether whether recover image can (carry out image recovery once again) by the recovery image after dither image before the recovery of eyes movement images and the image recovery.Recover image can the time, enter S2085, when carrying out that image recovers once again, return S2040.
In S2085, the user judges and determines the whether judgement of saving/restoring image and parameter.When saving/restoring image and parameter, enter S2090, finish when not preserving.In S2090, the user judges and selection indicates whether to cover saving/restoring image and parameter.Do not cover and enter S2110 when preserving, cover and enter S2100 when preserving.In addition, cover the selection that also is capped the data (data of having preserved) of cancellation when preserving simultaneously.
In S2100, the recovery image in the past of the corresponding preservation of deletion and parameter (having carried out covering the data of selecting among the S2090) with original image.In S2110, set up related and preservation with new argument that is used for this image recovery processing and original image the recovery image.
In this step, to preserve the file of the original image (dither image) before recovering and preserve the file of parameter and 3 kinds of files that recover image, as different separately files, in the file of having preserved parameter, write with the file of having preserved original image and preserved the file relevant information of recovering image.When in image playback apparatus 2, opening the file of having preserved parameter thereafter, also open and show be associated, preserved the file of original image and preserved the file that recovers image.
Figure 23 is a synoptic diagram of having represented the relation of recovery image, parameter and the original image preserved in S2110.
As shown in figure 23, in the present embodiment, can there be a plurality of recovery images that are associated with 1 original image and the combination of parameter.
Thus, though carry out the several image recover to handle also parameter is related with image foundation and preserve, so can be not chaotic and successfully advance operation.
In addition, recovering the preservation of image or parameter and original image, be not limited to the mode shown in the present embodiment, can be various embodiments.These combinations of expression in the following table 1.
Table 1
No.1 in the table 1～6th, the mode of not preserving original image.
For example, satisfied and when not carrying out that image recovers once again, have the situation that does not need original image fully to restoration result, at this moment, No.1,2,5, modes such as 6 are effective.
On the other hand, original image is recovered to handle, can not be satisfied with, and do not need under the situation of original image and recovery image resulting recovery image, reference when thereafter other original image being recovered to handle and when wanting to preserve parameter, No.3,4 mode are effective.
No.7 in the table 1～12 are for preserving the mode of original image.No.7 wherein, 8 mode are above-mentioned embodiments.
For example, recover under the very high situation of the processing speed of operational part 210 at the image of image playback apparatus 2, even the saving/restoring image by setting up the related parameter of only preserving with original image, can not utilize the parameter of preservation and original image to carry out the image recovery and show recovering image when needed immediately.Therefore, keep the operating position identical, can save the capacity (No.9,10) of recording medium etc. with above-mentioned embodiment.
In addition, image satisfied to restoration result and that do not need to carry out once again with condition recovers, but preserves original image for affirmation, carries out under the situation that image recovers No.11,12 effective allowing to again with other parameter.
In addition, to above-mentioned all modes, can select to preserve again and cover preservation as store method.
In example shown in Figure 21, on image displaying part 220, make the dither image before recover handling and recover to handle after recovery image, the information relevant with the some transform and to shake the track data difference corresponding, and carry out the form demonstration.By so on same picture, relatively showing, can make operator's a glance intuitively judge correction and where get final product.
In addition, the part that shows in the lower right of Figure 21 carries out shaking the demonstration of the operation of track data.In the present embodiment, so, can utilize mouse etc. to operate in the shake track data that shows on the image displaying part 220 partly.Shake track data according to operation like this recovers to handle once again, can carry out more detailed relatively judgement.
In addition, in the present embodiment, can carry out the coarse regulation of the manipulation of image data shown in Figure 22 (b), the inching shown in Figure 22 (c) by being the shake track data that benchmark dwindles/amplifies shown in Figure 22 (a), obtains with mouse indication point P0.Figure 22 (c) is the example that is the inching pattern, and therefore service data number meticulously carries out the evaluation to the parameter of the recovery image that obtains easily, can improve the image manipulation degree of freedom and effectively handles.
In the past, in a transform computing, will be directly used in computing, therefore in a transform, contain very many error components, also be difficult to obtain images with high image quality even carry out image display operations from the output that output such as angular-rate sensor 10 sensors such as grade obtains.To this, in the present embodiment, the computing of some transform utilizes by the few output data of clutter error of optical profile type jitter correction operation having carried out jitter correction and carries out image recovery processing, therefore obtains the very high recovery image of image quality.In addition, as data etc., for example can utilize mouse etc. directly to carry out image manipulation, also estimate easily, can carry out effective processing operation being used for the effect that image that image recovers the parameter handled recovers to shake track data or point.
So, in the present embodiment, owing to set up the associated record wobble information with image, only by utilizing image playback apparatus 2 (image viewing software) reading image just to make the user obtain wobble information.Therefore, do not need the user before carrying out the image recovery that image and wobble information foundation is related, improved operating efficiency.In addition, owing to also show the information that whether needs image to recover by the shake mark, so further improved operating efficiency.
According to present embodiment, detect the actual activation point of jitter correction camera lens 70, itself and the difference that drives the target location are obtained as error, the point transform that has reflected this error is carried out computing, therefore recover by utilizing this transform to carry out image, the jitter correction remnants that cause for the driving error of jitter correction camera lens 70 also can recover proofread and correct by image, can improve the jitter correction effect.
In addition, be not limited to the embodiment of above explanation, can carry out various distortion or change, those are also all in the scope of equalization of the present invention.
For example, in the present embodiment, represented that computing utilizes the example of wave digital lowpass filter to reference value, but be not limited thereto, also can carry out the reference value computing by carrying out other method such as moving average.
In the present embodiment, represented whether basis carries out the example that image recovers the cutoff frequency of change LPF, but be not limited thereto also whether basis does not carry out the cutoff frequency that image recovers change LPF.
In the present embodiment, represented via transmitting the example that cable 300 connection blur correction cameras 1 and image playback apparatus 2 carry out the transmitting-receiving of data, but be not limited thereto, for example can utilize and write down the image taken by blur correction camera 1 and recovered to handle the recording medium of the widespread use of parameters needed and photographic information etc., also can transmit by radio communication corresponding to the some transform of this image, other image.
In the present embodiment, represented restoration result operational part 230 is arranged on example on the image playback apparatus 2, but be not limited thereto, for example, recovered the camera of operational part, also the restoration result operational part can be arranged on the camera for having image.
In the present embodiment, represented example as the processing before the computing of some transform is handled in the extraction of data, but be not limited thereto, also can be in the extraction processing of a laggard line data of transform computing.
In the present embodiment, represented that jitter correction operator scheme selector switch 194 is the example of 3 attitude switches.But being not limited thereto, for example, can be the switch that can make " optical profile type correct operation pattern " and " image recovery operation pattern " ON/OFF respectively, also can be the switch of software.In this case, when under the state of not selecting " optical profile type correct operation pattern ", selecting " image recovery operation pattern ", the user is carried out following warning: the sound that gives a warning, or show that warning shows, or relevant additional representation with image is not carried out the warning label of optics jitter correction etc.
In the present embodiment, represented following example: judge that image recovers the result who whether needs, be judged as when not carrying out the image recovery, wobble information such as a transform are not carried out computing or carried out recorded and stored, but be not limited thereto, for example can add the record that carries out these wobble information, be the mark of the notification of information (warning) that do not need the image image restored, also can additional representation not with the mark of the information of wobble information recorded and stored.
In the present embodiment, represented following example: will preserve respectively original image file, preserved parameter file, and 3 kinds of files recovering image as different files, in the file of having preserved parameter, write with the file of having preserved original image and preserved the file relevant information of recovering image.But be not limited thereto, for example, these 3 kinds of data can be preserved as a file, also can be kept in other file, on application software, carry out the association demonstration etc. of 3 kinds of data with reference to this other file with the related relevant information of 3 kinds of data.
As above-mentioned detailed description,, can play following effect according to the present invention.
Contain a bit as the camera of distribution function operational part and contain the external device (ED) that image recovers operational part owing to have, recover, camera is become cheaply, in addition, can reduce the power consumption of camera so need not to carry out the very big image of operand by camera.
Utilize image recording portion or communication facilities to output to outside point as the distribution function output device as the point that the distribution function operational part calculates as distribution function owing to have, just can easily not carry out the image recovery by external device (ED) so do not carry out miscellaneous operation by point.
Point as the distribution function operational part according to the operation result computing point of reference value operational part as distribution function, so can be with the shake of correction can be by image recovery correction not shake of correction fully in the jitter correction that the jitter correction optical system is carried out as putting as distribution function fully in the jitter correction that carries out in the jitter correction optical system.
Receive view data and point as the data input part of distribution function with carry out the image that image recovers to proofread and correct the picture shake and recover operational part owing to have, as distribution function the view data that comprises shake is carried out the image recovery so can utilize a little, in the shake of photography post-equalization picture.
Owing to be to comprise receiving view data and point as the data entry program of distribution function with carry out the image that image recovers to proofread and correct the picture shake and recover the jitter correction program of operation program, recover so can utilize the computing machine of widespread use to carry out image.Therefore, need not utilize special-purpose external device (ED) just can carry out image and recover, can make it become system cheaply as a whole.
Be used in a little as the reference value of the computing of distribution function and/or the point after the computing quantity of information minimizing portion owing to have as the quantity of information minimizing of distribution function, therefore can shorten the calculation process time, conserve memory capacity etc., need not high-speed computation handling part, huge storage capacity recording medium, high-speed record equipment and high speed communication equipment, just can carry out image and recover.
Quantity of information minimizing portion reduces quantity of information by the point that extracts after reference value and/or the computing as the data of distribution function, therefore can be simply and reduce quantity of information effectively.
Quantity of information minimizing portion reduces quantity of information and recovers the needed quantity of information of computing to guarantee image, therefore can not make the image quality deterioration after image recovers, and can obtain the recovery image of high image quality.
Parameter and/or recovery image and related restoration result preservation portion or the restoration result save routine of also preserving of original image foundation that image recovers the Flame Image Process of operational part will be used for owing to have, so when the user changes image and recovers, during parameters needed, can easily put in order and managing image data and parameter setting.
Restoration result preservation portion can preserve and organize more corresponding a plurality of parameters of recovery images and/or recovery images, even therefore repeatedly try under the situation of image recovery in the change parameter while, also can keep tentative history, can easily put in order.
The jitter correction control part, corresponding with the selection mode of tremble correction mode selection portion, change the control content of jitter correction optical system, so can be suitable for carrying out the optical profile type jitter correction operation of image recovery situation.
The jitter correction control part by change the operational method of reference value according to the selection mode of tremble correction mode selection portion, changes the control content of jitter correction optical system.Thus, in the jitter correction amount of carrying out to change when image recovers the operation of optical profile type jitter correction,,, also can carry out suitable jitter correction operation for bigger hand shake by reducing the jitter correction amount of optical profile type jitter correction operation.In addition, residual picture shake can recover to carry out jitter correction by image, therefore can obtain jitter correction fully images with high image quality.
The jitter correction control part changes the control content of jitter correction optical system by the cutoff frequency that changes low-pass filter, so can easily carry out the change of the jitter correction amount of optical profile type jitter correction operation, can easily carry out present embodiment.
The jitter correction control part, the tremble correction mode selection portion is carried out the cutoff frequency of the selection mode of image recovery, change to the high frequency of cutoff frequency of not carrying out the selection mode of image recovery than tremble correction mode selection portion, the jitter correction amount of optical profile type jitter correction operation reduces when therefore carrying out the image recovery, for bigger hand shake, also can carry out suitable jitter correction operation.
Judge whether that the image that need carry out image recovery mode recovers judging part owing to have,, prevent to carry out meaningless image and recover so can recover by carrying out carrying out image when image recovers to improve image quality in hope.
Image recovers judging part, judges whether that according to vibration detection signal needs carry out image recovery mode, so can judge situation that the picture shake is excessive and the situation that does not almost have generation as shake.
Image recovers judging part, judges whether that according to shutter speed needs carry out image recovery mode, therefore can carry out image under the situation of the shutter speed that might produce the picture shake and recover.
Image recovers judging part, judges whether that according to the focal length of photographic optical system needs carry out image recovery mode, therefore can carry out image under the situation of the focal length that might produce the picture shake and recover.
Image recovers judging part, judges whether that as distribution function needs carry out image recovery mode according to point, therefore can change judging whether that the needs image recovers according to the amount of jitter in the exposure, and can carry out more right judgement.
When image recovery judgement section judges does not need to carry out image recovery mode, notify this notification of information equipment owing to have, so the cameraman can easily hold photography state, can be more convenient to use.
When image recovery judgement section judges does not need to carry out image recovery mode, owing to do not carry out image recovery mode, therefore can not carry out calculation process meaninglessly, effective at aspects such as processing speed, power consumption.
When image recovers judgement section judges and does not need to carry out image recovery mode, because savepoint therefore can conserve memory, the capacity of recording medium as distribution function.
When the tremble correction mode selection portion is selected image recovery mode, owing to also select the optical profile type correction mode simultaneously, so can reduce the shake of the picture that carries out the image recovery by the optical profile type jitter correction, can carry out obtaining images with high image quality when image recovers effectively.
The tremble correction mode selection portion under the state of not selecting the optical profile type tremble correction mode, can't be selected image recovery mode, therefore can prevent under the state that does not carry out the optical profile type jitter correction image of taking is being carried out the image recovery mistakenly.Therefore, carrying out always to obtain images with high image quality when image recovers.
The tremble correction mode selection portion when selecting image recovery mode under the state of not selecting the optical profile type tremble correction mode, can be warned, and can prevent that therefore under the state that does not carry out the optical profile type jitter correction image of taking being carried out image mistakenly recovers.Therefore, carrying out always to obtain images with high image quality when image recovers.
The point that is carried out as the distribution function operational part by point is as the computing of distribution function, can be undertaken by operating optical formula blur correcting device, the shake of the picture in the time of therefore can recovering by optical profile type jitter correction reduction carrying out image, the point of computing is as distribution function, comprise image fully and recover needed information, therefore carrying out always to obtain images with high image quality when image recovers.
＜the four embodiment 〉
Below, utilize Figure 24 that the 4th embodiment of the present invention is described.
The 4th embodiment following different with the 3rd embodiment, other parts are identical with the 3rd embodiment, after carrying out a transform computing (S750), are equivalent to the operation of the S680 (image recovery judging part) among Figure 17 of the 3rd embodiment that is:.Therefore, to playing the part with above-mentioned the 3rd embodiment identical functions, be marked with identical label, suitably the repetitive description thereof will be omitted.
After in S750, carrying out a transform computing, in S755, whether need image to recover the judgement of (whether needing to carry out image recovery operation pattern).This step is the operation (recovering the operation of judging part as image) with purpose identical with the S680 of Figure 17 in the 3rd embodiment, but determination methods difference (with reference to Figure 25).Judged result among the S755 is judged as when carrying out the image recovery, enters S760, is judged as when not carrying out the image recovery, turns back to S640.
Figure 25 is that expression judges whether to carry out the process flow diagram that the image image restored is recovered the detail operations of judging part according to a transform, is the figure that is equivalent to the Figure 18 in the 3rd embodiment.
In S5310, judge whether that according to a transform needs carry out image recovery operation pattern.The result who judges enters S5320 for carrying out when image recovers, and enters into the exposure program (S760 of Figure 24) that image recovers.On the other hand, do not carrying out entering S5330 when image recovers.
As the concrete mode whether needs carry out the judgement of image recovery operation pattern of carrying out according to a transform, for example be following method: the width of calculation level transform, this width hour carry out image than scheduled volume (for example 30 μ m) and recover.At this, the width of some transform for example can be in the hope of the rectangle external with a transform, and the catercorner length that will join with this rectangle is as the width of a transform.
In S5330, the information that the image recovery operation is not carried out in warning, demonstration (notice).Notice for example both can be warning tones, the also demonstration that can be scheduled to.
In S5340, entering does not have the exposure program (S640 among Figure 24) that recovers processing.
In the 3rd embodiment, before carrying out a transform computing, utilize information such as shake detection limit, shutter speed, focal length need to judge whether image to recover.But, these information with release-push from half by to entirely by during the information that obtains, therefore prediction and judge vibration in the exposure is from pressing release-push under the situation of end exposure period jitter quantitative changeization, the situation that existence can't correctly be judged entirely.Therefore, in the present embodiment, whether the some transform according to utilizing the information computing that obtains in the exposure needs to carry out the judgement of image recovery operation pattern, can reflect the judgement of the vibration information of the reality in the photography.
In addition, obtain as the picture amount of jitter the image planes of concrete numerical value from a transform, the needs that therefore can more judge rightly/need not image recovers.
According to present embodiment,, judge whether that the needs image recovers so can change, and can carry out more right judgement according to the amount of jitter in the exposure owing to carry out the judgement whether needs carry out image recovery operation pattern according to a transform.
As above-mentioned detailed description,, can play following effect according to the present invention.
Judge whether that the image that need carry out image recovery mode recovers judging part owing to have,, prevent to carry out meaningless image and recover so can recover by carrying out carrying out image when image recovers to improve image quality in hope.
Image recovers judging part, judges whether that according to vibration detection signal needs carry out image recovery mode, so can judge situation that the picture shake is excessive and the situation that does not almost have generation as shake.
Image recovers judging part, judges whether that according to shutter speed needs carry out image recovery mode, therefore can carry out image under the situation of the shutter speed that might produce the picture shake and recover.
Image recovers judging part, judges whether that according to the focal length of photographic optical system needs carry out image recovery mode, therefore can carry out image under the situation of the focal length that might produce the picture shake and recover.
Image recovers judging part, judges whether that as distribution function needs carry out image recovery mode according to point, therefore can change judging whether that the needs image recovers according to the amount of jitter in the exposure, and can carry out more right judgement.
When image recovery judgement section judges does not need to carry out image recovery mode, notify this notification of information equipment owing to have, so the cameraman can easily hold photography state, can be more convenient to use.
When image recovery judgement section judges does not need to carry out image recovery mode, owing to do not carry out image recovery mode, therefore can not carry out calculation process meaninglessly, effective at aspects such as processing speed, power consumption.
When image recovers judgement section judges and does not need to carry out image recovery mode, because savepoint therefore can conserve memory, the capacity of recording medium as distribution function.
＜the five embodiment 〉
The 5th embodiment is the mode as the changeable type camera that can change phtographic lens part, to playing the part with the 3rd embodiment identical functions, is marked with identical label, and suitably the repetitive description thereof will be omitted.
Figure 26 is the block diagram of system architecture of the 5th embodiment of expression blur correction camera of the present invention.
On camera main-body 101, main body side control part 80A, power suppling part 90, some transform operational part 100, image pickup part 110, image recording portion 120, interface portion 130, tremble correction mode judging part 145, exposure control part 150, flash of light control part 180, operating portion 190 etc. are set.
On lens changeable 102, camera lens side control part 80B, RAM 121, focus lens position detection part 160, focal length test section 170, tremble correction mode selector switch 194, optical profile type corrective system 500 etc. are set.
In addition, in the part that connects camera main-body 101 and lens changeable 102, signalization transfer part 310 can be carried out the exchange of signal between camera main-body 101 and lens changeable 102.
Function correction portion 240 is set on image playback apparatus 2.
Next, the operation when photographing describes to camera main-body in the present embodiment 101 and lens changeable 102.
In addition, described in the 3rd embodiment, tremble correction mode selector switch 194 is to select the switch of " jitter correction OFF pattern ", " optical profile type correct operation pattern ", " image recovery operation pattern " 3 kinds of patterns, but at this, only the operation to " optical profile type correct operation pattern " relevant with explanation of the present invention, " image recovery operation pattern " describes.
Figure 27 and Figure 28 are the process flow diagrams of the flow process of expression camera main-body 101 of present embodiment and the operation of lens changeable 102 when photography, only expression and general single relevant part of jitter correction when clapping release.In addition,, process flow diagram is divided into Figure 27 and Figure 28 represents on paper.In addition, in these flow processs, the flow process (S3000 part) of camera main-body 101 sides is represented in left side in the drawings, represents the flow process (S4000 part) of lens changeable 102 sides on the right side, the operation that connects with dotted line between this is expressed as roughly with operation constantly.
In S3010, to the power supply use of lens changeable 102 permission power suppling parts 90.
Obtained the lens changeable 102 of the power supply usage license (S4010), in S4020, to angular-rate sensor 10 and other circuit supplies.
In S3020, judge whether half be ON by switch 191, half enters S3030 during for ON by switch 191, partly repeat the judgement among this S3020 during for OFF by switch 191.In S3030, indication is sent to the camera lens side in the instruction that half jitter correction that carries out during for ON by switch 191 (hereinafter referred to as half by jitter correction) operation begins.
In having received half lens changeable 102 by jitter correction sign on (S4030), in S4040, remove the locking of jitter correction camera lens 70, beginning half press jitter correction and is operated.
In S3040, judge whether to be ON by switch 192 entirely, enter S3050 full during for ON by switch 192, return S3030 by switch 192 during for OFF entirely, repeat the judgement among this S3040.In S3050, receive the ON that presses switch 192 entirely, the instruction that jitter correction in the indication exposure is begun sends to the camera lens side.The preparation that exposes in S3060, for example catoptron rising etc. begins exposure in S3070, finish exposure in S3080.
In having received exposure, in the lens changeable 102 of jitter correction sign on (S4050), begin jitter correction operation in the exposure at S4060.In addition, in this S4060, in lens changeable 102, carry out jitter correction operation in this exposure, and detect the actual activation point of jitter correction camera lenses 70 by position detection part 60, at least during exposure zero hour to the finish time, will with the difference of target drives position as control information (error information), in addition, will continue to store among the RAM121 as vibration data from the information of angular-rate sensor 10.
In S3090, the instruction (jitter correction halt instruction) that the indication jitter correction is stopped to send to lens changeable 102.In the lens changeable 102 that has received jitter correction halt instruction (S4070), stop jitter correction control at S4080.
Processing after in S3100, exposing, for example catoptron decline and charging etc.In S3110, will indicate the jitter correction camera lens lock instruction of the locking of jitter correction camera lens 70 to send to lens changeable 102.In the lens changeable 102 that has received jitter correction camera lens lock instruction (S4090), at S4100 locking jitter correction camera lens.
Enter Figure 28, in S3120, in being arranged on the tremble correction mode judging part 145 of camera main-body 101, judge: be to select " optical profile type correct operation pattern " (only carrying out the jitter correction of optical profile type), still select " image recovery operation pattern " (jitter correction and the image that carry out optical profile type recover) by the tremble correction mode selector switch 194 that is arranged on the lens changeable 102.If " image recovery operation pattern " just enters S3130, if " optical profile type correct operation pattern " just enters S3170.
In addition, also corresponding with the operation among the S3120 even in the lens changeable side, if " image recovery operation pattern " just enters S4120, situation in addition enters S4150 (S4110).
In S3130, will be stored in error information among the RAM 121 before the request and the instruction of vibration data sends to lens changeable 102.Receive the lens changeable 102 of request error information and vibration data (S4120), in S4130, error information sent to camera main-body 101.
In S4140, judge whether the transmission of two data is finished, send and enter S4150 when having finished, sending the transmission of imperfect tense returning S4130 continuation error information.In the camera main-body 101 that has received error information and vibration data (S3140), judge at S3150 whether the transmission of two data is finished, send and enter S3160 when having finished, send and imperfect tense return the transmission that S3140 continues two data.
In S3155, by the vibration data computing point transform that receives.In S3160, the image of taking is set up error information and some transform association and is saved in image recording portion 120.In S3170, photographs is saved in image recording portion 120.In addition, different with S3160 under the situation of this step, do not preserve error information.In S3180, lens changeable 102 sent urges the instruction that cuts off power supplys, thereafter, in S3190 with camera main-body 101OFF, end operation.
In having received the lens changeable 102 of urging the instruction (S4150) that cuts off power supply, at S4160 with angular-rate sensor 10 and other circuit OFF, end operation.
The view data of preserving, by the some transform and an error information of transform operational part 100 computings, be sent to image playback apparatus 2, in function correction portion 240 according to error information check point transform.
Thereafter, recovering to carry out in the operational part 210 image at image recovers.At this moment, the some transform after utilization is proofreaied and correct according to error information is carried out image and is recovered.The recovery image that so obtains has been considered the jitter correction of following error of jitter correction camera lens 70 can obtain the high image of jitter correction effect.
According to present embodiment, in the camera system of lens changeable, detect the driving error of jitter correction camera lens 70, being used for image recovers, therefore in the drive characteristic of jitter correction camera lens not simultaneously, use any lens changeable all can obtain best jitter correction effect according to each lens changeable.
Be not limited to the embodiment of above explanation, can carry out various distortion or change, these are all in the scope of equalization of the present invention.
In the first and the 3rd embodiment, represented that the extraction processing of carrying out data reduces the example of data volume, but be not limited thereto, do not carry out the extraction of data, also can carry out computing, the preservation of computing, preservation and the error of reference value.
In the present embodiment, represented by utilized from the reference value of the output of angular-rate sensor 10 or vibration data computing point transform, by control information to its example of proofreading and correct, but be not limited thereto, for example, also can proofread and correct from reference value and vibration data both sides operating function.
In addition, also can try to achieve a transform according to any one party of reference value and vibration data or both sides and control information, the correction of not carrying out a transform is just carried out image and is recovered.
And then, also can be completely without the output of angular-rate sensor 10, only from control information computing point transform.During only from this control information computing point transform, reference value or vibration data need not storage or pass through the communication transmission, therefore can improve operating efficiency and shorten the activity duration.
In the present embodiment, represented that some transform operational part 100 is installed in the example on the camera main-body 101 of camera 1, but be not limited thereto, for example also can be on image playback apparatus 2 mounting points transform operational part 100.Equally, in the 5th embodiment, represented function correction portion 240 is installed on image playback apparatus 2, but be not limited thereto, for example also can on the camera main-body 101 of camera 1, function correction portion be set.So, as the mode of utilizing the information relevant, can carry out multiple combination with the control position error.This combination example of expression in the following table 2.
Table 2
| No. | Camera, camera main-body | Image | Remarks | |
| 1 | Point transform operational part function correction portion image recovers operational part | |||
| 2 | Point transform operational part (reflection error) image recovers operational part | |||
| 3 | Point transform operational part (the only computing of carrying out according to error) image recovers operational part |
| No. | Camera, camera main-body | Image | Remarks | |
| 4 | Point transform operational part function correction portion | Image recovers operational part | Corresponding with the 3rd embodiment | |
| 5 | Point transform operational part | Function correction portion image recovers operational part | Corresponding with the 5th embodiment | |
| 6 | Point transform operational part (reflection error) | Image recovers operational part | ||
| 7 | Point transform operational part (the only computing of carrying out according to error) | Image recovers operational part | ||
| 8 | Point transform operational part function correction portion image recovers operational part | |||
| 9 | Point transform operational part (reflection error) image recovers |
|||
| 10 | Point transform operational part (the only computing of carrying out according to error) image recovers operational part |
No.4 in the table 2 is equivalent to the 3rd embodiment, and No.5 is equivalent to the 5th embodiment.Any one mode shown in the table 2 all can similarly be brought into play effect of the present invention.
In addition, according to the mode shown in the No.3 in the table 2,7,10, as mentioned above, reference value or vibration data need not storage or transmit by communication, can improve operating efficiency and shorten the activity duration.
As above-mentioned detailed description, according to the embodiment of the present invention, can play following effect.
Owing to have: control position error efferent, the driving target location of the jitter correction optical system that will be obtained by control part and poor from the actual activation point of the jitter correction optical system of position detection part output are exported as the control position error; Recover operational part with image, carry out image and recover, proofread and correct the picture shake by the image of being taken by image pickup part having been added the Flame Image Process of control position error; Can also comprise the situation that does not have as target, to be undertaken jitter correction according to the remaining picture shake of the drive controlling error correction of jitter correction optical system, the high and correction picture shake effectively of jitter correction effect always by the optical profile type jitter correction.
Comprise the function correction portion of error correction point in control position that utilize as distribution function, image recovers operational part, handle as distribution function with the point after proofreading and correct by function correction portion, thereby carrying out image recovers, therefore can be by the residual picture shake of the drive controlling error correction of jitter correction optical system, also comprise the situation that does not have as target, to be undertaken jitter correction, the high and correction picture shake effectively of jitter correction effect always by the optical profile type jitter correction.
Since have utilize control position error computing point as the point of distribution function as the distribution function operational part, therefore can carry out computing as distribution function to the point of the drive controlling error that reflected the jitter correction optical system.Therefore, can also comprise the situation that does not have as target, to be undertaken jitter correction by the residual picture shake of the drive controlling error correction of jitter correction optical system, the high and correction picture shake effectively of jitter correction effect always by the optical profile type jitter correction.
The possibility of utilizing on the industry
More than, the digital camera of taking still image is illustrated, but also can similarly uses the present invention for the digital camera of shooting motion.
Claims (4)
1. blur correction camera system comprises:
Vibration detecting part detects vibration and output vibration detection signal;
The reference value operational part, the reference value of the described vibration detection signal of computing;
The jitter correction optical system is driven according to the signal that deducts described reference value from described vibration detection signal, carries out the first picture jitter correction;
Image pickup part is taken the picture that is formed by the photographic optical system that comprises described jitter correction optical system;
Point is as the distribution function operational part, and is needed as distribution function according to described reference value arithmograph picture recovery computing; With
Image recovers operational part, carries out image recovery computing according to described as distribution function, and the image of being taken by described image pickup part is carried out the second picture jitter correction,
Even described second shake of proofreading and correct as jitter correction is to have carried out described first as the also residual shake composition that has of jitter correction.
2. blur correction camera system according to claim 1,
With described image pickup part take rest image time correlation temporal information and take the relevant time sequence information of the sequential of described rest image with described image pickup part and be provided for describedly as the distribution function operational part, describedly utilize described temporal information and described time sequence information computing described as distribution function as the distribution function operational part.
3. blur correction camera system according to claim 1,
Also have image and recover judging part, even utilize the focal length of described photographic optical system, described image pickup part to take the time of rest image and carried out described first, judge whether that recovering operational part by described image carries out the described second picture jitter correction as in the also residual shake composition that has of jitter correction any.
4. according to each described blur correction camera system in the claim 1 to 3,
Described second shake of proofreading and correct as jitter correction is the rest image shake of the rest image of described image pickup part shooting.
Applications Claiming Priority (17)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2002374704A JP4647183B2 (en) | 2002-12-25 | 2002-12-25 | Blur correction camera system, image recovery device, and blur correction program |
| JP2002374687A JP2004205803A (en) | 2002-12-25 | 2002-12-25 | Image blur correcting camera |
| JP2002374724A JP4244632B2 (en) | 2002-12-25 | 2002-12-25 | Vibration reduction camera |
| JP374687/2002 | 2002-12-25 | ||
| JP374748/2002 | 2002-12-25 | ||
| JP2002374644A JP4311013B2 (en) | 2002-12-25 | 2002-12-25 | Blur correction camera system and camera |
| JP2002374748A JP2004205810A (en) | 2002-12-25 | 2002-12-25 | Correcting camera |
| JP374739/2002 | 2002-12-25 | ||
| JP2002374739A JP4244633B2 (en) | 2002-12-25 | 2002-12-25 | Vibration reduction camera |
| JP374724/2002 | 2002-12-25 | ||
| JP374704/2002 | 2002-12-25 | ||
| JP374661/2002 | 2002-12-25 | ||
| JP374644/2002 | 2002-12-25 | ||
| JP2002374661A JP4356316B2 (en) | 2002-12-25 | 2002-12-25 | Blur correction camera system, blur correction camera, image restoration device, and blur correction program |
| JP2003026098A JP2004239962A (en) | 2003-02-03 | 2003-02-03 | Shake correction camera system, shake correction camera, image recovering device and shake correction program |
| JP026098/2003 | 2003-02-03 | ||
| PCT/JP2003/016809 WO2004059380A1 (en) | 2002-12-25 | 2003-12-25 | Blur correction camera system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1732406A CN1732406A (en) | 2006-02-08 |
| CN1732406B true CN1732406B (en) | 2010-06-02 |
Family
ID=32812606
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200380107765.5A Expired - Fee Related CN1732406B (en) | 2002-12-25 | 2003-12-25 | Blur correction camera system |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP4311013B2 (en) |
| CN (1) | CN1732406B (en) |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4418342B2 (en) * | 2004-10-13 | 2010-02-17 | オリンパス株式会社 | Image processing apparatus and electronic camera |
| JP4985062B2 (en) * | 2006-04-14 | 2012-07-25 | 株式会社ニコン | camera |
| JP5150308B2 (en) * | 2007-03-13 | 2013-02-20 | ペンタックスリコーイメージング株式会社 | Image blur correction device |
| JP2008236289A (en) * | 2007-03-20 | 2008-10-02 | Sanyo Electric Co Ltd | Image sensing device |
| JP2009156946A (en) * | 2007-12-25 | 2009-07-16 | Sanyo Electric Co Ltd | Vibration prevention control circuit of imaging device |
| JP5487722B2 (en) * | 2009-05-25 | 2014-05-07 | ソニー株式会社 | Imaging apparatus and shake correction method |
| JP2011091571A (en) * | 2009-10-21 | 2011-05-06 | Olympus Imaging Corp | Moving image creation device and moving image creation method |
| JP5424835B2 (en) * | 2009-11-30 | 2014-02-26 | キヤノン株式会社 | Image processing apparatus and image processing method |
| JP5599039B2 (en) | 2010-06-01 | 2014-10-01 | キヤノン株式会社 | Optical device with image blur correction function |
| CN104427241A (en) * | 2013-09-09 | 2015-03-18 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| JP6381433B2 (en) * | 2014-12-15 | 2018-08-29 | オリンパス株式会社 | Camera system and blur correction method thereof |
| KR20160140193A (en) * | 2015-05-29 | 2016-12-07 | 삼성전기주식회사 | Circuit for correcting image and correcting image Method thereof |
| KR20170076375A (en) * | 2015-12-24 | 2017-07-04 | 삼성전기주식회사 | Optical image stabilization module and camera module |
| US11202011B2 (en) * | 2016-07-25 | 2021-12-14 | Canon Kabushiki Kaisha | Control apparatus, image capturing apparatus, lens apparatus, image capturing system, control method, and storage medium |
| JP7007214B2 (en) * | 2018-02-27 | 2022-01-24 | 日本電産サンキョー株式会社 | Laser pointer with runout correction mechanism and its shake suppression control method |
| JP2022112842A (en) * | 2021-01-22 | 2022-08-03 | キヤノン株式会社 | Shake evaluation device, shake evaluation method, imaging means manufacturing method, and program |
| KR102501092B1 (en) * | 2022-09-15 | 2023-02-17 | 주식회사 서랩 | Smart rope holder and pets managemant convergence system using the same |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5282044A (en) * | 1990-10-18 | 1994-01-25 | Fuji Photo Film Co., Ltd. | Camera shake correction system |
-
2002
- 2002-12-25 JP JP2002374644A patent/JP4311013B2/en not_active Expired - Fee Related
-
2003
- 2003-12-25 CN CN200380107765.5A patent/CN1732406B/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5282044A (en) * | 1990-10-18 | 1994-01-25 | Fuji Photo Film Co., Ltd. | Camera shake correction system |
Non-Patent Citations (3)
| Title |
|---|
| JP特开平11-101998A 1999.04.13 |
| JP特开平11-146260A 1999.05.28 |
| JP特开平7-226905A 1995.08.22 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1732406A (en) | 2006-02-08 |
| JP2004205799A (en) | 2004-07-22 |
| JP4311013B2 (en) | 2009-08-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1732406B (en) | Blur correction camera system | |
| CN102047318B (en) | Image display apparatus and control method thereof, and computer program | |
| EP1577705A1 (en) | Blur correction camera system | |
| CN102457661B (en) | Camera | |
| JPH114375A (en) | Electronic image pickup device | |
| CN101616261B (en) | Image recording apparatus, image recording method, image processing apparatus, and image processing method | |
| CN101415076B (en) | Composition determining apparatus, composition determining method | |
| CN100553294C (en) | Camera head, direct picture display control method | |
| US5561531A (en) | Camera for recording image data and shot data and video filing system for filing such data | |
| CN103200354A (en) | Imaging apparatus and method for controlling the same | |
| CN102045503A (en) | Information processing apparatus, display control method, and display control program | |
| CN104717429A (en) | Image capture device having tilt and/or perspective correction | |
| CN103795917A (en) | Imaging apparatus and control method | |
| CN100385282C (en) | Apparatus and method for focal point position detecting | |
| JP5630041B2 (en) | Electronic equipment | |
| JP4187954B2 (en) | Electronic album device and electronic album creation method | |
| JPH09163037A (en) | Image filing system | |
| JPH114376A (en) | Electronic image pickup device | |
| CN102265602A (en) | Image capture device | |
| JPH114401A (en) | Electronic image-pickup device | |
| US20100166316A1 (en) | Method and apparatus for processing a digital image including a face detection finction | |
| US20050270407A1 (en) | Imaging apparatus | |
| CN102006412A (en) | Image pickup apparatus and control method therefor | |
| US20060177211A1 (en) | Digital camera | |
| JP4366484B2 (en) | Digital camera and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100602 Termination date: 20191225 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |