JP2007318201A - Deflection detection apparatus and image correction apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a deflection detection apparatus capable of obtaining a deflection correction image cost-effectively with high quality without upsizing the apparatus and resulting in heavy total weight. <P>SOLUTION: The deflection detection apparatus 10 includes a pressure sensor 11 and a deflection detection section 12. The pressure sensor 11 outputs a photographing signal corresponding to a photographing operation and is formed to cover a shutter button 21. The deflection detection section 12 senses deflection of a camera 20 and outputs a deflection signal synchronously with the photographing signal, and includes a gyro sensor 13 for sensing the deflection, a drive/signal detection circuit 14 for driving the gyro sensor 13 and sensing the signal, and a memory section 15 for recording the sensed deflection signal. The pressure sensor 11 and the deflection detection section 12 are interconnected via a communication cable 16. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a shake detection device that detects camera shake that occurs when shooting using a shooting device such as a digital still camera or a digital video camera, and a shot image of a shooting device equipped with the shake detection device. The present invention relates to an image correction apparatus that performs correction based on camera shake information.

  In order to obtain an image obtained by correcting camera shake that occurs during shooting, a digital still camera with a built-in camera shake correction function is usually used. On the other hand, in such a digital still camera that does not have a built-in camera shake correction mechanism, for example, the whole camera is mounted on an anti-vibration device including a drive actuator that displaces the camera shake in a direction to cancel the camera shake itself. This has been proposed (see Patent Document 1). There has also been proposed a method of estimating a camera shake component on a computer after shooting from an imaging screen affected by camera shake and performing image processing to obtain a camera shake correction image (see Non-Patent Document 1).

JP-A-10-293333 Optics Letters vol.13, no.7, p547-p549

  In the former vibration isolator, it is inevitable that the apparatus becomes large and the total weight increases, and a high-power actuator is necessary to obtain high vibration isolation performance, and there is a problem that the cost increases.

  Further, in the latter method in which camera shake correction is performed by image processing, a camera shake component is estimated from only a captured image and processed, and thus there is a problem that a corrected image with sufficient quality cannot be obtained.

  The present invention has been made in view of the above circumstances, and the shake detection apparatus capable of obtaining an image stabilization image that is inexpensive and excellent in quality without increasing the size of the apparatus or increasing the total weight. An object of the present invention is to provide an image correction apparatus that corrects a captured image of an imaging apparatus equipped with the shake detection apparatus.

  The shake detection device according to claim 1 of the present invention that achieves the above object includes a shooting operation detection unit that outputs a shooting signal corresponding to a shooting operation of the shooting device, and detects a shake of the shooting device and outputs the shooting signal to the shooting signal. And a shake detector that outputs a synchronized shake signal.

  Examples of the photographing device include a digital still camera, a digital video camera, and a mobile phone having a photographing function (equipped with a digital camera).

  The photographing operation detection unit outputs a photographing signal corresponding to a photographing operation such as a release (pressing of a photographing shutter), and includes, but is not limited to, a pressure sensor. For example, a remote control that transmits a release signal is also included in the photographing operation detection unit if the release signal is output as a photographing signal.

  As the shake detection unit, for example, an angular velocity sensor is used. Specifically, a gyro sensor that detects a biaxial angular velocity of pitch (PITCH) and yaw (YAW) is provided, or a gyro sensor that detects an angular velocity of the pitch. A sensor provided with two gyro sensors, a sensor and a gyro sensor for detecting the angular velocity of the yaw, is used, but is not limited to this.

  According to a second aspect of the present invention, there is provided a shake detection device comprising an attachment portion for attaching the shake detection portion to the imaging device.

  The shake detection device according to a third aspect of the present invention is characterized in that the photographing operation detection unit is attached to a photographing operation unit of the photographing device.

  Examples of the photographing operation unit include a shutter button (release button) or an operation key in a mobile phone.

  The shake detection apparatus according to claim 4 of the present invention is characterized in that the shooting operation detection unit supplies the shooting signal to the shake detection unit by wired means or wireless means.

  As the wired means, for example, there is a communication cable, and the shooting operation detection unit and the shake detection device are connected to each other by a communication cable, and a shooting signal is supplied through the communication cable.

  As the wireless means, for example, there is a transmitter / receiver composed of a transmitter installed in the photographing operation detecting device and a receiver installed in the shake detecting device, and a photographing signal is supplied via this transceiver.

  The shake detection device according to claim 5 of the present invention is characterized in that the photographing operation detection unit includes a pressure sensor for detecting a photographing operation of the photographing device.

  An example of the pressure sensor is a type that detects a pressing force applied to a shutter button (release button) during photographing.

  An image correction apparatus according to a sixth aspect of the present invention includes a first input unit to which the shake signal supplied from the shake detection apparatus according to any one of claims 1 to 5 is input, and the shake. A second input unit to which an image obtained by an imaging device to which a detection device is attached is supplied, and an image correction unit that corrects the image based on the shake signal.

  According to the shake detection device of the first aspect of the present invention, it is possible to detect the shake of the camera or the like that is attached to a digital still camera or the like. A corrected image can be obtained by performing image processing on the captured image based on the shake signal. Therefore, even if it is a digital still camera etc. that does not have a camera shake correction function, the overall size of the device is not increased, the weight is increased, and the cost is not increased as compared with the case where it is mounted on a fender. Thus, it is possible to obtain a photographed image with the shake corrected. In addition, when applied to a digital still camera with a camera shake correction function, it is possible to perform image processing using a shake signal on a captured image that cannot be processed with the camera shake correction function, and shake is sufficiently corrected. It is possible to obtain a photographed image.

  According to the image correction device of the present invention, the image correction device according to any one of claims 1 to 5 detects an image captured by the image capturing device to which the shake detection device according to any one of claims 1 to 5 is attached. Since image processing is performed using the shake signal of the shake detection device, it is possible to obtain a corrected image with superior quality as compared with the case where image processing is performed by estimating a camera shake component only from a captured image.

  An embodiment of an image correction apparatus of the present invention that processes an image captured by a shake detection apparatus of the present invention and a digital still camera equipped with the shake detection apparatus will be described below with reference to FIGS.

  FIG. 1 is a perspective view showing an embodiment of a shake detection device of the present invention, and FIG. 2 is a perspective view for explaining a state in which the shake device of FIG. 1 is mounted on an adapter as an attachment portion and attached to a camera.

  As shown in FIG. 1, the shake detection device 10 includes a pressure sensor 11 and a shake detection unit 12 as a photographing operation detection unit.

  The pressure sensor 11 detects, for example, a pressing force acting on a shutter button 21 (see FIG. 2) of the camera 20 to detect a shooting operation, and outputs a shooting signal corresponding to the shooting operation. The pressure sensor 11 covers the shutter button 21. Formed as follows. Therefore, the operator of the camera 20 presses the shutter button 21 from above the pressure sensor 11.

  The shake detection unit 12 detects a shake of the camera 20 and outputs a shake signal synchronized with the photographing signal. As shown in FIG. 4, the shake detection unit 12 drives the gyro sensor 13 for detecting the shake and the gyro sensor 13. A drive / signal detection circuit 14 for detecting the signal and a memory unit 15 for recording the detected shake signal.

  The pressure sensor 11 and the shake detection unit 12 are connected to each other via a communication cable 16 as a wired means. An imaging signal output from the pressure sensor 11 is input to the drive / signal detection circuit 14 via the communication cable 16. The drive / signal detection circuit 14 drives the gyro sensor 13 based on the photographing signal to detect the shake of the camera 20, and outputs the shake signal in synchronization with the photographing signal. The output shake signal is stored in the memory unit 15 in a state corresponding to each photographing frame.

  The gyro sensor 13 includes, for example, one biaxial type gyro sensor that detects the angular velocity of two axes of pitch (PITCH) and yaw (YAW), or a single axis type gyro sensor that detects the angular velocity of the pitch and the iodine. It consists of two uniaxial gyro sensors that detect the angular velocity.

  The memory unit 15 is made of, for example, a semiconductor memory, and is installed in a state incorporated in the shake detection unit 12 or is detachably installed. Note that the memory unit 15 may be installed outside the shake detection device 10 and the shake signal transmitted from the shake detection unit 12 by radio may be recorded.

  The shake detection device 10 configured as described above is attached to the camera 20 via an adapter 30 as an attachment portion as shown in FIG. The adapter 30 is configured according to the camera 20 to be attached. In the case shown in FIG. 2, the adapter 30 includes a base 31 applied to the bottom surface of the body of the camera 20, a pair of side portions 32 applied to both side surfaces of the base 31 at both ends in the length direction, and the length of the base 31. And a protrusion 33 protruding from the front edge at a substantially central position in the direction, and formed from an elastic material such as synthetic resin.

  The distance between the pair of side portions 32 is set to be slightly narrower than the dimension between both side surfaces of the camera 20, and the pair of side portions 32 are in close contact with both side surfaces of the camera 20 when mounted. For this reason, once the adapter 30 is once attached to the body of the camera 20, there is no possibility that it will be easily detached during the photographing operation.

  The protrusion 33 is provided with the shake detection unit 12, and the shake detection unit 12 is located in the vicinity of the photographing lens 22 of the camera 20 so as not to interfere with the hand and fingers of the photographer holding the camera 20 during photographing. Position.

  The camera 20 does not have a camera shake correction function, but may have a built-in camera shake correction function. The shake detection device 10 is also used to deal with camera shake that cannot be handled by the built-in camera shake correction function.

  As shown in FIG. 3, the pressure sensor 11 is mounted on the shutter button 21. For example, a pressure-sensitive adhesive layer is formed on the back surface of the pressure sensor 11 (the surface in contact with the shutter button 21) so that the pressure sensor 11 cannot be easily detached after being mounted.

  FIG. 5 is a block diagram showing an embodiment of the image correction apparatus of the present invention.

  The image correction apparatus 40 includes an interface 41, a first input unit 42 provided in the interface 41 that inputs a shake signal from the shake detection apparatus 10, and a first input provided in the interface 41 that inputs a captured image from the camera 20. 2 input unit 43, image correction unit 44 that processes a captured image based on the input shake signal, liquid crystal type display device 45 that displays an image corrected by image correction unit 44, and printing the corrected image A printer 46 to be output, a memory 47, and a microprocessor (CPU) 48 for controlling the entire image correction device 40 such as the image correction unit 44, the display device 45, the printer 46, and the like.

  A slot is provided in the first input unit 42, and a shake signal can be input from the memory unit 15 by inserting the memory unit 15 of the shake detection device 10 into this slot. The shake signal is once amplified by, for example, an amplifier, converted into a digital signal by an A / D converter, and then input to the image correction device 40.

  Similarly, the second input unit 43 is provided with a slot. By inserting a memory card of the camera 20 into this slot, a photographed image can be input from the memory card.

  In the memory 47, a control program for the entire image correction device 40 and an image restoration processing program for processing a photographed image taken by the camera 20 based on a shake signal from the shake detection device 10 (contents of steps S103 to S107 in FIG. 6). ), A shake signal input from the first input unit 42, a captured image input from the second input unit 43, a corrected image subjected to image restoration processing by the image correction unit 44, and the like are stored. The CPU 48 reads out a control program and the like from the memory 47, controls the image correction apparatus 40, executes an image restoration processing program, and the like.

  FIG. 6 shows a method for correcting a photographed image including camera shake by image processing using the image correction apparatus 40.

  First, in step S100, the shake detection device 10 is attached to the camera 20 via the adapter 30 (see FIG. 3).

  Next, in step S101, the shake detection device 10 is set in a driving state (the gyro sensor 13 is in a driving state), and the shutter button 21 is pressed to perform photographing.

  In step S <b> 102, the shake detection unit 12 detects the shake generated in the camera 20 in synchronization with the shooting signal as a shake signal and records it in the memory unit 15, while recording the shot image in the memory card of the camera 20.

  In step S103, the memory unit 15 of the shake detection device 10 is inserted into the first input unit 42 of the image correction device 40, the memory card of the camera 20 is inserted into the second input unit 43, and the shake signal and the captured image are input.

  In step S104, it is determined whether all photographed images and shake signals have been input, and the input operation is repeated until all photographed images and shake signals are inputted.

  When all captured images and shake signals are input, the process proceeds to step S105, and image recovery is executed by image processing of the captured images based on the shake signals by the image correction unit 44. This image restoration uses a point image information (shake signal) spread by the shake detected by the shake detection device 10 to obtain a non-shake image from an image degraded by the shake (image taken by the camera 20) ( For example, refer to the image recovery processing disclosed in paragraph numbers 0008 to 00017 of JP-A No. 2004-205799).

  In step S106, it is determined whether or not the image restoration processing has been completed. If the image restoration processing has not been completed, the image restoration processing is continued. Is recorded (saved) in the memory 47. The corrected image can be read from the memory 47 and displayed on the display device 45 or printed out by the printer 46.

  When a camera 20 having a built-in camera shake correction function that performs optical shake correction is used as the camera 20, for example, image restoration processing is performed on an image that cannot be corrected by this camera shake correction function and still has camera shake. Apply. As this image restoration process, for example, there is an image restoration process having the contents disclosed in paragraph numbers 0090 to 0098 of JP-A-2004-205799.

  In the shake detection device 10 described above, unlike the image stabilization device that cancels the shake of the camera 20, the device does not need to be large and does not become bulky, heavy, or expensive. Further, it can be easily attached to the body of the camera 20 via the adapter 30. Furthermore, the shake detection unit 12 is located in the vicinity of the photographing lens 22 and does not interfere with the operation of the camera 20.

  In addition, since the shake of the camera 20 is detected in synchronization with the shooting signal, the shake signal can be detected for each shooting frame and can be recorded in the memory unit 15. For this reason, the image correction device 40 can perform image restoration processing of a captured image using a shake signal for each captured frame.

  Furthermore, even if the camera 20 has a built-in camera shake correction function, if the shake detection device 10 is mounted, the camera shake can be detected during shooting, and the camera shake correction function cannot be corrected after shooting, and camera shake remains. The image can be corrected by the recovery process by the image correction device 40.

  In the embodiment described above, the case where the shake detection device 10 is mounted on the camera 20 with the photographic lens 22 integrated has been described. However, it is needless to say that the camera can also be mounted on a single-lens reflex camera that can be replaced.

  In addition, although the case where the pressure sensor 11 is used as the photographing operation detection unit has been shown, the present invention is not limited to this, and for example, it is configured by a push button mechanism that can simultaneously perform shutter driving and output of a photographing signal to the shake detection device 10. May be.

  Moreover, although the case where the adapter 30 was used as an attachment part for attaching the shake detection part 12 to the camera 20 was shown, it is not limited to this, for example, using a hook-and-loop fastener or a pressure sensitive adhesive The shake detection unit 12 may be attached to a desired part of the camera 20.

  The image correction device 40 is not limited to the device shown in FIG. 5, and information can be input from a memory card that records a shake signal of the shake detection device 10 or a memory card that records an image of the camera 20. An ordinary personal computer or an image processing station may be used as long as it has a part that functions as the image correction unit 44 by installing the image recovery software.

It is a perspective view showing one embodiment of a shake detection device of the present invention. It is a perspective view explaining the state which mounts the shake detection apparatus of FIG. 1 on the adapter as an attachment part, and attaches it to a camera. It is a perspective view of the camera which attached the shake detection apparatus of FIG. It is a block diagram of the shake detection apparatus of FIG. It is a block diagram which shows one Embodiment of the image correction apparatus of this invention. 6 is a flowchart illustrating an operation of restoring and correcting an image by the image correction apparatus of FIG. 5.

Explanation of symbols

10 shake detection device 11 pressure sensor (photographing motion detector)
12 shake detection unit 13 gyro sensor 14 drive / signal detection circuit 15 memory unit 20 camera 30 adapter (mounting unit)
40 Image Correction Device 42 First Input Unit 43 Second Input Unit 44 Image Correction Unit

Claims (6)

A shooting operation detector that outputs a shooting signal corresponding to the shooting operation of the shooting device;
A shake detection unit comprising: a shake detection unit that detects a shake of the imaging apparatus and outputs a shake signal synchronized with the imaging signal. The shake detection apparatus according to claim 1,
A shake detection device comprising an attachment portion for attaching the shake detection unit to the photographing apparatus. In the shake detection device according to claim 1 or 2,
The shake detection device, wherein the shooting operation detection unit is attached to a shooting operation unit of the shooting device. The shake detection device according to any one of claims 1 to 3,
The shake detection device is characterized in that the shooting operation detection unit supplies the shooting signal to the shake detection unit by wired means or wireless means. The shake detection device according to any one of claims 1 to 4,
The shake detection device, wherein the shooting operation detection unit includes a pressure sensor that detects a shooting operation of the shooting device. A first input unit to which the shake signal supplied from the shake detection device according to any one of claims 1 to 5 is input;
A second input unit to which an image obtained by an imaging device to which the shake detection device is attached is supplied;
And an image correction unit that corrects the image based on the shake signal.

Images