JP2012054902A - Method of reducing image blur - Google Patents
Method of reducing image blur Download PDFInfo
- Publication number
- JP2012054902A JP2012054902A JP2010216058A JP2010216058A JP2012054902A JP 2012054902 A JP2012054902 A JP 2012054902A JP 2010216058 A JP2010216058 A JP 2010216058A JP 2010216058 A JP2010216058 A JP 2010216058A JP 2012054902 A JP2012054902 A JP 2012054902A
- Authority
- JP
- Japan
- Prior art keywords
- image
- camera shake
- image pickup
- imaging device
- shake correction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Studio Devices (AREA)
- Adjustment Of Camera Lenses (AREA)
Abstract
Description
この発明は、撮像装置を大きく動かしたときに生じる画像ブレを軽減する方法に関するものである。 The present invention relates to a method for reducing image blur that occurs when an imaging apparatus is moved greatly.
ビデオカメラなどの撮像装置を一方向にパンまたはチルトしながら撮影すると、再生画像はその動きと反対方向に動くように見える。そのとき、撮影した画面全体に画像ブレ(ブラー)が生じるため、それを見ている者に不快感が生じる。そのため、できる限り再生画像にブラーが発生しないように、撮像装置をパンするときは低速で行うのがカメラワークの基本手技とされてきた。そうする以外に、この問題を解決する有効な対策が無かったのである。 When an imaging device such as a video camera is photographed while panning or tilting in one direction, the reproduced image appears to move in the opposite direction. At that time, image blurring (blurring) occurs on the entire photographed screen, causing discomfort to those who are watching it. For this reason, it has been a basic technique of camera work to perform panning of the imaging device at a low speed so as not to blur the reproduced image as much as possible. Besides that, there was no effective measure to solve this problem.
手ブレ(撮像装置本体を手で持って撮影するとき、意図しない手の振動)によって発生するブラーは、手ブレの振幅が小さければ、従来の光学式手ブレ補正装置によって補正することができた。しかし、撮像装置が一方向に大きくパンまたはチルトする場合には、そうした装置によって画面に生じるブラーを軽減することは不可能であった。また、手ブレ補正装置がどんなに高性能であっても、それが撮像装置の動きを打ち消すことで撮像素子上の画像を静止させるという原理に基づく装置である以上、撮影者が撮像装置をパンあるいはチルトして外界を広範囲に撮影しようとする意図とは、常に相反する動作をする装置であると言え、手ブレ補正装置のみでは、意図的なパンニングまたはチルティングによって発生するブラーの抑制は、原理上からも不可能であった。 Blur caused by camera shake (unintentional hand vibration when shooting with the imaging device main body held by hand) could be corrected by a conventional optical camera shake correction device if the amplitude of camera shake was small. . However, when the imaging device pans or tilts greatly in one direction, it is impossible to reduce the blur generated on the screen by such a device. Also, no matter how high-performance the camera shake correction device is, it is a device based on the principle that the image on the image sensor is stopped by canceling the movement of the image pickup device. It can be said that the intention to tilt and shoot a wide range of the outside world is a device that always operates in a contradictory manner, and with the camera shake correction device alone, the suppression of blur caused by intentional panning or tilting is the principle. It was impossible from above.
本発明が解決しようとする課題は、撮像者が撮像装置を一方向に大きく動かして撮像すると、撮像した画像全体にブラーが生じてしまうことである。 The problem to be solved by the present invention is that blurring occurs in the entire captured image when the imager moves the imaging apparatus greatly in one direction to capture an image.
本発明の方法は、撮影者が撮像装置を、ある方向に大きく動かしながら外界を撮影しているとき、光学式手ブレ補正機能を持つ装置を撮像装置本体の動きを打ち消す方向に動かし(ここではこの区間を緩徐相と呼ぶ)、それが一定の点まで動いたら、所定の位置まで急速に戻す(ここではこの区間を急速相と呼ぶ)という二相の動作を頻回に繰り返すことを最も主要な特徴とする。 According to the method of the present invention, when the photographer is shooting the outside world while moving the image pickup device in a certain direction, the device having the optical image stabilization function is moved in the direction to cancel the movement of the image pickup device main body (here, The most important thing is to repeat the two-phase operation frequently, which is called the slow phase), and once it moves to a certain point, it quickly returns to the specified position (here, this zone is called the rapid phase). Features.
急速相の画像は、画像全体に高度にブラーが生じているので、それらを動画再生時に映像として表示されないように分離し、緩徐相のみのデータで動画を構成する。緩徐相の画像には、原理上、撮像装置の動きに起因するブラーは無いのであるから、必然的にブラーの無い動画が表示される。 Since the image in the rapid phase is highly blurred throughout the image, they are separated so as not to be displayed as a video during the reproduction of the moving image, and the moving image is composed of data of only the slow phase. Since a slow phase image has no blur due to the movement of the imaging device in principle, a moving image without a blur is inevitably displayed.
急速相の画像を表示しないようにするには実施例1のように、急速相で個体撮像素子の作動を一過性に休止させ、撮像そのものを行わないという方法が最も確実である。また、実施例2のように、個体撮像素子の出力信号から急速相の信号を分離して、緩徐相の出力のみを表示するという方法も選択可能である。 In order to prevent the rapid phase image from being displayed, the most reliable method is to temporarily stop the operation of the individual imaging element in the rapid phase and not to perform the imaging itself as in the first embodiment. Further, as in the second embodiment, a method of separating a rapid phase signal from an output signal of an individual image sensor and displaying only a slow phase output can be selected.
これらは、いずれも、既存技術で容易に実現可能な信号処理であって、本発明を実施するのに特別な技術開発は不要である。 These are signal processing that can be easily realized by existing technology, and no special technical development is required to implement the present invention.
光学式手ブレ補正の方法には、撮像素子を動かす方法(イメージセンサーシフト方式)、レンズ系を動かす方法(レンズシフト方式)、レンズと撮像素子を一体として動かす方式(レンズユニットスイング方式)などが実施されているが、本発明の方法は、いずれの光学式手ブレ補正法に対しても使用可能である。 Optical image stabilization methods include moving the image sensor (image sensor shift method), moving the lens system (lens shift method), and moving the lens and image sensor together (lens unit swing method). Although implemented, the method of the present invention can be used for any optical image stabilization method.
急速相の画像信号を除去したあとに生じる信号の空白区間は、直前または直後の緩徐相の画像信号を用いて埋めることで、原画像と急速相の画像信号を除去した画像との間で動画の再生時間に誤差が生じるのを補正することができる。 The blank section of the signal that occurs after the removal of the fast-phase image signal is filled with the immediately preceding or immediately following slow-phase image signal, so that the moving image is between the original image and the image from which the rapid-phase image signal has been removed. It is possible to correct the occurrence of an error in the reproduction time.
本発明の方法は、常に光学式手ブレ補正機能を持つ装置を作動させておけばよく、パンニング、チルティングに際して装置の作動を停止する必要はない。当然、撮像装置の揺れが手ブレか、それとも撮影者の意図的なパンニング、チルティングかを区別する必要はなく、そのための複雑な制御装置も不要である。 In the method of the present invention, it is only necessary to always operate an apparatus having an optical image stabilization function, and it is not necessary to stop the operation of the apparatus during panning and tilting. Of course, it is not necessary to distinguish whether the shaking of the imaging device is camera shake or the intentional panning or tilting of the photographer, and a complicated control device for that purpose is also unnecessary.
本発明の方法は、撮影時の撮像装置の大きな動きそれ自身を打ち消すものではないから、撮像装置の振幅の大きな上下動などの手ブレは、画面の揺れとして表示される。しかし、揺れる映像がブラーの無い画像で構成されているため、映像を見る者は、ブラーが多く発生している従来の映像の場合ほど不快感を感じない。 Since the method of the present invention does not cancel the large movement of the image pickup apparatus at the time of photographing, camera shake such as a large vertical movement of the image pickup apparatus is displayed as a shake of the screen. However, since the swaying image is composed of an image without blur, a person who views the image does not feel uncomfortable as in the case of a conventional image in which a lot of blur occurs.
本発明によって、再生画像から、手ブレのみならず、撮像装置をパンあるいはチルトするときに画像全体に生じるブラーが高精度で除去される。その結果、映像の各フレームの品位は、静止画とほぼ同等となる。このブラー除去の効果は、撮像装置の動く速度が、光学式手ブレ補正機能を持つ装置の性能限界を超えない限りは維持される。再生動画の任意のフレームを取り出して、高品位のスチル写真として利用することも可能である。 According to the present invention, not only camera shake but also blur generated in the entire image when panning or tilting the imaging apparatus is removed from the reproduced image with high accuracy. As a result, the quality of each frame of the video is almost equal to that of the still image. The effect of removing the blur is maintained as long as the moving speed of the imaging apparatus does not exceed the performance limit of the apparatus having the optical image stabilization function. It is also possible to take out an arbitrary frame of a reproduced moving image and use it as a high-quality still photo.
図1は、本発明の実施例1の構成を示すブロック図であって、1〜5は、図2と同様である。これらの装置・回路を電源回路と共に一つの躯体に組み込んで、ビデオカメラなどの撮像装置として用いる。本発明の主体は、光学式手ブレ補正機能を持つ装置の駆動方法および固体撮像素子の出力信号の処理方法にあり、それらの駆動制御を行う回路等は既存の技術の範囲内で作成しうるから、その詳細な説明は省略する。 FIG. 1 is a block diagram showing the configuration of the first embodiment of the present invention, where 1 to 5 are the same as FIG. These devices and circuits are incorporated in a single casing together with a power supply circuit and used as an imaging device such as a video camera. The subject of the present invention is a method for driving an apparatus having an optical camera shake correction function and a method for processing an output signal of a solid-state imaging device, and a circuit for controlling the drive can be created within the scope of existing technology. Therefore, detailed description thereof is omitted.
本発明の方法は、業務用、民生用を問わず、あらゆる撮像装置に適用することができ、撮像装置を大きく動かしながらでもブラーの無い鮮明な画像の撮影を可能にする。監視カメラでは、本体を高速で回転させて撮影しても高品位の画像が得られるので、一台で広範囲の監視が可能になる。ロボットビジョン(コンピュータビジョン)に応用すれば、ロボットが画像データを収集するのに撮像装置の動きを止める必要が無くなり、ロボットは稼働中、常に高品位の画像データを収集することができる。 The method of the present invention can be applied to any image pickup apparatus regardless of whether it is for business use or consumer use, and enables a clear image without blur to be taken even when the image pickup apparatus is moved greatly. With a surveillance camera, high-quality images can be obtained even if the main body is rotated at a high speed, so a wide range of surveillance can be performed with a single camera. When applied to robot vision (computer vision), it is not necessary for the robot to stop the movement of the imaging device in order to collect image data, and the robot can always collect high-quality image data during operation.
1 光学式手ブレ補正装置が組み込まれた撮像装置
2 信号の空白区間を埋める信号処理を行う回路
3 固体撮像素子の駆動信号生成装置
4 手ブレ補正装置の制御信号生成装置
5 撮像装置本体の動き(速度、方向、角速度など)を検知するセンサー
6 急速相の信号と緩徐相の信号を分離する回路DESCRIPTION OF SYMBOLS 1 Image pick-up device incorporating optical camera-shake correction device 2 Circuit for performing signal processing to fill in a blank section of
Claims (1)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010216058A JP2012054902A (en) | 2010-09-02 | 2010-09-02 | Method of reducing image blur |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010216058A JP2012054902A (en) | 2010-09-02 | 2010-09-02 | Method of reducing image blur |
Publications (1)
Publication Number | Publication Date |
---|---|
JP2012054902A true JP2012054902A (en) | 2012-03-15 |
Family
ID=45907739
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2010216058A Pending JP2012054902A (en) | 2010-09-02 | 2010-09-02 | Method of reducing image blur |
Country Status (1)
Country | Link |
---|---|
JP (1) | JP2012054902A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11398014B2 (en) * | 2018-09-14 | 2022-07-26 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method |
-
2010
- 2010-09-02 JP JP2010216058A patent/JP2012054902A/en active Pending
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11398014B2 (en) * | 2018-09-14 | 2022-07-26 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method |
US11972546B2 (en) | 2018-09-14 | 2024-04-30 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101528860B1 (en) | Method and apparatus for correcting a shakiness in digital photographing apparatus | |
JP6071545B2 (en) | IMAGING DEVICE, IMAGE PROCESSING DEVICE AND ITS CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM | |
JP6128389B2 (en) | Imaging device | |
JP6598537B2 (en) | Image processing apparatus, imaging apparatus, and image processing program | |
JP2016090973A (en) | Imaging device | |
JP2007116309A (en) | Image information reproduction apparatus | |
JP2005215388A (en) | Interchangeable lens and camera system using the same | |
JP6642971B2 (en) | Image blur correction device, optical device, imaging device, and control method | |
JP2009272890A (en) | Image processing apparatus and method, and imaging device | |
JP7324284B2 (en) | Imaging device, camera shake correction device, imaging method, and camera shake correction method | |
JP6767618B2 (en) | Imaging device | |
WO2017104102A1 (en) | Imaging device | |
JP2023076452A (en) | Blur detector, imaging device, lens device, imaging device body, method for detecting blur, blur detection program, and recording medium | |
JP2007201570A (en) | Image processor, photography apparatus, image processing method and control program | |
JP2012054902A (en) | Method of reducing image blur | |
JP2012163852A (en) | Shake correction device and optical apparatus | |
JP6711099B2 (en) | Imaging device | |
JP6278798B2 (en) | Imaging apparatus, control method thereof, and program | |
JP2019008143A (en) | Image blur correction device, image pickup device, image pickup system, control method, program, and storage medium | |
JP6188369B2 (en) | Imaging device | |
JP7214424B2 (en) | Imaging device and its control method | |
JP2012054911A (en) | Imaging apparatus | |
JP7210256B2 (en) | Imaging device and display control method | |
WO2024048069A1 (en) | Information processing device, information processing method, and program | |
JP2017194531A (en) | Vibration proof control device |