JP2012054902A - Method of reducing image blur - Google Patents

Method of reducing image blur Download PDF

Info

Publication number
JP2012054902A
JP2012054902A JP2010216058A JP2010216058A JP2012054902A JP 2012054902 A JP2012054902 A JP 2012054902A JP 2010216058 A JP2010216058 A JP 2010216058A JP 2010216058 A JP2010216058 A JP 2010216058A JP 2012054902 A JP2012054902 A JP 2012054902A
Authority
JP
Japan
Prior art keywords
image
camera shake
image pickup
imaging device
shake correction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2010216058A
Other languages
Japanese (ja)
Inventor
Kazumoto Suzuki
一元 鈴木
Akira Suzuki
明 鈴木
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to JP2010216058A priority Critical patent/JP2012054902A/en
Publication of JP2012054902A publication Critical patent/JP2012054902A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Studio Devices (AREA)
  • Adjustment Of Camera Lenses (AREA)

Abstract

PROBLEM TO BE SOLVED: To provide a method of reducing blur generated in the whole photographed image when photographing is performed while panning or tilting an imaging device in one direction.SOLUTION: When an imaging device is panned or tilted in one direction, an optical camera shake correction device operates so as to cancel the motion of a photographing device. A program is described so that, when the operation of the optical camera shake correction device becomes a certain amount, a position is made go back rapidly to the vicinity of the initial position in an opposite direction to restart a cancel operation. The optical camera shake correction device repeats this operation to intermittently produce a state equivalent to a state that the photographing is performed while holding the imaging device still. By putting only images photographed at that time together, blur generation caused by panning, tilting and camera shakes can be alleviated.

Description

この発明は、撮像装置を大きく動かしたときに生じる画像ブレを軽減する方法に関するものである。  The present invention relates to a method for reducing image blur that occurs when an imaging apparatus is moved greatly.

ビデオカメラなどの撮像装置を一方向にパンまたはチルトしながら撮影すると、再生画像はその動きと反対方向に動くように見える。そのとき、撮影した画面全体に画像ブレ(ブラー)が生じるため、それを見ている者に不快感が生じる。そのため、できる限り再生画像にブラーが発生しないように、撮像装置をパンするときは低速で行うのがカメラワークの基本手技とされてきた。そうする以外に、この問題を解決する有効な対策が無かったのである。  When an imaging device such as a video camera is photographed while panning or tilting in one direction, the reproduced image appears to move in the opposite direction. At that time, image blurring (blurring) occurs on the entire photographed screen, causing discomfort to those who are watching it. For this reason, it has been a basic technique of camera work to perform panning of the imaging device at a low speed so as not to blur the reproduced image as much as possible. Besides that, there was no effective measure to solve this problem.

手ブレ(撮像装置本体を手で持って撮影するとき、意図しない手の振動)によって発生するブラーは、手ブレの振幅が小さければ、従来の光学式手ブレ補正装置によって補正することができた。しかし、撮像装置が一方向に大きくパンまたはチルトする場合には、そうした装置によって画面に生じるブラーを軽減することは不可能であった。また、手ブレ補正装置がどんなに高性能であっても、それが撮像装置の動きを打ち消すことで撮像素子上の画像を静止させるという原理に基づく装置である以上、撮影者が撮像装置をパンあるいはチルトして外界を広範囲に撮影しようとする意図とは、常に相反する動作をする装置であると言え、手ブレ補正装置のみでは、意図的なパンニングまたはチルティングによって発生するブラーの抑制は、原理上からも不可能であった。  Blur caused by camera shake (unintentional hand vibration when shooting with the imaging device main body held by hand) could be corrected by a conventional optical camera shake correction device if the amplitude of camera shake was small. . However, when the imaging device pans or tilts greatly in one direction, it is impossible to reduce the blur generated on the screen by such a device. Also, no matter how high-performance the camera shake correction device is, it is a device based on the principle that the image on the image sensor is stopped by canceling the movement of the image pickup device. It can be said that the intention to tilt and shoot a wide range of the outside world is a device that always operates in a contradictory manner, and with the camera shake correction device alone, the suppression of blur caused by intentional panning or tilting is the principle. It was impossible from above.

特開2010−147857号広報JP2010-147857 特開2009−152802号広報Japanese Unexamined Patent Publication No. 2009-152802 特開平05−066448号広報JP 05-066448 特開平09−80539号広報Japanese Laid-Open Patent Application No. 09-80539

本発明が解決しようとする課題は、撮像者が撮像装置を一方向に大きく動かして撮像すると、撮像した画像全体にブラーが生じてしまうことである。  The problem to be solved by the present invention is that blurring occurs in the entire captured image when the imager moves the imaging apparatus greatly in one direction to capture an image.

本発明の方法は、撮影者が撮像装置を、ある方向に大きく動かしながら外界を撮影しているとき、光学式手ブレ補正機能を持つ装置を撮像装置本体の動きを打ち消す方向に動かし(ここではこの区間を緩徐相と呼ぶ)、それが一定の点まで動いたら、所定の位置まで急速に戻す(ここではこの区間を急速相と呼ぶ)という二相の動作を頻回に繰り返すことを最も主要な特徴とする。  According to the method of the present invention, when the photographer is shooting the outside world while moving the image pickup device in a certain direction, the device having the optical image stabilization function is moved in the direction to cancel the movement of the image pickup device main body (here, The most important thing is to repeat the two-phase operation frequently, which is called the slow phase), and once it moves to a certain point, it quickly returns to the specified position (here, this zone is called the rapid phase). Features.

急速相の画像は、画像全体に高度にブラーが生じているので、それらを動画再生時に映像として表示されないように分離し、緩徐相のみのデータで動画を構成する。緩徐相の画像には、原理上、撮像装置の動きに起因するブラーは無いのであるから、必然的にブラーの無い動画が表示される。  Since the image in the rapid phase is highly blurred throughout the image, they are separated so as not to be displayed as a video during the reproduction of the moving image, and the moving image is composed of data of only the slow phase. Since a slow phase image has no blur due to the movement of the imaging device in principle, a moving image without a blur is inevitably displayed.

急速相の画像を表示しないようにするには実施例1のように、急速相で個体撮像素子の作動を一過性に休止させ、撮像そのものを行わないという方法が最も確実である。また、実施例2のように、個体撮像素子の出力信号から急速相の信号を分離して、緩徐相の出力のみを表示するという方法も選択可能である。  In order to prevent the rapid phase image from being displayed, the most reliable method is to temporarily stop the operation of the individual imaging element in the rapid phase and not to perform the imaging itself as in the first embodiment. Further, as in the second embodiment, a method of separating a rapid phase signal from an output signal of an individual image sensor and displaying only a slow phase output can be selected.

これらは、いずれも、既存技術で容易に実現可能な信号処理であって、本発明を実施するのに特別な技術開発は不要である。  These are signal processing that can be easily realized by existing technology, and no special technical development is required to implement the present invention.

光学式手ブレ補正の方法には、撮像素子を動かす方法(イメージセンサーシフト方式)、レンズ系を動かす方法(レンズシフト方式)、レンズと撮像素子を一体として動かす方式(レンズユニットスイング方式)などが実施されているが、本発明の方法は、いずれの光学式手ブレ補正法に対しても使用可能である。  Optical image stabilization methods include moving the image sensor (image sensor shift method), moving the lens system (lens shift method), and moving the lens and image sensor together (lens unit swing method). Although implemented, the method of the present invention can be used for any optical image stabilization method.

急速相の画像信号を除去したあとに生じる信号の空白区間は、直前または直後の緩徐相の画像信号を用いて埋めることで、原画像と急速相の画像信号を除去した画像との間で動画の再生時間に誤差が生じるのを補正することができる。  The blank section of the signal that occurs after the removal of the fast-phase image signal is filled with the immediately preceding or immediately following slow-phase image signal, so that the moving image is between the original image and the image from which the rapid-phase image signal has been removed. It is possible to correct the occurrence of an error in the reproduction time.

本発明の方法は、常に光学式手ブレ補正機能を持つ装置を作動させておけばよく、パンニング、チルティングに際して装置の作動を停止する必要はない。当然、撮像装置の揺れが手ブレか、それとも撮影者の意図的なパンニング、チルティングかを区別する必要はなく、そのための複雑な制御装置も不要である。  In the method of the present invention, it is only necessary to always operate an apparatus having an optical image stabilization function, and it is not necessary to stop the operation of the apparatus during panning and tilting. Of course, it is not necessary to distinguish whether the shaking of the imaging device is camera shake or the intentional panning or tilting of the photographer, and a complicated control device for that purpose is also unnecessary.

本発明の方法は、撮影時の撮像装置の大きな動きそれ自身を打ち消すものではないから、撮像装置の振幅の大きな上下動などの手ブレは、画面の揺れとして表示される。しかし、揺れる映像がブラーの無い画像で構成されているため、映像を見る者は、ブラーが多く発生している従来の映像の場合ほど不快感を感じない。  Since the method of the present invention does not cancel the large movement of the image pickup apparatus at the time of photographing, camera shake such as a large vertical movement of the image pickup apparatus is displayed as a shake of the screen. However, since the swaying image is composed of an image without blur, a person who views the image does not feel uncomfortable as in the case of a conventional image in which a lot of blur occurs.

本発明によって、再生画像から、手ブレのみならず、撮像装置をパンあるいはチルトするときに画像全体に生じるブラーが高精度で除去される。その結果、映像の各フレームの品位は、静止画とほぼ同等となる。このブラー除去の効果は、撮像装置の動く速度が、光学式手ブレ補正機能を持つ装置の性能限界を超えない限りは維持される。再生動画の任意のフレームを取り出して、高品位のスチル写真として利用することも可能である。  According to the present invention, not only camera shake but also blur generated in the entire image when panning or tilting the imaging apparatus is removed from the reproduced image with high accuracy. As a result, the quality of each frame of the video is almost equal to that of the still image. The effect of removing the blur is maintained as long as the moving speed of the imaging apparatus does not exceed the performance limit of the apparatus having the optical image stabilization function. It is also possible to take out an arbitrary frame of a reproduced moving image and use it as a high-quality still photo.

本発明の実施例1の装置の基本構成を示すブロック図である。It is a block diagram which shows the basic composition of the apparatus of Example 1 of this invention. 本発明の実施例2の装置の基本構成を示すブロック図である。It is a block diagram which shows the basic composition of the apparatus of Example 2 of this invention.

図1は、本発明の実施例1の構成を示すブロック図であって、1〜5は、図2と同様である。これらの装置・回路を電源回路と共に一つの躯体に組み込んで、ビデオカメラなどの撮像装置として用いる。本発明の主体は、光学式手ブレ補正機能を持つ装置の駆動方法および固体撮像素子の出力信号の処理方法にあり、それらの駆動制御を行う回路等は既存の技術の範囲内で作成しうるから、その詳細な説明は省略する。  FIG. 1 is a block diagram showing the configuration of the first embodiment of the present invention, where 1 to 5 are the same as FIG. These devices and circuits are incorporated in a single casing together with a power supply circuit and used as an imaging device such as a video camera. The subject of the present invention is a method for driving an apparatus having an optical camera shake correction function and a method for processing an output signal of a solid-state imaging device, and a circuit for controlling the drive can be created within the scope of existing technology. Therefore, detailed description thereof is omitted.

本発明の方法は、業務用、民生用を問わず、あらゆる撮像装置に適用することができ、撮像装置を大きく動かしながらでもブラーの無い鮮明な画像の撮影を可能にする。監視カメラでは、本体を高速で回転させて撮影しても高品位の画像が得られるので、一台で広範囲の監視が可能になる。ロボットビジョン(コンピュータビジョン)に応用すれば、ロボットが画像データを収集するのに撮像装置の動きを止める必要が無くなり、ロボットは稼働中、常に高品位の画像データを収集することができる。  The method of the present invention can be applied to any image pickup apparatus regardless of whether it is for business use or consumer use, and enables a clear image without blur to be taken even when the image pickup apparatus is moved greatly. With a surveillance camera, high-quality images can be obtained even if the main body is rotated at a high speed, so a wide range of surveillance can be performed with a single camera. When applied to robot vision (computer vision), it is not necessary for the robot to stop the movement of the imaging device in order to collect image data, and the robot can always collect high-quality image data during operation.

1 光学式手ブレ補正装置が組み込まれた撮像装置
2 信号の空白区間を埋める信号処理を行う回路
3 固体撮像素子の駆動信号生成装置
4 手ブレ補正装置の制御信号生成装置
5 撮像装置本体の動き(速度、方向、角速度など)を検知するセンサー
6 急速相の信号と緩徐相の信号を分離する回路
DESCRIPTION OF SYMBOLS 1 Image pick-up device incorporating optical camera-shake correction device 2 Circuit for performing signal processing to fill in a blank section of signal 3 Drive signal generation device for solid-state image sensor 4 Control signal generation device for camera shake correction device 5 Sensor that detects (speed, direction, angular velocity, etc.) 6 A circuit that separates the fast-phase and slow-phase signals

Claims (1)

撮影者が撮像装置を一方向へ大きく動かしながら外界を撮影している間、光学式手ブレ補正機能を持つ装置を撮像装置の動きを打ち消すように動作させ、その動作量がある大きさになったなら所定の位置まで急速に戻し、その後、ただちに撮像装置の動きの打ち消し動作を再開させるという制御を繰り返し行うことで、撮像装置が静止状態で作動しているのと同等の状態を間欠的に作り出し、その間に撮影した鮮明な画像のみを連結した動画を作成することで、撮像装置の動きに起因するブラーを除去することを特徴とする撮像方法。While the photographer moves the image pickup device in one direction and shoots the outside world, the device with the optical image stabilization function is operated so as to cancel the movement of the image pickup device. If the image pickup device returns to a predetermined position rapidly and then immediately repeats the control of canceling the motion canceling operation of the image pickup device, the state equivalent to the operation of the image pickup device is stopped intermittently. An imaging method characterized by removing a blur caused by the movement of an imaging device by creating a moving image in which only clear images taken during the creation are connected.
JP2010216058A 2010-09-02 2010-09-02 Method of reducing image blur Pending JP2012054902A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2010216058A JP2012054902A (en) 2010-09-02 2010-09-02 Method of reducing image blur

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2010216058A JP2012054902A (en) 2010-09-02 2010-09-02 Method of reducing image blur

Publications (1)

Publication Number Publication Date
JP2012054902A true JP2012054902A (en) 2012-03-15

Family

ID=45907739

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2010216058A Pending JP2012054902A (en) 2010-09-02 2010-09-02 Method of reducing image blur

Country Status (1)

Country Link
JP (1) JP2012054902A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11398014B2 (en) * 2018-09-14 2022-07-26 Canon Kabushiki Kaisha Image processing apparatus and image processing method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11398014B2 (en) * 2018-09-14 2022-07-26 Canon Kabushiki Kaisha Image processing apparatus and image processing method
US11972546B2 (en) 2018-09-14 2024-04-30 Canon Kabushiki Kaisha Image processing apparatus and image processing method

Similar Documents

Publication Publication Date Title
KR101528860B1 (en) Method and apparatus for correcting a shakiness in digital photographing apparatus
JP6071545B2 (en) IMAGING DEVICE, IMAGE PROCESSING DEVICE AND ITS CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM
JP6128389B2 (en) Imaging device
JP6598537B2 (en) Image processing apparatus, imaging apparatus, and image processing program
JP2016090973A (en) Imaging device
JP2007116309A (en) Image information reproduction apparatus
JP2005215388A (en) Interchangeable lens and camera system using the same
JP6642971B2 (en) Image blur correction device, optical device, imaging device, and control method
JP2009272890A (en) Image processing apparatus and method, and imaging device
JP7324284B2 (en) Imaging device, camera shake correction device, imaging method, and camera shake correction method
JP6767618B2 (en) Imaging device
WO2017104102A1 (en) Imaging device
JP2023076452A (en) Blur detector, imaging device, lens device, imaging device body, method for detecting blur, blur detection program, and recording medium
JP2007201570A (en) Image processor, photography apparatus, image processing method and control program
JP2012054902A (en) Method of reducing image blur
JP2012163852A (en) Shake correction device and optical apparatus
JP6711099B2 (en) Imaging device
JP6278798B2 (en) Imaging apparatus, control method thereof, and program
JP2019008143A (en) Image blur correction device, image pickup device, image pickup system, control method, program, and storage medium
JP6188369B2 (en) Imaging device
JP7214424B2 (en) Imaging device and its control method
JP2012054911A (en) Imaging apparatus
JP7210256B2 (en) Imaging device and display control method
WO2024048069A1 (en) Information processing device, information processing method, and program
JP2017194531A (en) Vibration proof control device