JP2012044377A5

JP2012044377A5 -

Info

Publication number: JP2012044377A5
Application number: JP2010182677A
Authority: JP
Filing date: 2010-08-18
Publication date: 2012-06-28
Anticipated expiration: 2030-08-18

Description

前記課題を解決するため請求項１記載の発明は、略同一の撮影画角で且つ露光条件が夫々異なる複数の画像を取得する画像取得手段と、前記複数の画像における他の露光条件の画像と露光条件が等しくなるように、前記画像取得手段によって取得された複数の画像のうち露光量が低い方の画像の明るさのゲインを上げるよう制御するゲイン制御手段と、このゲイン制御手段によってゲインが上げられた画像と、このゲインが上げられた画像と露光条件が等しい画像とを比較することにより、前記撮影画角における動体領域を検出する動体領域検出手段と、前記ゲインが上げられた画像と露光条件が等しい画像における前記動体領域検出手段によって検出された動体領域の画像を、前記ゲインが上げられた画像における同領域の画像に置換する置換手段と、前記動体領域検出手段によって検出された動体領域について、前記ゲインが上げられた画像と前記ゲインが上げられた画像と露光条件が等しい画像との画素毎の差分の最大値を取得する差分取得手段と、この差分取得手段によって取得された情報を透過強度の情報として前記置換手段による置換後の画像にブレンディングするブレンディング手段と、このブレンディング手段によってブレンディングされた画像と前記露光量の低い方の画像との画素加算合成画像を生成する生成手段と、を備えたことを特徴とする。 In order to solve the above-mentioned problem, the invention according to claim 1 is characterized in that image acquisition means for acquiring a plurality of images having substantially the same shooting angle of view and different exposure conditions, and images of other exposure conditions in the plurality of images, Gain control means for controlling to increase the gain of the brightness of the image with the lower exposure amount among the plurality of images acquired by the image acquisition means so that the exposure conditions are equal, and the gain by the gain control means A moving object region detecting means for detecting a moving object region at the shooting angle of view by comparing the raised image with an image having the same exposure condition as that of the image having the increased gain, and the image having the increased gain. Replace the moving object region image detected by the moving object region detection means in the image with the same exposure condition with the image in the same region in the image with the increased gain. For the moving object region detected by the replacing means and the moving object region detecting means, the maximum value of the difference for each pixel between the image with the increased gain, the image with the increased gain, and the image with the same exposure condition is acquired. Difference acquisition means, blending means for blending the information acquired by the difference acquisition means as transmission intensity information into the image after replacement by the replacement means, the image blended by the blending means, and the one having the lower exposure amount Generating means for generating a pixel-added composite image with the above image.

また、請求項６記載の発明は、略同一の撮影画角で且つ露光条件が夫々異なる複数の画像を取得する画像取得ステップと、前記複数の画像における他の露光条件の画像と露光条件が等しくなるように、前記画像取得ステップによって取得された複数の画像のうち露光量が低い方の画像の明るさのゲインを上げるよう制御するゲイン制御ステップと、このゲイン制御ステップによってゲインが上げられた画像と、このゲインが上げられた画像と露光条件が等しい画像とを比較することにより、前記撮影画角における動体領域を検出する動体領域検出ステップと、前記ゲインが上げられた画像と露光条件が等しい画像における前記動体領域検出ステップによって検出された動体領域の画像を、前記ゲインが上げられた画像における同領域の画像に置換する置換ステップと、前記動体領域検出ステップによって検出された動体領域について、前記ゲインが上げられた画像と前記ゲインが上げられた画像と露光条件が等しい画像との画素毎の差分の最大値を取得する差分取得ステップと、この差分取得ステップによって取得された情報を透過強度の情報として前記置換ステップによる置換後の画像にブレンディングするブレンディングステップと、このブレンディングステップによってブレンディングされた画像と前記露光量の低い方の画像との画素加算合成画像を生成する生成ステップと、を含むことを特徴とする。 According to a sixth aspect of the present invention, the image acquisition step of acquiring a plurality of images having substantially the same shooting angle of view and different exposure conditions, and the exposure conditions of the images of other exposure conditions in the plurality of images are equal. The gain control step for controlling to increase the gain of the brightness of the image having the lower exposure amount among the plurality of images acquired by the image acquisition step, and the image whose gain has been increased by the gain control step And a moving object region detecting step for detecting a moving object region at the shooting angle of view by comparing the image with the increased gain and the image with the same exposure condition, and the exposure condition is equal to the image with the increased gain. The image of the moving object area detected by the moving object area detecting step in the image is changed to the image of the same area in the image with the gain increased. For the moving object region detected by the replacing step and the moving object region detecting step, the maximum value of the difference for each pixel between the image with the increased gain, the image with the increased gain, and the image with the same exposure condition. A difference acquisition step to be acquired , a blending step for blending the information acquired in the difference acquisition step as transmission intensity information into the image after replacement in the replacement step, an image blended in the blending step, and the exposure amount And a generation step of generating a pixel-added composite image with the lower image.

また、請求項７記載の発明は、装置が有するコンピュータを、略同一の撮影画角で且つ露光条件が夫々異なる複数の画像を取得する画像取得手段、前記複数の画像における他の露光条件の画像と露光条件が等しくなるように、前記画像取得手段によって取得された複数の画像のうち露光量が低い方の画像の明るさのゲインを上げるよう制御するゲイン制御手段、このゲイン制御手段によってゲインが上げられた画像と、このゲインが上げられた画像と露光条件が等しい画像とを比較することにより、前記撮影画角における動体領域を検出する動体領域検出手段、前記ゲインが上げられた画像と露光条件が等しい画像における前記動体領域検出手段によって検出された動体領域の画像を、前記ゲインが上げられた画像における同領域の画像に置換する置換手段、前記動体領域検出手段によって検出された動体領域について、前記ゲインが上げられた画像と前記ゲインが上げられた画像と露光条件が等しい画像との画素毎の差分の最大値を取得する差分取得手段、この差分取得手段によって取得された情報を透過強度の情報として前記置換手段による置換後の画像にブレンディングするブレンディング手段、このブレンディング手段によってブレンディングされた画像と前記露光量の低い方の画像との画素加算合成画像を生成する生成手段、として機能させることを特徴とする。 According to a seventh aspect of the present invention, there is provided an image acquisition means for acquiring a plurality of images having substantially the same shooting angle of view and different exposure conditions, and images of other exposure conditions in the plurality of images. Gain control means for controlling the gain of the image with the lower exposure amount among the plurality of images acquired by the image acquisition means so that the exposure conditions are equal, and the gain control means controls the gain. A moving object region detecting means for detecting a moving object region at the shooting angle of view by comparing the raised image with an image having the same exposure condition as that of the image having the increased gain, and the image having the increased gain and the exposure An image of the moving object region detected by the moving object region detection unit in an image having the same condition is placed on the image of the same region in the image with the gain increased. For the moving body region detected by the moving body region detecting unit, the maximum value of the difference for each pixel between the image with the increased gain, the image with the increased gain, and the image with the same exposure condition is acquired. Difference acquisition means, blending means for blending the information acquired by the difference acquisition means as transmission intensity information into the image after replacement by the replacement means, the image blended by the blending means and the image with the lower exposure amount And generating means for generating a pixel-added synthesized image.

したがって、このステップＳ１０２及びステップＳ１０３での処理により、図４（ａ）に示すＹＵＶ画像からなる露出アンダー画像Ｕと、同図（ｂ）に示すＹＵＶ画像からなる露出オーバー画像ＯとがＲＡＭ８に保存される。連写された露出アンダー画像Ｕと露出オーバー画像Ｏとは、撮像画角全体を示す背景Ｂ内において動体としての手Ｈを上下に振っている状態で、略同じ撮像画角で連写したものである。両画像Ｕ、Ｏにおいて、背景Ｂは同一であるが、時間ｔが進むに従って手Ｈの像は背景Ｂ内において相対的に下方に変位し、露出オーバー画像Ｏの手Ｈの像は、露出アンダー画像Ｕの手Ｈの像よりも下に位置する。 Therefore, by the processing in step S102 and step S103, the underexposed image U made up of the YUV image shown in FIG. 4A and the overexposed image O made up of the YUV image shown in FIG. 4B are stored in the RAM 8. Is done . The continuously exposed underexposed image U and overexposed image O are obtained by continuously shooting at substantially the same imaging angle of view while shaking the hand H as a moving object up and down in the background B showing the entire imaging angle of view. It is. In both images U and O, the background B is the same, but as the time t advances, the image of the hand H is displaced relatively downward in the background B, and the image of the hand H of the overexposed image O is underexposed. It is located below the image of the hand H of the image U.

引き続き、下記式［７］で示すように、強調処理を行って前記動体判定マップＭのコントラストをアップさせる（ステップＳ２０５）。
Map_Move = fEmphasis (Diff_Lpf) ・・・式［７］
このステップＳ２０５での平滑化処理により、図５（ｂ）に示すように、動体判定マップＭにおいて動体である手Ｈの像の領域におけるコントラストがアップされる。 Subsequently, as shown by the following equation [7], enhancement processing is performed to increase the contrast of the moving object determination map M (step S205 ).
Map_Move = fEmphasis (Diff_Lpf) (7)
By the smoothing process in step S205, as shown in FIG. 5B, the contrast in the region of the image of the hand H that is a moving object in the moving object determination map M is increased.

以上のようにして、合成画像ＰＭを表すＹＵＶ画像データを生成したならば、完成画像である合成画像ＰＭのＹＵＶ画像データを、ＪＰＥＧ方式で符号化しファイル化して、画像記録部６に記録保存し（ステップＳ１０８）、処理を終了する。 When the YUV image data representing the composite image PM is generated as described above, the YUV image data of the composite image PM that is the completed image is encoded and filed by the JPEG method, and is recorded and stored in the image recording unit 6. (Step S108 ), the process is terminated.

Claims

Image acquisition means for acquiring a plurality of images having substantially the same shooting angle of view and different exposure conditions;
Control is performed to increase the brightness gain of the image with the lower exposure amount among the plurality of images acquired by the image acquisition unit so that the exposure condition is equal to the image of the other exposure conditions in the plurality of images. Gain control means;
A moving object region detecting means for detecting a moving object region at the shooting angle of view by comparing an image whose gain has been increased by the gain control unit with an image having the same exposure condition as that of the image having the increased gain;
Replacement means for replacing the image of the moving object region detected by the moving object region detection means in the image having the same exposure condition as that of the image with the increased gain with an image of the same area in the image with the increased gain;
Difference acquisition means for acquiring a maximum value of a difference for each pixel between the image with the increased gain, the image with the increased gain, and an image with the same exposure condition for the moving object region detected by the moving object region detection means; ,
Blending means for blending the information acquired by the difference acquiring means as transmission intensity information on the image after replacement by the replacing means;
Generating means for generating a pixel addition composite image of the image blended by the blending means and the image having the lower exposure amount;
An image composition device comprising:

An image acquisition step of acquiring a plurality of images having substantially the same shooting angle of view and different exposure conditions;
Control is performed to increase the brightness gain of the image with the lower exposure amount among the plurality of images acquired by the image acquisition step so that the exposure condition is equal to the image of the other exposure conditions in the plurality of images. A gain control step;
A moving object region detecting step for detecting a moving object region at the shooting angle of view by comparing an image whose gain has been increased by the gain control step with an image having the same exposure condition as that of the image having the increased gain;
A replacement step of replacing an image of the moving object region detected by the moving object region detection step in an image having the same exposure condition as that of the image having the increased gain with an image of the same region in the image having the increased gain;
A difference obtaining step for obtaining a maximum value of a difference for each pixel between the image with the increased gain, the image with the increased gain, and an image with the same exposure condition for the moving object region detected by the moving object region detecting step; ,
A blending step for blending the information acquired in the difference acquisition step as transmission intensity information into the image after replacement in the replacement step;
A generation step of generating a pixel addition composite image of the image blended by the blending step and the image with the lower exposure amount;
An image composition method comprising:

The computer that the device has
Image acquisition means for acquiring a plurality of images having substantially the same shooting angle of view and different exposure conditions;
Control is performed to increase the brightness gain of the image with the lower exposure amount among the plurality of images acquired by the image acquisition unit so that the exposure condition is equal to the image of the other exposure conditions in the plurality of images. Gain control means,
A moving object region detecting means for detecting a moving object region at the shooting angle of view by comparing an image whose gain has been increased by the gain control unit with an image having the same exposure condition as that of the image having the increased gain;
Replacement means for replacing the image of the moving object region detected by the moving object region detection means in the image with the same exposure condition as that of the image with the increased gain, with the image of the same area in the image with the increased gain;
A difference acquisition unit that acquires a maximum value of a difference for each pixel between the image with the increased gain and the image with the increased gain and an image having the same exposure condition for the moving region detected by the moving region detection unit;
Blending means for blending the information acquired by the difference acquisition means as transmission intensity information on the image after replacement by the replacement means;
Generating means for generating a pixel-added synthesized image of the image blended by the blending means and the image with the lower exposure amount;
A program characterized by functioning as