JP2011193117A5

JP2011193117A5 -

Info

Publication number: JP2011193117A5
Application number: JP2010056096A
Authority: JP
Filing date: 2010-03-12
Publication date: 2013-04-18
Anticipated expiration: 2030-03-12

Description

上記課題を解決するため、本発明の画像処理装置は、
第１のフレームレートの第１の動画と、主要被写体像領域を含む、前記第1のフレームレートより低い第２のフレームレートの第２の動画とを合成することによって、合成動画を生成する画像処理装置において、
前記第１の動画の再生速度に合わせて、前記第２の動画に含まれる各フレームの画像データから前記主要被写体像領域を含む挿入フレームを生成する挿入フレーム生成手段と、
前記第２の動画の動画データに、前記挿入フレーム生成手段により生成された挿入フレームを挿入して、前記第１の動画の動画データとフレーム単位で順次合成することによって、前記合成動画を生成する合成手段と、
を備え、
前記合成手段は、前記挿入フレーム生成手段によって生成された各挿入フレームを、前記第２の動画のフレーム間における前記主要被写体像領域の移動を補間するように前記第１の動画の各フレームに挿入して、合成することを特徴とする。 In order to solve the above problems, an image processing apparatus according to the present invention provides:
By combining the first moving image of the first frame rate, including the main subject image region, and a second video of the lower than the first frame rate second frame rate, image to generate a composite video In the processing device,
An insertion frame generating means for generating an insertion frame including the main subject image area from image data of each frame included in the second moving image in accordance with the reproduction speed of the first moving image;
Inserting the insertion frame generated by the insertion frame generation unit into the moving image data of the second moving image, and sequentially combining the moving image data of the first moving image with the first moving image data to generate the combined moving image Combining means ;
With
The synthesizing unit inserts each inserted frame generated by the inserted frame generating unit into each frame of the first moving image so as to interpolate the movement of the main subject image area between the frames of the second moving image. And synthesizing .

また、本発明のプログラムは、
第１のフレームレートの第１の動画と、主要被写体像領域を含む、前記第1のフレームレートより低い第２のフレームレートの第２の動画とを合成することによって、合成動画を生成する画像処理装置を制御するコンピュータに、
前記第１の動画の再生速度に合わせて、前記第２の動画に含まれる各フレームの画像データから前記主要被写体像領域を含む挿入フレームを生成する挿入フレーム生成機能と、
前記第２の動画の動画データに、前記挿入フレーム生成機能により生成された挿入フレームを挿入して、前記第１の動画の動画データとフレーム単位で順次合成することによって、前記合成動画を生成する合成機能であって、
前記挿入フレーム生成機能によって生成された各挿入フレームを、前記第２の動画のフレーム間における前記主要被写体像領域の移動を補間するように前記第１の動画の各フレームに挿入して、合成する合成機能と、
を実現させることを特徴とする。 The program of the present invention is
By combining the first moving image of the first frame rate, including the main subject image region, and a second video of the lower than the first frame rate second frame rate, image to generate a composite video To the computer that controls the processing device,
An insertion frame generation function for generating an insertion frame including the main subject image area from image data of each frame included in the second video according to the playback speed of the first video;
Inserting the insertion frame generated by the insertion frame generation function into the moving image data of the second moving image, and sequentially combining the first moving image data and the moving image data of the first moving image to generate the combined moving image A compositing function,
Each insertion frame generated by the insertion frame generation function is inserted into each frame of the first moving image so as to interpolate the movement of the main subject image area between the frames of the second moving image, and is synthesized. Composition function ,
It is characterized by realizing.

Claims

By combining the first moving image of the first frame rate, including the main subject image region, and a second video of the lower than the first frame rate second frame rate, image to generate a composite video In the processing device,
An insertion frame generating means for generating an insertion frame including the main subject image area from image data of each frame included in the second moving image in accordance with the reproduction speed of the first moving image;
Inserting the insertion frame generated by the insertion frame generation unit into the moving image data of the second moving image, and sequentially combining the moving image data of the first moving image with the first moving image data to generate the combined moving image Combining means ;
With
The synthesizing unit inserts each inserted frame generated by the inserted frame generating unit into each frame of the first moving image so as to interpolate the movement of the main subject image area between the frames of the second moving image. And is characterized by synthesis,
Image processing device.

Determining means for determining whether or not the second moving image having the second frame rate is suitable for interpolation synthesis;
The insertion frame generation unit generates an insertion frame so as to interpolate movement of the subject region based on a difference between the frames when the determination unit determines that it is suitable for interpolation synthesis.
The image processing apparatus according to claim 1.

The determining means determines that the main subject image area between each frame in the second moving image is suitable for interpolation synthesis when the moving amount of the main subject image area is a predetermined amount or more.
The image processing apparatus according to claim 2.

The determining means determines that the moving direction of the main subject image region between each frame in the second moving image is substantially constant when the moving direction of the main subject image region is substantially constant;
The image processing apparatus according to claim 2.

The determining means determines that the main subject image region overlap amount between each frame in the second moving image is suitable for interpolation synthesis when the amount of overlap is a predetermined amount or less.
The image processing apparatus according to claim 2.

The determination means determines that the main subject image area between each frame in the second moving image is suitable for interpolation synthesis when the size of the main subject image area changes by a predetermined amount or more.
The image processing apparatus according to claim 2.

The insertion frame generation means generates the insertion frame so as to have a main subject image region located in the middle of each position of the main subject image region in the front and rear frames.
The image processing apparatus according to any one of claims 1 to 5.

The insertion frame generating means generates the insertion frame so as to have a main subject image area having a size intermediate between the sizes of the main subject image areas in the front and rear frames;
The image processing apparatus according to claim 6.

Determining means for determining whether image data of the second moving image having the second frame rate is suitable for interpolation synthesis;
The insertion frame generation unit generates an insertion frame by duplicating each frame when the determination unit determines that the frame is not suitable for interpolation and synthesis.
The image processing apparatus according to claim 2.

By combining the first moving image of the first frame rate, including the main subject image region, and a second video of the lower than the first frame rate second frame rate, image to generate a composite video To the computer that controls the processing device,
An insertion frame generation function for generating an insertion frame including the main subject image area from image data of each frame included in the second video according to the playback speed of the first video;
Inserting the insertion frame generated by the insertion frame generation function into the moving image data of the second moving image, and sequentially combining the first moving image data and the moving image data of the first moving image to generate the combined moving image A compositing function,
Each insertion frame generated by the insertion frame generation function is inserted into each frame of the first moving image so as to interpolate the movement of the main subject image area between the frames of the second moving image, and is synthesized. Composition function ,
A program to realize