JP2001326855A - Large screen video generator - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in a conventional large screen video generator that cannot have produced a natural video for a moving object on a large screen even when obtained videos are joined because one object is photographed while moving a camera resulting in photographing part of one object at different times in the case of generating the video for a large screen size. SOLUTION: The large-screen video generator is provided with a camera 1 that photographs an object while moving, a video storage means 2 that stores videos photographed by the camera 1, a means 3 that measures a moving quantity at each time of the camera 1, and a time space pixel edit means 4 that rearranges configuration pixels of the photographed image by the camera 1 stored in the video storage means 2 in a time space according to the movement quantity at each time of the camera measured by the measurement means 3, reads the various configuration pixels that are rearranged in an oblique direction in the time space, and interpolates missing pixels with the adjacent configuration pixels to generate the missing pixels thereby generating a video for a large screen.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a large screen image for creating a high-definition background image, which is a material for obtaining a more natural synthesized image even when a moving object is included in the background. The present invention relates to a creating device.

[0002]

2. Description of the Related Art In the production of television programs, it is common practice to extract only a person region from a person image taken in a studio and combine it with a background image taken separately. At that time, in order to obtain a composite image without a sense of incongruity, the camera work of the studio image and the background image needs to be the same. This is rather cumbersome. However, if there is a larger screen (wide field of view) and a higher definition background video, the difference between the two camera works can be absorbed. In other words, if there is a large-screen background video, a natural composite video can be obtained by cutting out a part of the video area from the large-screen background video according to the camera work of the studio and combining it with the studio video. .

Conventionally, there is the following method for creating a large-screen background image for such a purpose. We describe them and describe their disadvantages. (1) Method Using Wide-Angle Lens An image with a wide field of view can be obtained by photographing a subject using a lens having a wide angle of view. However, in order to obtain a composite video, if a part of the captured video is cut out, the definition naturally becomes coarse. (2) Method of Using High-Definition Imaging System When a high-definition television camera or a movie camera is used, the definition increases according to the system. However, a higher definition than specified by the system cannot be obtained.

(3) Method of Using a Plurality of Cameras This is a method of preparing a plurality of cameras having different photographing directions, and accurately aligning and joining photographed images to obtain a large-screen image. However, in this method, it is necessary to accurately correct and adjust the characteristics of the camera and the installation position of the camera so that the joint of the captured images does not become unnatural. (4) Method of shooting while moving the camera In addition, in the case of a still image, even if one camera is shot while moving, and the shot images are accurately aligned and connected,
A large screen image can be obtained as in the method (3). This method is often used. However, also in this method, various precautions need to be taken so as not to make the joints of the captured images unnatural.

[0005]

Among the conventional methods for obtaining a large-screen image described in the above (1) to (4), those which have no problem in terms of the definition of the image are (3) and (4). However, in these methods, there are very difficult problems such as a large scale of the system and a need for accurate alignment of the captured images.

In particular, in the case of the above method (4), it cannot be applied to photographing a moving subject. The reason is that photographing one subject while moving the camera means that one subject is photographed at different times for each part, and when a moving object such as a tree or a wave is photographed by this method, This is because connecting the obtained images does not result in a natural image of a moving object on a large screen.

SUMMARY OF THE INVENTION An object of the present invention is to photograph a subject while moving a camera, and to create a natural large-screen image showing a moving subject even when the subject is moving. .

[0008]

In order to achieve the above-mentioned object, a large-screen image producing apparatus according to the present invention handles image data obtained by photographing a subject while moving a camera in a unit of a screen as in the prior art. Instead, the pixels are handled in pixel units, the pixels are arranged in space and time, and the missing pixel data is supplemented by editing or interpolation processing to obtain a natural and high-definition large-screen image.

That is, the present invention provides a large-screen image producing apparatus,
A camera that captures an image of a subject while moving, a video storage unit that stores video captured by the camera, a unit that measures the amount of movement of the camera at each time, and a camera that is stored in the video storage unit. The constituent pixels of the shooting screen are rearranged and rearranged in space and time in accordance with the amount of movement of the camera at each time measured by the measuring means, and the rearranged constituent pixels are obliquely positioned in space and time. It is characterized in that it comprises a spatio-temporal pixel editing means for creating a large screen image by reading out and missing pixels by interpolating with adjacent constituent pixels.

[0010]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described in detail below based on embodiments of the present invention with reference to the accompanying drawings. FIG.
1 is a block diagram showing an embodiment of the large-screen video image creating apparatus according to the present invention. In FIG. 1, 1 is a moving camera, 2
Denotes an image storage unit, 3 denotes a movement amount measurement unit, and 4 denotes a spatiotemporal pixel editing unit.

The operation will be described. In the present invention,
First, an object is photographed by the moving camera 1 while controlling the moving amount, and the photographed output is stored in the image storage unit 2. At this time, the movement amount of the camera at each time is measured by the movement amount measurement unit 3. Video storage unit 2
Is supplied to the spatiotemporal pixel editing unit 4 and a large-screen image is created by a method described below.

FIG. 2 illustrates the pixel structure of video data obtained from a stationary camera. Here, one screen is
It is composed of 7 pixels in both the vertical and horizontal directions and a total of 7 × 7 = 49 pixels. Since the camera is stationary, it is possible to obtain an image of 49 pixels / screen and an arbitrary time length. That is, an image only in the shooting range of the still camera can be obtained. If the subject contains a moving object,
The obtained video is also a motion video only in the shooting range of the still camera.

On the other hand, FIG. 3 illustrates the pixel structure of video data obtained when an image is taken while moving the camera in the x-axis direction (horizontal direction) according to the present invention. In addition,
The pixel structure is shown in a diagram viewed from the y-axis direction (up-down direction). Here, for simplicity, the video data is obtained by parallel projection, the shooting range of the camera is 7 pixels in the x-axis direction, and the camera continuously moves in the x-axis direction at a constant speed of 1 pixel per unit time. Assume that you are moving. In this way, as can be seen from FIG. 3, even at the pixel position of xi (i ≧ 6), 6 unit times (tj to tj + 5) (j
Is a positive integer). That is, by arranging the pixels for six unit times, a large screen image having seven or more pixels in the x-axis direction can be obtained. Note that there is no increase in the number of pixels in the y-axis direction. For example, the number of pixels remains seven as in the case of FIG.

At this time, all the pixels in one screen are not pixels at the same time, but the time difference between adjacent pixels is one.
By editing so as to have a unit time, and supplementing missing pixel data from adjacent pixels by editing or interpolation processing, it is possible to minimize the unnaturalness of the obtained video. These operations are performed by the spatiotemporal pixel editing unit 4.
In FIG. 3, a hatched line toward the lower right direction indicates which of the pixels of the video data captured while moving to compose a large-screen video, which is represented by a pixel position x.
If the movement of the camera is defined by i and the time tj, and the movement of the camera is moving in parallel by one pixel at a constant speed, selection of a pixel to be used (pixel rearrangement in spatiotemporal space, that is, pixel editing) Can be based on certain rules.

However, in practice, the pixel movement is not always parallel movement at a constant speed one pixel at a time. Generally, the camera movement amount obtained from the movement amount measuring device 3 shown in FIG. The selection of a pixel to be used is performed. That is, it is necessary to perform spatio-temporal pixel editing after performing perspective transformation of the image using the measured camera rotation angle and zoom amount.

FIG. 4 illustrates a method of extracting a background image necessary for image synthesis from a large-screen image obtained as described above. Here, 7 obtained by the method of FIG.
From a large-screen moving image of 12 pixels, it is possible to cut out a wide-range image having a width equal to or larger than the camera pixel (7 × 7 pixels) at the time of shooting, using camera data and the like when combining with a real image in a studio. .

[0017]

According to the present invention, a large screen image having a resolution higher than that of the camera can be created by arranging the pixels in a space and time with respect to the pixels of the image photographed by one camera. Therefore, it is possible to cut out and use an image in an arbitrary direction when performing image synthesis.

Further, according to the present invention, even if a single camera is moved, and particularly when a moving subject is photographed, the obtained images are joined at the edge of the screen as in the related art. Therefore, each part of the screen is regarded as having been photographed at the same time, and therefore, it is a natural image in which a large screen moving object is reflected.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an embodiment of a large-screen image creating apparatus according to the present invention.

FIG. 2 illustrates a pixel structure of video data obtained from a stationary camera.

FIG. 3 shows the camera in the x-axis direction (horizontal direction) according to the present invention.
The pixel structure of the video data obtained when shooting while moving to is described.

FIG. 4 illustrates a method of cutting out a background image required for image synthesis from a large screen image.

[Explanation of symbols]

 Reference Signs List 1 moving camera 2 video storage unit 3 moving amount measuring unit 4 spatiotemporal pixel editing unit

 ────────────────────────────────────────────────── ─── Continued on the front page F term (reference) 5B057 AA20 BA02 BA19 CA01 CA08 CA12 CA16 CB01 CB08 CB12 CB16 CD06 CD14 CE08 CE09 CH11 CH18 DA16 DA17 5C023 AA11 AA37 BA04 BA12 CA03 DA04 EA03

Claims (1)

[Claims] A camera for photographing a subject while moving; a video storage unit for storing video captured by the camera; a unit for measuring an amount of movement of the camera at each time; and a video memory stored in the video storage unit. The rearranged and rearranged the constituent pixels of the photographing screen obtained by the camera in time and space according to the amount of movement of the camera at each time measured by the measuring means. A large-screen image creating apparatus comprising: a spatio-temporal pixel editing unit that creates a large-screen image by reading a pixel in an oblique direction above and interpolating and generating a missing pixel with an adjacent constituent pixel.