JPH05207502A - Video image synthesis system - Google Patents

Abstract

PURPOSE:To make the production of a program efficient by providing a foreground video image storage means, a background video image storage means, a means calculating a camera controlled variable, a foreground video image processing means, a background video image processing means and a chromakie synthesis means to the system. CONSTITUTION:An object is picked up by a foreground television camera 2 while panning the camera 2, obtained foreground video image information is recorded by a video recorder 4 and data from a camera data detector when the camera 2 is subjected to panning are recorded by a camera data recorder 5. Based on data of a pan tilt zoom operation device 11 detected by the camera data detector 6, a background video image of a background video image picture memory 1 is segmented by a background video image processing unit 7. On the other hand, camera data with respect to the foreground video image based on the camera data from the devices 5, 6 are calculated by a control section 10 and a background video image processing unit 8 segments the background video image recorded by the recorder 4. The foreground video image and the background video image from the devices 8, 7 are synthesized by a chromakie synthesis device 9.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image synthesizing system for synthesizing images by a chroma key method.

[0002]

SUMMARY OF THE INVENTION According to the present invention, a camera operation amount for a foreground image at the time of combination is calculated from a camera operation amount required for combination and a camera operation amount for foreground shooting, and a foreground of an area corresponding to the calculated camera operation amount. The image is clipped from the foreground image stored at the time of shooting, scaled to the size of the composite image, and the background image of the region corresponding to the required camera operation amount is clipped from the background image stored in advance and the composite image By changing the size to a size and combining the obtained background image and foreground image with a chroma key, the required camera operation can be performed on the combined image regardless of the amount of camera operation when shooting the foreground. I did it.

[0003]

2. Description of the Related Art A conventional image synthesizing system records a foreground photographed by a foreground camera and a camera operation amount at the time of photographing the foreground, for example, a pan, tilt, and zoom operation amount, and records the foreground and background images. When synthesizing, using the read pan, tilt, and zoom operation amount, perform image processing corresponding to the pan, tilt, and zoom operation amount on the background electronic image,
The background image that has undergone video processing and the reproduced foreground image are combined to obtain a combined image.

[0004]

However, since the pan, tilt and zoom operation amounts in the combined image are the same as the pan, tilt and zoom operation amounts when the foreground is photographed, the combined image after the foreground is photographed. It was not possible to freely change the pan, tilt, and zoom operation amounts for.

An object of the present invention is to solve the above problems and to perform a required camera operation on a composite image regardless of the amount of camera operation when the foreground is photographed. To provide a system.

[0006]

In order to achieve such an object, the present invention provides a foreground image storing means for storing information of a foreground image photographed by a foreground television camera together with a camera operation amount at the time of foreground photographing. A background image storage means for storing in advance information of a background image including a background image area at the time of combination, a camera operation amount required for combination and a camera operation amount for the foreground image from the camera operation amount at the time of foreground shooting. A foreground image in a region corresponding to the amount of camera operation calculated by the calculation unit is cut from the foreground image stored in the foreground image storage unit, and the cut foreground image is a predetermined composite image. The foreground image processing means for changing the size to the size of, and the background image in the region corresponding to the required camera operation amount is cut, and the cut background image is the size of the composite image. And the background for the video processing means for zooming in,
It is characterized by further comprising a chroma key synthesizing means for performing chroma key synthesis of the background image processed by the background image processing means and the foreground image processed by the foreground image processing means.

[0007]

According to the present invention, the information of the foreground image captured by the foreground television camera is stored in the foreground image storage means together with the camera operation amount at the time of image capturing, and the background image information including the background image area at the time of composition is used as the background. The amount of camera operation stored in the image storage means is calculated by the calculating means from the camera operation amount required at the time of combining and the camera operation amount at the time of foreground shooting, and the amount of camera operation for the foreground image at the time of combining is calculated by the calculating means, The foreground image of the region is cut from the foreground image stored in the foreground image storage means by the foreground image processing means, and the cut out foreground image is scaled to a predetermined size of the composite image, and the background image processing is performed. By means of the means, the background image of the area corresponding to the required camera operation amount is cut out, and the cut-out background image is scaled up to the size of the composite image, and the background image processing means is provided. To the chroma key composition by the chroma key composition unit foreground image processed by the processing background image and foreground image processing means Ri.

[0008]

Embodiments of the present invention will now be described in detail with reference to the drawings.

FIG. 1 shows an embodiment of the present invention.

In FIG. 1, reference numeral 2 is a foreground television camera for photographing a person in front of a blue curtain. Four
Is a video recording device for recording the foreground video information from the foreground television camera 2 together with the vertical synchronizing signal and the field number (attached to each field). Reference numeral 3 denotes a camera data detection device that detects the pan, tilt, and zoom operation amounts (hereinafter referred to as camera data) of the foreground television camera 2. A camera data recording device 5 records the camera data detected by the camera data detection device 3 in synchronization with the foreground image on the basis of the vertical synchronizing signal of the image from the image recording device 4 and the field number of the image. is there.

Reference numeral 11 denotes a pan / tilt / zoom operator for giving camera work to a composite image. A camera data detection device 6 detects camera data of the pan / tilt / zoom operation device 11. 1
Reference numeral 0 denotes a control unit, which calculates camera data for a background video based on the camera data from the camera data detection device 6 and foreground video based on the camera data from the camera data detection device 6 and the camera data from the camera data recording device 5. To calculate camera data for.

Reference numeral 8 denotes a foreground image processing device, which cuts out the foreground image recorded in the image recording device 4 based on the camera data for the foreground image from the control unit 10, and cuts the foreground image up to the size of the composite image. It is to change the magnification.

Reference numeral 1 denotes a background image memory for storing a background image. Reference numeral 7 denotes a background image processing device, which cuts the image from the background image memory 1 based on the camera data for the background image from the control unit 10, and scales the cut image to the size of the composite image.

Reference numeral 9 denotes a chroma-key synthesizing device for performing chroma-key synthesizing of the background image from the background image processing device 7 and the foreground image from the foreground image processing device 8.

Next, the operation will be described.

This is an example in which an image is realized by synthesizing an image in which a person who walks in front of a painting hung on the wall of a room and passes through it is zoomed in without performing panning or tilting with the camera position fixed.

A room image (background image) taken in an area about four times the background of the composite image is stored in the background image memory 1. An example of the captured image is shown in FIG.

On the other hand, a person walking from right to left in front of the blue curtain is shot while panning the foreground television camera 2 so that it is in the center of the shooting area indicated by the broken line, as shown in FIG. 2B. Then, the obtained foreground image information is recorded in the image recording device 4, and the camera data from the camera data detecting device 3 when the foreground television camera 2 is panned is recorded in the camera data recording device 5.

Then, when synthesizing the background image and the foreground image, the pan / tilt / zoom operation unit 11 is given the same operation as the camera work of zooming in aiming at the center of the room as the background.

Then, based on the camera data of the pan / tilt / zoom operating device 11 detected by the camera data detecting device 6, the background image processing device 7 cuts out the background image in the background image memory 1. For example, before zooming in on the pan / tilt / zoom operation device 11, FIG.
The inside of the broken line in (c) is cut out, and after the pan / tilt / zoom operation device 11 is zoomed in, the inside of the broken line in FIG. 2 (f) is cut out and scaled to the size of the composite image.
Here, since the pan / tilt / zoom operation unit 11 is only zooming in, the center position of the region to be clipped is fixed and only the width is changed.

On the other hand, the camera data for the foreground image is calculated by the control unit 10 based on the camera data from the camera data detection device 6 and the camera data stored in the camera data recording device 5, and the camera data from the control unit 10 is obtained. Based on this, the foreground image processing device 8 cuts out the foreground image recorded in the image recording device 4. For example,
Before the zoom-in of the pan / tilt / zoom operation device 11 is performed, the area is cut out in the area within the broken line in FIG. This is the same size as within the broken line in FIG. Next, after zooming in on the pan / tilt / zoom operation unit 11, as shown in FIG.
It is cut out in the area within the broken line in (g). At this time, the size of the clipped area is the same as the size within the broken line in FIG. 2 (f), and the clipped position is moved to the right according to the pan data recorded in the camera data recording device 5. The areas thus cut are scaled up to the size of the composite image.

Next, the foreground image from the foreground image processing device 8 and the background image from the background image processing device 7 are chroma key combined by the chroma key combining device 9. Composite images before and after zooming in on the pan / tilt / zoom operation device 11 are shown in FIGS. 2 (e) and 2 (h), respectively.

In this embodiment, an example in which the zoom operation is performed on the composite image regardless of the pan operation amount of the foreground image captured while performing the pan operation has been described, but the present invention is not limited to this example. No matter how much pan, tilt, or zoom operation is taken when shooting the foreground, pan the composite video,
Tilt and zoom operations can be performed.

Further, when taking a picture of a person, it is not necessary to consider the camera work, and it is not necessary to retake the camera work due to an error in the camera work, so that the program production can be efficiently performed.

[0025]

As described above, according to the present invention,
With the configuration as described above, there is an effect that the camera operation can be performed on the combined image regardless of the amount of camera operation when the foreground is photographed.

[Brief description of drawings]

FIG. 1 is a block diagram showing an embodiment of the present invention.

FIG. 2 is an explanatory diagram for explaining video composition in the embodiment.

[Explanation of symbols]

 1 background image memory 2 foreground TV camera 3 camera data detection device 4 video recording device 5 camera data recording device 6 camera data detection device 7 background video processing device 8 foreground video processing device 9 chromakey synthesis device 10 control unit 11 pan・ Tilt / zoom operation device

Continuation of the front page (72) Inventor Kazumasa Enami 1-10-11 Kinuta, Setagaya-ku, Tokyo Inside the Japan Broadcasting Corporation Broadcasting Technology Laboratory

Claims (1)

[Claims] 1. A foreground image storage unit for storing information of a foreground image captured by a foreground television camera together with a camera operation amount at the time of foreground image capturing, and background image information including a background image area at the time of composition in advance. Background image storage means, calculation means for calculating the camera operation amount for the foreground image at the time of combination from the camera operation amount required for the combination and the camera operation amount for the foreground shooting, and the camera operation amount calculated by the calculation means. A foreground image in an area corresponding to the foreground image stored in the foreground image storage means, and the foreground image processing means for scaling the clipped foreground image to a predetermined composite image size; and the required camera. Background image processing means for clipping a background image in an area corresponding to an operation amount, and scaling the clipped background image to the size of the composite image, and the background image processing means. The image synthesizing system, characterized in that a chroma key composition unit for chroma key composition foreground image processed by the processed background image the foreground video processing unit by.