JP3113365B2 - Video synthesis system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image synthesizing system for synthesizing an image by a chroma key method.

[0002]

SUMMARY OF THE INVENTION The present invention calculates a camera operation amount for a foreground image at the time of synthesis from a required camera operation amount at the time of synthesis and a camera operation amount at the time of foreground shooting, and foregrounds an area corresponding to the calculated camera operation amount. The video is cropped from the foreground video stored at the time of shooting, scaled to the size of the composite video, and from the previously stored background video, the background video in the area corresponding to the required amount of camera operation is cut, and the composite video is By zooming to the size and chroma keying the obtained background video and foreground video, the required camera operation can be performed on the synthesized video regardless of the amount of camera operation when shooting the foreground I did it.

[0003]

2. Description of the Related Art A conventional video synthesizing system records a foreground photographed by a foreground camera and camera operation amounts for photographing the foreground, for example, pan, tilt and zoom operation amounts. When synthesizing is performed, the readout pan, tilt, and zoom operation amounts are used to perform image processing corresponding to the pan, tilt, and zoom operation amounts on the background electronic image,
The synthesized background image and the reproduced foreground image are synthesized to obtain a synthesized image.

[0004]

However, since the amount of pan, tilt, and zoom operation in the composite image is the same as the amount of pan, tilt, and zoom operation when the foreground is photographed, after the foreground is photographed, the composite image , The pan, tilt, and zoom operation amounts for can not be freely changed.

SUMMARY OF THE INVENTION An object of the present invention is to solve the above-mentioned problems, and to perform a required camera operation on a synthesized image irrespective of the amount of camera operation when a foreground is photographed. It is to provide a system.

[0006]

In order to achieve the above object, the present invention provides a foreground image storing means for storing information of a foreground image photographed by a foreground television camera together with a camera operation amount at the time of foreground photographing. Background video storage means for pre-storing background video information including a background video area at the time of synthesis; and a camera operation amount for the foreground video at the time of synthesis from the camera operation amount required at the time of synthesis and the camera operation amount at the time of foreground shooting Calculating a foreground image of an area corresponding to the camera operation amount calculated by the calculating means from the foreground image stored in the foreground image storage means, and converting the cut foreground image into a predetermined composite image. A foreground image processing unit that scales up to the size of: a background image of an area corresponding to the required camera operation amount, and cuts the background image into a size of the composite image. And the background for the video processing means for zooming in,
And a chroma key synthesizing unit for chroma key synthesizing the background video processed by the background video processing unit and the foreground video processed by the foreground video processing unit.

[0007]

According to the present invention, information of a foreground image taken by a foreground television camera is stored in a foreground image storage means together with a camera operation amount at the time of shooting, and information of a background image including a background image area at the time of synthesis is stored in the background. The camera operation amount for the foreground video at the time of synthesis is calculated by the camera operation amount at the time of synthesis from the camera operation amount required at the time of synthesis and the camera operation amount at the time of foreground shooting. The foreground image in the foreground image is cut from the foreground image stored in the foreground image storage means by the foreground image processing means, and the cut foreground image is scaled up to a predetermined composite image size. Means for cutting out a background image of an area corresponding to the required camera operation amount, scaling the cut-out background image to the size of the composite image, To the chroma key composition by the chroma key composition unit foreground image processed by the processing background image and foreground image processing means Ri.

[0008]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 shows an embodiment of the present invention.

In FIG. 1, reference numeral 2 denotes a foreground television camera for photographing a person in front of a blue curtain. 4
A video recording device records foreground video information from the foreground television camera 2 together with a vertical synchronization signal and a field number (attached to each field). Reference numeral 3 denotes a camera data detecting device for detecting a pan, tilt, and zoom operation amount (hereinafter, referred to as camera data) of the foreground television camera 2. Reference numeral 5 denotes a camera data recording device which records the camera data detected by the camera data detecting device 3 in synchronization with the foreground image based on the vertical synchronization signal of the image from the image recording device 4 and the field number of the image. is there.

Reference numeral 11 denotes a pan / tilt / zoom operation unit for giving a camera work to a composite image. Reference numeral 6 denotes a camera data detection device for detecting camera data of the pan / tilt / zoom operation device 11. 1
Reference numeral 0 denotes a control unit that calculates camera data for a background image based on camera data from the camera data detection device 6 and foreground image based on camera data from the camera data detection device 6 and camera data from the camera data recording device 5. Is to calculate camera data for.

Reference numeral 8 denotes a foreground image processing device which cuts out the foreground image recorded in the image recording device 4 based on the camera data for the foreground image from the control unit 10 and reduces the cut foreground image to the size of the composite image. It is a variable.

Reference numeral 1 denotes a background image memory for storing a background image. Reference numeral 7 denotes a background image processing device which cuts out the image from the background image memory 1 based on the camera data for the background image from the control unit 10 and scales the cut-out image to the size of the synthesized image.

Reference numeral 9 denotes a chroma key synthesizing device which performs chroma key synthesizing of the background image from the background image processing device 7 and the foreground image from the foreground image processing device 8.

Next, the operation will be described.

This is an example of realizing an image in which a person who walks in front of a painting hung on a wall in a room and is captured at a fixed camera position without zooming or panning is captured in a zoomed-in manner.

A room image (background image) taken in an area about four times the background of the synthesized image is stored in the background image memory 1. FIG. 2A shows an example of a shot video.

On the other hand, as shown in FIG. 2B, a person walking in front of the blue curtain from right to left is shot while panning the foreground television camera 2 so as to be exactly in the middle of the shooting area indicated by the broken line. Then, the obtained foreground video information is recorded in the video recording device 4 and the camera data from the camera data detection device 3 when the foreground television camera 2 is panned is recorded in the camera data recording device 5.

When synthesizing the background image and the foreground image, the same operation as the camera work of zooming in on the center of the room as the background is given to the pan / tilt / zoom operation unit 11.

Then, based on the camera data of the pan / tilt / zoom operation device 11 detected by the camera data detection device 6, the background video of the background image memory 1 is cut by the background video processing device 7. For example, before zooming in on the pan / tilt / zoom operation device 11, FIG.
After the inside of the dashed line in (c) is cut out and the pan / tilt / zoom operation unit 11 is zoomed in, the inside of the dashed line in FIG.
Here, since the pan / tilt / zoom operation unit 11 performs only zoom-in, the center position of the cut-out area is fixed and only the size is changed.

On the other hand, the camera data for the foreground image is calculated by the control unit 10 based on the camera data from the camera data detection device 6 and the camera data stored in the camera data recording device 5. Based on this, the foreground image processing device 8 cuts out the foreground image recorded in the image recording device 4. For example,
Before the zoom operation of the pan / tilt / zoom operation unit 11 is performed, the image is cut off in a region within a broken line in FIG. This is the same size as that in the broken line in FIG. Next, after zooming in on the pan / tilt / zoom operation device 11, FIG.
It is cut off in the area within the broken line in (g). At this time, the size of the region to be cut is the same as that within the broken line in FIG. 2F, and the position to be cut is moved to the right according to the pan data recorded in the camera data recording device 5. Each of the cut-out areas is scaled up to the size of the composite image.

Next, the foreground image from the foreground image processing device 8 and the background image from the background image processing device 7 are chromakey synthesized by the chromakey synthesizing device 9. FIGS. 2E and 2H show composite images before and after zooming in on the pan / tilt / zoom operation device 11, respectively.

In this embodiment, an example has been described in which a zoom operation is performed on a composite image regardless of the pan operation amount of a foreground image shot while performing a pan operation. However, the present invention is not limited to this example. Regardless of the pan, tilt, or zoom operation amount when shooting the foreground, pan, tilt,
Tilt and zoom operations can be performed.

Further, when photographing a person, there is no need to consider camera work, and there is no need to retake the work due to a mistake in camera work, so that program production can be performed efficiently.

[0025]

As described above, according to the present invention,
With the configuration described above, there is an effect that the camera operation can be performed on the composite video regardless of the amount of camera operation when the foreground is photographed.

[Brief description of the drawings]

FIG. 1 is a block diagram showing one embodiment of the present invention.

FIG. 2 is an explanatory diagram for explaining video composition in the embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Background image memory 2 Foreground television camera 3 Camera data detection device 4 Video recording device 5 Camera data recording device 6 Camera data detection device 7 Background video processing device 8 Foreground video processing device 9 Chroma key synthesizing device 10 Control unit 11 Pan・ Tilt / zoom controller

──────────────────────────────────────────────────続 き Continuation of the front page (72) Inventor Kazumasa Enami 1-10-11 Kinuta, Setagaya-ku, Tokyo Japan Broadcasting Corporation Research Institute of Broadcasting Technology (56) References JP-A-60-18067 (JP, A) JP-A-55-71363 (JP, A) JP-A-63-123280 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) H04N 9/75 H04N 5/272

Claims (1)

(57) [Claims] 1. A foreground image storage means for storing information of a foreground image taken by a foreground television camera together with a camera operation amount at the time of foreground shooting, and information of a background image including a background image area at the time of synthesis is stored in advance. Means for calculating a camera operation amount for a foreground image at the time of synthesis from a camera operation amount required at the time of synthesis and the camera operation amount at the time of foreground shooting, and a camera operation amount calculated by the calculation means Foreground image processing means for cutting a foreground image of an area corresponding to the foreground image stored in the foreground image storage means and scaling the cut foreground image to a predetermined composite image size, and the required camera Background video processing means for cropping a background video in an area corresponding to an operation amount, and scaling the cropped background video to the size of the composite video; The image synthesizing system, characterized in that a chroma key composition unit for chroma key composition foreground image processed by the processed background image the foreground video processing unit by.