JPH1155620A - Moving image synthesis system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a moving image synthesis system where a motion of the user in front of a camera is permitted and the motion of the user and a background image are synthesized while giving them an interactive relation. SOLUTION: The system is provided with a background moving image reproduction means 20 that reproduces a background moving image being a background of a synthesized image, cameras 4C, 4R, 4L photographing a video image of the user, a moving image synthesis means 2 that synthesizes the background moving image with a video image of the user, a position pointer 8 that instructs a moving position of the user during photographing of the video image of the user, a caption pointer 7 that displays words of the user while designating a direction of a sight of the user, and a video tape recorder 3 that records the video image of the user and the background moving image.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a moving image synthesizing system for synthesizing an image obtained by photographing a user in front of a camera with a predetermined moving image.

[0002]

2. Description of the Related Art Conventionally, a still image of a user has been taken,
2. Description of the Related Art An image synthesizing system that synthesizes a predetermined image and outputs the image in a form such as a sticker or a stamp is known. In such a system, only static images are output, and the number of variations can be increased by changing the background image to be synthesized, but the composition of the user on the screen has become stylized. They tended to be.

[0003] If a moving image is used as a background image and a video tape or the like is used as an output means, the number of variations can be further increased as compared with a still image, and entertainment can be provided. By simply synthesizing the image and the background moving image, there is no interactive relationship between the two, and eventually a stylized synthesized image is obtained.

[0004]

SUMMARY OF THE INVENTION In view of the above circumstances, the present invention allows a user to move in front of a camera, and combines the motion of the user and the background image with an interactive relationship. It is an object of the present invention to provide a moving picture synthesizing system capable of performing such operations.

[0005]

In order to solve the above-mentioned problems, a moving image synthesizing system according to the present invention is provided with a background moving image reproducing means for reproducing a background moving image as a background of an image to be synthesized, and for photographing a video of a user. Photographing means, background moving image combining means for combining the background moving image with the user's image, moving position instructing means for instructing a user's moving position during photographing of the user's image, Recording means for recording a composite image of a user's video and the background moving image (corresponding to claim 1).

According to such a moving image synthesizing system, when the user moves to the specified moving position, the user moves in accordance with the background image. It will blend into the image without discomfort.

From another viewpoint, a moving image composing system according to the present invention comprises: a background moving image reproducing means for reproducing a background moving image which is a background of an image to be synthesized; a photographing means for photographing a video of a user; Background video image synthesizing means for synthesizing a background video and the video of the user, and display means for displaying the dialogue of the user as subtitles during shooting of the video of the user, at a position matching the background image, Recording means for recording a composite image of the video of the user and the background moving image (claim 2).

[0008] In this case, the user merely looks at the caption position and reads the caption, and in the synthesized image, the user turns his or her gaze to an appropriate position and speaks the dialogue.

From a further viewpoint, a moving image synthesizing system according to the present invention comprises a background moving image reproducing means for reproducing a background moving image as a background of an image to be synthesized, and a photographing means for photographing a video of a user. Background video image synthesizing means for synthesizing the background video and the user's video, moving position instructing means for instructing a user's moving position during shooting of the user's video, and video of the user Display means for displaying the dialogue of the user as captions at a position where the user's line of sight is directed in an appropriate direction in the image to be synthesized during shooting of
Recording means for recording a composite image of the video of the user and the background moving image (claim 3).

From a different point of view, the moving picture synthesizing system of the present invention comprises: a background moving picture reproducing means for reproducing a background moving picture which is a background of an image to be synthesized; a photographing means for photographing a video of a user; A background moving image synthesizing means for synthesizing a background moving image and the image of the user; and It is characterized by having a gaze position indicating means for guiding a gaze position, and a recording means for recording a combined image of the video of the user and the background moving image (claim 4).

That is, the user moves his line of sight while being guided by the line of sight position indicating means, so that the line of sight is completely moved on the combined screen with the background image.

[0012] The line-of-sight position designating means may be configured to also serve as caption display means for displaying the speech spoken by the user as captions (claim 5).

[0013] Further, the moving picture synthesizing system is provided with predetermined information input means, and the position of the user's line of sight indicated by the line of sight position display means based on the information input by the predetermined information input means. Is corrected, the user's gaze position in the synthesized image can be made more accurate.

At this time, it is possible to adopt a configuration having a calculation means for calculating the position of the user's line of sight specified by the line of sight position specifying means based on the information input by the predetermined information input means ( Claim 7).

[0015] The height of the user may be input by the predetermined information input means. That is, it is possible to adopt a configuration in which the gaze position is corrected in accordance with the height of the user (claim 8).

[0016] The background moving image synthesizing means synthesizes the image of the user and the background moving image by chroma key processing.

The background moving picture reproducing means may reproduce a plurality of types of background images respectively corresponding to a plurality of scenes, and a user may select a desired picture from the plurality of background moving pictures. It is preferable to adopt a configuration further provided with a selecting means (claim 10).

[0018] By further comprising a composite image reproducing means for reproducing the composite image recorded in the recording means, the user can immediately confirm the composite image (claim 11).

It is possible to have a configuration having a plurality of display devices for displaying at least the background image during the photographing of the user (claim 12). Further, on this display device, it is also possible to combine and display an image of the model performance of the role played by the user during the shooting of the user. It is preferable that the photographing unit has a plurality of cameras, and at least one of the plurality of cameras is configured to be movable (claim 13).

[0020] It is also possible to adopt a configuration having audio reproducing means for reproducing the audio corresponding to the background image.
4). Further, it is possible to further include a voice input unit for picking up a user's dialogue during the photographing of the user (claim 15). A video tape recorder can be used as the recording means.

[0021]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows a first embodiment of the present invention.
It is a figure showing composition of animation composition system 100 of an embodiment. In the moving image composition system 100, for example, an image in which a person speaks is prepared as a background image.
Then, the user speaks a line corresponding to the person's line in the background image, captures the line, and synthesizes the line with the background image, so that a simple skit or the like can be created and recorded on a recording medium.

The moving image synthesizing system 100 has a room 10 in which a user enters when performing moving image synthesis. Inside the room 10, cameras 4C and 4R for photographing the user are provided.
The camera 4L is attached to a side wall 10B at the rear (lower side in the figure) of the room 10, a right side wall 10R of the room 10 in the figure, and a left side wall 10L of the room 10 in the figure.

The camera 4C is configured such that the side walls 10L to 10B
And is movably mounted on a guide rail 1 extending in an arc shape across the side wall 10R. The camera 4C is provided with a drive mechanism (not shown), and moves on the guide rail 1 based on movement data set in advance according to a background moving image described later. Further, as shown in FIG. 2, the camera 4C can change the angle in the vertical direction, and when the camera 4C is positioned at the center of the movable range along the rail 1 by a mechanism not shown (that is, the position shown in FIG. 1). 2), it can be moved up and down as shown in FIG.

Camera 4R, Camera 4C and Camera 4L
Each has a zoom mechanism, and can perform zooming during shooting by remote control. Note that the zooming operation of each camera is executed based on zooming data set in advance in accordance with a background moving image described later.

In the moving image synthesizing system 100, a background image and a moving image of a user photographed using the cameras 4R, 4C and 4L are synthesized by chroma key processing. For this reason, the inside of the room 10 is configured as a blue screen generally suitable for chroma key processing. It is not necessary that all the wall surfaces of the room 10 be blue screens, and only the blue screen should be provided within the range of the angle of view of the cameras 4R, 4C, and 4L.

Camera 4R, Camera 4C and Camera 4L
Are sent to the synthesizing workstation 2 as images R, C, and L, respectively. The background image is also input to the synthesizing workstation 2, and the camera 4
One of the images captured by R, the camera 4C, and the camera 4L is combined with the background image, sent to the video tape recorder 3 as an image B, and recorded on a video tape as a recording medium. FIGS. 7, 8, and 9 show examples of images R, C, and L when the user is photographed in the state of FIG.

As an image input means for inputting a background image to the synthesizing workstation 2, an image reproducing device such as a video tape recorder or a video disk player, a cable television system, a satellite broadcasting system, or the like can be used. . The image input means includes, in addition to the background image, the above-described zooming data, data for setting the position of the camera 4C, subtitle data, position data, and model data in which an actor plays a role played by the user, The audio data is also input to the synthesizing workstation 2.

In the moving image synthesizing system 100, the video tape recorder 3, the synthesizing workstation 2
Is installed outside the rear wall 10B of the room 10.
This is because, in the present system, the user can move in the room 10, so that devices other than those necessary for photographing are taken out of the room 10.
Note that the tape take-out opening of the video tape recorder 3 is exposed inside the room 10.

The moving image synthesizing system 100 is further provided with a confirmation monitor for a user to monitor an image. A confirmation monitor 5F is attached to the front (upper side in the figure) wall 10F of the room 10, confirmation monitors 5R and 5L are attached to the side walls 10R and 10L, and a confirmation monitor 5C is attached to the rear wall 10B. The image displayed on the confirmation monitor is an image obtained by synthesizing a background image, the above-described exemplary data, and a result of converting the above-described subtitle data into image data. Therefore, by imitating the choreography performed by the actor displayed on the confirmation monitor, the user can easily perform his role without practicing repeatedly.

When the background image is the image A shown in FIG. 11, a combination of the model data and the caption is displayed as an image shown as an image D in FIG. During shooting, the image D is displayed on the confirmation monitors 5R, 5L, and 5C. At this time, the image B input to the video tape recorder 3 is as shown in FIG. The model data displayed in the image D is replaced with the image of the user in the image B.

FIG. 2 is a perspective view of the room 10 seen from outside the side wall 10R. As shown in FIG. 2, the camera 4C is installed at a relatively low position. On the other hand, the cameras 4R and 4L are mounted at relatively high positions on the side walls 10R and 10L, respectively. This is to prevent the cameras 4R and 4L from entering the angle of view of the camera 4C.

The confirmation monitor 5C is provided slightly above the guide rail 1. Since the wall surface 10B does not enter the angle of view of any of the cameras 4R, 4C, and 4L, the confirmation monitor 5B may be at a low position.

The confirmation monitors 5R and 5L are also installed at relatively low positions as shown in FIG. However, the confirmation monitors 5R and 5L are connected to the camera 4C by the guide rail 1.
Moving up may enter the angle of view. Therefore, as shown in FIG. 1, the confirmation monitors 5R and 5L
Are provided with shielding plates 6R and 6L on the camera 4C side. When the camera 4C moves on the guide rail 1 toward the side wall 10L, the monitor 5R for confirmation is hidden behind the shielding plate 6R when viewed from the camera 4C. Similarly, when the camera 4C is moved to the rightmost position in FIG. 1, the monitor 5L for confirmation is viewed from the camera 4C.
Hide behind L. In addition, the camera 4 of the shielding plates 6R and 6L
The surface on the C side is also configured as a blue screen. In FIG. 2, the confirmation monitor 5 installed on the side wall 10R is shown.
The state where the composite image displayed on R is seen through from the outside of the side wall 10R is shown.

The monitor 5F for confirmation is, as shown in FIG.
It is installed above the wall surface 10F. This is the wall 10
This is because the portion other than the portion above F is within the shooting angle of view of the camera 4C.

The moving picture synthesizing system 100 further has a subtitle pointer 7, a position pointer 8, and a microphone 9.

The subtitle pointer 9 is a device for projecting subtitles on the wall surface of the room 10 and is provided on the ceiling surface 10T of the room 10. The subtitle pointer 9 has, for example, a laser light source, and projects a subtitle or other information on a wall surface by scanning a laser beam according to information to be projected (the above-described subtitle data). The user can speak a line corresponding to the background image by reading the subtitle projected on the wall surface aloud. As will be described in detail later, when the user views the caption projected by the caption pointer 9,
The user's gaze comes to a position (height and direction) corresponding to the background image.

It should be noted that the three cameras 4C, 4R and 4L are normally switched so that the user can always be photographed from a position where the user's face can be seen. Therefore, the wall surface on which the caption is projected does not fall within the angle of view of the camera that is capturing the user image combined with the background image.

The caption pointer 7 not only displays the user's dialogue, but also gives instructions to the user, such as what kind of facial expression should be given and what kind of acting should be performed. It can also be used to inform users of information. It can also be used to simply specify the position of the user's line of sight. The contents of the caption are stored as caption data corresponding to the background image. The subtitle data includes a reference position for displaying each subtitle, and an optimal subtitle display position is calculated based on the reference position and height data (described later) input by the user. The subtitle is controlled to be displayed at the optimum display position.

The position pointer 8 is a device for indicating to which position in the room 10 the user should move during photographing, and is provided on the ceiling surface of the room 10. The position pointer 8 also has, for example, a laser light source, and notifies the user of the user's movement position (movement destination) by projecting a light spot on the floor surface. The moving position of the user is input together with the background image as position data corresponding to the background image data.

The moving image synthesizing system 100 further has a switch panel 11. The switch panel 11 is provided with keys for selecting an image, which will be described later, and for inputting characters and numerals. When the present system is a commercial system, a charge insertion port can be provided on the switch panel 11. As shown in FIG. 1 and FIG.
Reference numeral 1 is installed at a position slightly lower than the rear wall 10B and near the side wall 10L. As described above, since the rear wall 10L does not enter the angle of view of any camera, the position of the switch panel 11 may be any position on the rear wall 10B as long as it is easy for the user to operate.

The microphone 9 is installed on the ceiling of the room 10 for inputting speech displayed by the subtitle pointer 7 and read out by the user to the video tape recorder 3.
The subtitle pointer 7, the position pointer 8, and the microphone 9 do not necessarily need to be installed on the ceiling, but need to be located outside the angle of view of the camera and function at all positions within the photographable range of the camera. System 100
Is installed on the ceiling of the room 10 as a suitable position.

The moving image synthesizing system 100 further includes speakers 12L and 12R as audio output means. The speakers 12L and 12R are for outputting sound reproduced in synchronization with the background image. For example,
Human dialogue, sound effects, music, and the like appearing in the background image are reproduced from the speakers 12L and 12R. As shown in FIGS. 1 and 2, the speakers 12L and 12R are mounted on the wall 1 so as to be out of the angle of view of the cameras 4L, 4C and 4R.
It is installed above both ends of OF.

FIG. 3 is a block diagram schematically showing a control system of the moving picture synthesizing system 100. Video synthesis system 10
0 has control means 30 for controlling the operation of the entire system.
Various key operations on the switch panel 11 are input to the control unit 30. The switch panel 11 is provided with a charge insertion slot, and when a charge is inserted, the charge detector 11C detects that the charge has been inserted.

The background image, position data, and caption data input by the background image input means 20 are synthesized in the workstation 2 and sent to the confirmation monitors 5F, 5L, 5R, and 5B. Position data and subtitle data are
It is also sent to the control means 30, and the control means 30 controls the position pointer 8 and the caption pointer 7 based on the position data and the caption data, respectively, and projects the caption and the moving position.

The cameras 4C, 4R and 4L are
Under the control of 0, the user is photographed and the video is sent to the workstation 2. The switching data for switching between the cameras 4C, 4R and 4L is stored in the background image input means 2
0 to the workstation 2, where the camera 4 </ b> C,
The video signals from the 4R and 4L are selected, combined with the background image, and output to the video tape recorder 3.

The video tape recorder 3 records the image signal sent from the work station 2 on a video tape together with the audio signal from the microphone 9 under the control of the control means 30. Note that zooming data and movement data of the cameras 4R, 4L, and 4C are input to the control unit 30 via the workstation 2. The control unit 30 also controls the zooming of each of the cameras 4C, 4R, and 4L and the driving unit 40 for moving the camera 4C based on the data. The cameras 4C, 4R, 4
The switching of L and the movement of the camera 4C depend on the camera work at the time of shooting the background image, and by using the cameras 4C, 4R, and 4L in the same manner as when the background image was shot, the combined image (image B In ()), the movement of the user and the background image match.

FIG. 4 is a flowchart showing a moving image synthesizing process by the moving image synthesizing system 100. This process
This processing is executed by the control unit 30 when a user mounts a video tape on the video tape recorder 3. S
In 1, the control means 30 determines whether or not a charge has been inserted based on the detection result of the charge detector 11C.
If the charge has not been inserted (S1: NO), the control means 30 waits for the charge to be inserted.

When the fee is inserted (S1: YES), a process for selecting a scene is executed. The present video composition system 1
In 00, the background image input means 20 has a plurality of background images, from which an image can be selectively input to the workstation 2. In the scene selection process of S3, the user is requested to select one of a plurality of available scenes (background images). For the plurality of scenes, for example, titles are displayed in a list on the confirmation monitor 5B or the like, and images (still images or moving images) indicating the scenes are displayed.
Can be displayed to notify the user. The user selects a desired one from a plurality of scenes using the switch panel 11.

When the user selects a scene, the control means 3
In step S5, 0 determines whether or not the selected scene includes a co-star. In other words, if the content of the background image is a skit excluding only the role that the user will play, and another person appears in the background image and interacts with the user, it is synthesized. It is necessary to adjust the user's line of sight so that the user can successfully interact with another person in the video (ie, the video in which the user's video and the background image are combined).

Therefore, in S5, it is determined whether or not another person (co-star) appears in the background image. If there is a co-star (S5: YES), the height is input to the user. Request to do so. That is, the user is requested to input the height by transmitting a message to the user using, for example, a voice or a monitor for confirmation. When the user needs to input the height (that is, when it is determined that there is a co-star),
In S7, the user inputs his / her height using a key on the switch panel 11. The control means 30 calculates a correction amount based on the input height. If there is no co-star (S5: NO), the process of S7 is skipped.

In step S9, the control means 30 determines whether the user has operated the start button on the switch panel 11. When the start button is operated (S
9: YES), the control means 30 first executes a rehearsal (S11). Unless the start button is operated, the process continues to wait for the start button operation in S9. In addition,
In this embodiment, the process proceeds only by operating the start button.
Using a timer, the process may automatically proceed to the next step when the start button is not operated for a predetermined time or more. Alternatively, when the start button is not operated for a predetermined time or more, the processing may be interrupted and the fee may be refunded.

In the rehearsal of S11, the background image selected by the user is input to the workstation 2 from the background image input means 20, and the synthesizing workstation 2 transmits the background image to the confirmation monitors 5F, 5B, 5R and 5L. A confirmation image (image D: see FIG. 5) obtained by synthesizing the image, the model data, and the subtitle data is output, and audio is output from the speakers 12L and 12R. At the same time, the position pointer 8 and the subtitle pointer 7 are controlled to project the user's movement position and the user's dialogue on the wall surface of the room 10. Further, the cameras 4C, 4R, 4
L, and driving means 40 for moving the camera 4C
Is also controlled. The user plays his part by moving to the movement position projected on the floor by the position pointer 8 and reading the subtitle projected on the wall surface by the subtitle pointer 7. In addition, choreography is a monitor 5F, 5B, 5R for confirmation
And the model performance displayed in 5L may be imitated.

The performance of the user in the rehearsal is photographed by the cameras 4C, 4R, and 4L, and video signals (image C, image R, and image L) are sent to the combining workstation 2. The synthesizing workstation 2 synthesizes the background image and the user's video, sends it as the image B to the video tape recorder 3, and records the synthesized video on the video tape. At this time, the voice of the user is also input to the video tape recorder 3 by the microphone 9 and recorded on the video tape together with the synthesized video.

When the rehearsal is completed, the control means 30 controls the video tape recorder 3 to rewind the video tape, and reproduces the video to check the state of the rehearsal (S13). The reproduced image is sent once from the video tape recorder 3 to the synthesizing workstation 2, and then sent to the confirmation monitors 5F, 5B, 5R and 5L for display. The user can check his performance at this time.

When the rehearsal check in S13 is completed, the control means 30 enters a standby state for the first photographing. That is, in S15, the first shooting is not started until the user operates the start button (S1).
5: NO), when the user operates the start button (S
15: YES), the first shooting is performed (S17).
The processing in S17 is substantially the same processing as the rehearsal in S11. When the first shooting is completed, the control means 30 controls the video tape recorder 3 to rewind the video tape by the first shooting and play back the video recorded by the first shooting for checking. (S1
9).

When the checking of the photographing result in S19 is completed, the control means 30 enters a standby state for the second photographing. That is, in S21, the second shooting is not started until the user operates the start button (S12).
1: NO), when the user operates the start button (S
121: YES), the second shooting is performed (S2)
3). The processing in S23 is also substantially the same as S11 and S17. When the second shooting is completed, the control means 30 controls the video tape recorder 3 to rewind the video tape by an amount used for the second shooting.
The video recorded by the second shooting is reproduced for checking (S25).

When the second photographing is completed, the control means 30
Controls the video tape recorder 3, ejects the tape, and terminates one moving image synthesis process. If the user wants to continue the moving image synthesis using the same tape, the process shown in FIG. 4 can be started by attaching the discharged tape to the video tape recorder 3 again.

In this embodiment, the processing is started when the user mounts a video tape on the video tape recorder 3, but the video tape is mounted on the video tape recorder 3 in advance. Alternatively, the control means 30 may be in a standby state of charge insertion (a state in which the determination of NO is repeated in S1).

In this embodiment, a fee is required to be inserted, but it is also possible to construct a system that does not require a fee. In this case, for example, S1 in FIG. 4 may be omitted, and the standby state may be continued until a scene is selected in S3.

In the above-described moving image composing process, the rehearsal and the first and second photographing processes are substantially the same. In the case of rehearsal, the user recognizes his / her own position and the display position of the dialogue, and allows the user to operate the playback / stop of the image or to reduce the playback speed so that the user can easily practice. It is also possible to adopt a configuration that can perform such operations. In this case, it is also possible to perform control so that recording on a video tape is not performed during rehearsal.

In addition, the user can select whether or not to perform rehearsal simultaneously with scene selection so that a rehearsal step (S9 to S13 in FIG. 4) can be skipped for an accustomed user. Is also good. This selection can also be configured to be selectable by key operation of the panel switch 11.

Also, the video taken during the rehearsal is
It is also possible to adopt a configuration in which the video tape is rewound before the next first shooting, so that the video tape is erased.

When a scene is selected, the user can simultaneously input a title, a name, a message, and the like, and a title, a message, and the like are combined with the captured video. Is also good.

The user may operate the switch panel 11 so that image reproduction for checking after each photographing can be skipped. Alternatively, control without performing the check step may be performed.

From another viewpoint, substantially the same photographing process is executed three times. The number of times of this photographing process may be selectable. In that case, the fee may be set according to the number of times of the selected photographing process. Alternatively, the control may be such that the number of times of the photographing process is determined according to the inserted fee.

Next, a second embodiment will be described with reference to the drawings. FIG. 5 is a diagram illustrating a configuration of a moving image composition system 100M according to the second embodiment. The moving image synthesizing system 100M has the room 10 like the moving image synthesizing system 100 of the first embodiment, and the inside of the room is configured as a blue screen suitable for chroma key processing.
In the present embodiment, the switch panel is provided on the shield plate 6R on the side opposite to the camera 4C.

The moving picture synthesizing system 10 of the second embodiment
0M has no subtitle pointer. Also, there is no monitor for confirmation. As a substitute for the subtitle pointer and the monitor for confirmation, the moving image compositing system 100M has projectors 60R and 60L.

The projectors 60L and 60R project images toward the side walls 10L and 10R, respectively.
It is attached to the ceiling of the room 10 (see FIG. 6). Projectors 60L, 60R with side walls 10L and 10R
Are not blue screens but white screens 61L and 61R (see FIGS. 5 and 6).

From the projectors 60R and 60L, an image D, that is, an image in which a background image, model data, and subtitle data are synthesized is projected. Therefore, in the moving image composition system 100M, the user's line of sight
It is defined by the caption displayed on L or 61R. The position of the caption may be corrected based on information such as the height of the user as in the case of the first embodiment, or the position correction in the image projected by the projectors 60L and 60R is performed by processing. Since it becomes complicated, the correction based on the height may not be performed.

In order to prevent the screens 61L and 61R from entering the angle of view of the camera 4C when the camera 4C is at the center position shown in FIG. 5, shielding plates 6L and 6R are provided. The surfaces of the shielding plates 6L and 6R on the camera 4C side are blue screens. Note that the camera 4C moves on the rail 1. At this time, the screen falls within the angle of view of the camera 4C. For example, the camera 4C is connected to the side wall 1 of FIG.
When moving to the 0L side, the screen 61R enters the angle of view of the camera 4C. However, if the camera is moved so that the user's face is always photographed, the camera 4C may
The user moves to the side when the user is facing the side wall 10L side, in which case it is not necessary to project the image D on the screen 61R. For this reason, when the camera 4C is moved from the position shown in FIG. 5 to the side wall 10L, the image D is not projected on the screen 61R, but a blue image is projected. Although the screen 61R is a white screen, by projecting a blue image on the screen 61R, the screen 61R does not affect the chroma key processing. Even when the camera 4C moves to the side wall 10R, the screen 61 is moved for the same reason as described above.
A blue image is projected on L instead of the image D.

The moving image compositing process of the moving image compositing system 100M is the same as that of the first embodiment, and the description is omitted here.

The moving picture synthesizing system 10 according to the second embodiment
0M has a simpler configuration than the first embodiment by using the projectors 60R and 60L. Although the camera 4C is movable, even if the position is fixed, if the shooting is advanced while switching between the cameras 4L and 4R, it is possible to shoot a video that has been sufficiently converted. If the camera 4C is fixed in position, the rail 1
Is unnecessary, so that the whole moving image system 100M can have a compact structure.

As described above, according to the moving image composing system of the present invention, it is possible to compose a moving image in which a user moves in a background image (moving image) without discomfort. It is possible to synthesize an image as if actually interacting with another person acting in the background image.
At this time, the user's line of sight can be surely directed toward the co-star, and the dialog can be reliably notified to the user.

[Brief description of the drawings]

FIG. 1 is a top view illustrating a configuration of a moving image synthesis system according to a first embodiment of the present invention.

FIG. 2 is a side view showing a configuration of the moving image composing system of FIG. 1;

FIG. 3 is a block diagram illustrating a control system of the moving image synthesis system.

FIG. 4 is a flowchart illustrating an operation of the moving image synthesis system.

FIG. 5 is a top view illustrating a configuration of a moving image synthesis system according to a second embodiment of the present invention.

FIG. 6 is a side view showing an example of the configuration of the moving picture composition system of FIG. 5;

FIG. 7 is a diagram illustrating an example of an image L captured by a camera 4L.

FIG. 8 is a diagram illustrating an example of an image C captured by a camera 4C.

FIG. 9 is a diagram illustrating an example of an image R captured by a camera 4R.

FIG. 10 is a diagram illustrating an example of an image D output from a workstation to a confirmation monitor.

FIG. 11 is a diagram illustrating an example of an image A input to a workstation from a background image input unit.

FIG. 12 is a diagram illustrating an example of an image B in which a user's video and a background image are combined.

[Explanation of symbols]

 REFERENCE SIGNS LIST 100 moving image synthesizing system (first embodiment) 100M moving image synthesizing system (second embodiment) 2 synthesizing workstation 3 video tape recorder 4C, 4R, 4L camera 5C, 5R, 5L confirmation monitor 7 subtitle pointer 8 Position Pointer 11 Switch Panel 11C Charge Detector 20 Background Image Input Means 30 Control Means 40 Drive Means 60R, 60L Projector 61R, 61L Projector Screen

Claims (16)

[Claims] 1. A background moving image reproducing unit that reproduces a background moving image that is a background of an image to be combined, a photographing unit that captures a user image, and a background moving image that combines the background moving image and the user image Image synthesis means, a movement position instructing means for instructing a movement position of the user during shooting of the video of the user, and a recording means for recording a composite image of the video of the user and the background moving image. Moving image synthesis system. 2. A background moving image reproducing means for reproducing a background moving image serving as a background of an image to be synthesized, a photographing means for photographing a user image, and a background moving image for synthesizing the background moving image and the user image Image synthesizing means, and display means for displaying the dialogue of the user as a caption at a position where the user's line of sight is oriented in an appropriate direction in the image to be synthesized, while capturing the video of the user, A moving image synthesizing system, comprising: recording means for recording a composite image of a user's video and the background moving image. 3. A background moving image reproducing means for reproducing a background moving image as a background of an image to be synthesized, a photographing means for photographing a user image, and a background moving image for synthesizing the background moving image and the user image Image synthesizing means, moving position instructing means for instructing a moving position of the user during shooting of the image of the user, and speech of the user during shooting of the image of the user, A moving image synthesizing system, comprising: display means for displaying captions at a position where the user's line of sight is directed in an appropriate direction; and recording means for recording a composite image of the user's video and the background moving image. 4. A background moving image reproducing means for reproducing a background moving image serving as a background of an image to be synthesized, a photographing means for photographing a user image, a background moving image for synthesizing the background moving image and the user image An image synthesizing unit; a line-of-sight position instructing unit that guides a position of the user's line of sight so that the user's line of sight is directed to an appropriate direction in the synthesized image while capturing the image of the user; A moving image synthesizing system, comprising: a recording unit that records a synthetic image of a user's video and the background moving image. 5. The moving picture synthesizing system according to claim 4, wherein said line-of-sight position indicating means also serves as caption display means for displaying a dialogue spoken by a user as captions. 6. The information processing apparatus according to claim 1, further comprising a predetermined information input unit, wherein the position of the user's line of sight indicated by the line of sight position display unit is corrected based on the information input by the predetermined information input unit. The moving picture synthesizing system according to claim 4. 7. The apparatus according to claim 6, further comprising calculating means for calculating a position of the user's line of sight indicated by said line of sight position specifying means based on information input by said predetermined information inputting means. Moving image synthesis system according to 1. 8. The moving image composing system according to claim 6, wherein the information input by said predetermined information input means is the height of said user. 9. The moving image composing system according to claim 1, wherein the background moving image synthesizing unit synthesizes the image of the user and the background moving image by chroma key processing. 10. The background moving image reproducing means is capable of reproducing a plurality of types of background images respectively corresponding to a plurality of scenes, and is provided for a user to select a desired moving image from the plurality of types of background moving images. 10. The moving image composing system according to claim 1, further comprising a selecting unit. 11. The moving image composing system according to claim 1, further comprising a composite image reproducing unit for reproducing the composite image recorded in said recording unit. 12. The moving image composing system according to claim 1, further comprising a plurality of display devices for displaying at least the background image during photographing of the user. 13. The photographing means has a plurality of cameras,
13. The moving image composing system according to claim 1, wherein at least one of the plurality of cameras is movable. 14. The moving picture synthesizing system according to claim 1, further comprising audio reproducing means for reproducing an audio corresponding to the background image. 15. The moving picture synthesizing system according to claim 1, further comprising a voice input unit for inputting a voice of the user during the photographing of the user. 16. The moving picture composing system according to claim 1, wherein said recording means has a video tape recorder.