JP5089459B2 - Video system with past video reference function, video information processing method, program, and recording medium - Google Patents

Description

  The present invention relates to a video system, a video information processing method, a program, and a recording medium.

Conventionally, a video conference system has been developed. By using the video conference system, video / audio can be transmitted and received between two or more remote conference rooms. (See, for example, Patent Document 1).
Japanese Patent Laid-Open No. 10-285567

On the other hand, a past conference (hereinafter referred to as “past conference”) that has been performed using the video conference system may be recorded, and a review or the like may be performed while playing back the recorded video of the conference. In addition, a meeting in which such a review or the like is performed (hereinafter referred to as a “review meeting”) may be photographed including the display area of the display unit where the past meeting is displayed. In addition, the contents of the review meeting taken may be viewed later.
However, generally, when the video displayed on the display unit is further photographed, the image quality is deteriorated. Therefore, even if the captured video is viewed later, the contents of the past video displayed in the display area of the display unit included in the captured video are not well understood. There is a problem that the contents cannot be properly understood.
That is, even if the contents of the review meeting are photographed and viewed later, the contents of the past meeting discussed in the review meeting are not well understood, and there is a problem that the contents of the review meeting cannot be properly understood.

  The present invention has been made to solve the above-described problem, and an image that enables a better understanding of the contents of past images displayed in the display area of the display unit included in the captured image. It is an object to provide a system, a video information processing method, and a program.

The present invention has been made to solve the above-described problems, and includes a first video information storage unit that stores first video information that is information indicating a captured video, and displays the first video information. the first display section and the second image information storing unit for the first image information storing second image information obtained by photographing a scene including a display area of the first display portion that appears to be When, by using the synchronization information between images, the display area of the first display unit in the second image information, a second outputting a second synthesized image information obtained by combining the first image information A third image obtained by photographing a scene including an information combining unit, a second display unit that displays the second combined video information, and a display area of the second display unit on which the second combined video information is displayed. a third video information storage unit for storing video information, using the synchronization information among the video, the third The display area of the second display unit in the image information, and a third information synthesizing unit for outputting a third combined video information obtained by combining the second synthetic image information, said second display unit In the process of synthesizing the second synthesized video information with the display area, the first video information is synthesized with the display area of the first display unit in the second video information.

According to another aspect of the present invention, the second video information storage unit stores video information excluding a display area of the first display unit among the second video information, and the third video information. A memory | storage part memorize | stores the video information except the display area of a said 2nd display part among 3rd video information.

According to another aspect of the present invention, the synchronization information is information using a video time code.

According to another aspect of the present invention, a display step of displaying first video information that is information indicating a captured video on a first display unit, and the first video information on which the first video information is displayed. A second video information storing step for storing second video information for capturing a scene including a display area of the display unit, and synchronization information between videos, and the first display unit in the second video information. A second information synthesis step of outputting second synthesized video information obtained by synthesizing the first video information, a second display step of displaying the second synthesized video information, and the second display step. Using a third video information storage step for storing third video information for capturing a scene including a display area of the second display unit on which the composite video information of 2 is displayed, and synchronization information between the videos, Display area of the second display section in the third video information A third information synthesis step of outputting third synthesized video information obtained by synthesizing the second synthesized video information, and the second synthesized video information in a display area of the second display unit. In the process of combining the first video information, the first video information is combined with the display area of the first display unit in the second video information.

  According to the present invention, it is possible to synchronize the display time of the past video and the shooting time of the video, and by synthesizing the synchronized past video with the shot video, Since it is possible to output a composite video that is a captured video including the video, it is possible to more appropriately understand the content of the captured video.

Hereinafter, an image system according to the present invention will be described using embodiments.
In the following embodiments, components and steps denoted by the same reference numerals are the same or equivalent, and repetitive description may be omitted.

(First embodiment)
A video conference system (video system) according to a first embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing the configuration of the video conference system according to the present embodiment. 1, the video conference system according to the present embodiment includes a video information storage unit 11, a display unit 12, a photographing unit 13, a video information reception unit 14, a video information storage unit 15, and a synchronization information management unit 16. , An information synthesis unit 17, a display 18, and a display 19.

The video information storage unit 11 stores first video information that is information indicating a video.
The first video information is a video obtained by photographing a meeting scene. This meeting is, for example, a meeting for discussing the first video information.
This video may be a video taken in a video conference system or the like having a communication function, or may be a video simply taken of a meeting scene without using the communication function. In the former case, the video indicated by the first video information may include video of two or more conference scenes connected via a communication line, or only video of one of the conference scenes. It may be.
A meeting includes a situation where two or more people talk in two directions. Accordingly, not only so-called business meetings, but also situations where housewives and friends are talking are included in the meeting. In addition, it is assumed that the conference includes a format in which the presenter provides information to the information recipient, such as a seminar or lecture.

It is preferable that the first video information is configured so that an arbitrary temporal position (for example, an arbitrary frame) of the video can be designated. For example, in the first video information, it may be possible to specify an arbitrary temporal position of the video using a time code, and an arbitrary temporal position of the video may be specified using an elapsed time from the top of the video. It may be possible to designate, or other temporal ID of the video may be designated using other frame IDs or the like.
Here, the time code is an electric signal obtained by encoding time and time information, for example, an electric signal given for each frame of video information.
Further, the first video information may or may not include information indicating the temporal position of the video. The information indicating the temporal position of the video may indicate, for example, the relative temporal position of the video as long as the temporal position of the video can be specified, or the absolute position of the video. It may indicate a time position.

  In the present embodiment, it is assumed that the first video information includes a time code as information indicating a temporal position. The first video information may or may not include audio information. Further, the first video information may be digital data or analog data.

  The video information storage unit 11 is realized by a predetermined recording medium (for example, a semiconductor memory, a magnetic disk, an optical disk, etc.). The process in which the first video information is stored in the video information storage unit 11 does not matter. For example, the first video information may be stored in the video information storage unit 11 via a recording medium, and the first video information transmitted via a communication line or the like is stored in the video information storage unit 11. Alternatively, the first video information input via the input device may be stored in the video information storage unit 11. Storage in the video information storage unit 11 may be temporary storage in a RAM (Random Access Memory) or the like of video information read from an external storage device or the like, or may be long-term storage.

  The display unit 12 displays the first video information stored in the video information storage unit 11. In addition, when audio information is included in the first video information, the display unit 12 may display the first video information and output the audio information as audio. The display unit 12 may or may not include a display device (for example, a CRT (Cathode Ray Tube) or a liquid crystal display) or a speaker that performs display.

  In the present embodiment, the display unit 12 displays the first video information on the display 18. The display unit 12 may be realized by hardware, or may be realized by software such as a driver that drives a display device.

  The image capturing unit 13 captures a scene including a display area of the display unit 12 on which the first video information is displayed, which is a meeting scene in which the display unit 12 displays the first video information. The imaging unit 13 is a camera that captures an image, for example, and uses an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor: Complementary Metal Oxide Semiconductor), for example. Shoot. When the imaging unit 13 also acquires audio information, the imaging unit 13 may include a microphone, for example.

The video information receiving unit 14 receives second video information from the imaging unit 13. Here, the second video information is a meeting scene in which the display unit 12 displays the first video information, and includes a scene including a display area of the display unit 12 on which the first video information is displayed. This is information indicating the video imaged by the imaging unit 13.
It is preferable that the second video information is configured so that an arbitrary temporal position (for example, an arbitrary frame) of the video can be designated. For example, in the second video information, it may be possible to specify an arbitrary temporal position of the video using a time code, and an arbitrary temporal position of the video may be specified using an elapsed time from the top of the video. It may be possible to designate, or other temporal ID of the video may be designated using other frame IDs or the like.
Further, the second video information may or may not include information indicating the temporal position of the video.

  In the present embodiment, it is assumed that the second video information includes a time code as information indicating a temporal position. This second video information may or may not include audio information. The sound information may be received by a microphone of the photographing unit 13 or may be received by another microphone (not shown). The second video information may be digital data or analog data.

  Here, this acceptance may be, for example, a wired or wireless communication line (for example, the Internet, an intranet, a LAN, or the like, or an IEEE 1394 cable, a dedicated cable for transmitting video information, or the like). Information received via a predetermined recording medium (for example, an optical disk, a magnetic disk, a semiconductor memory, etc.) may be received.

  In the present embodiment, the video information receiving unit 14 receives second video information captured by the imaging unit 13 via a communication line. Note that the video information receiving unit 14 may or may not include a device for receiving (for example, a modem or a network card). Further, the video information receiving unit 14 may be realized by hardware, or may be realized by software such as a driver that drives a predetermined device.

The video information storage unit 15 stores at least a part of the second video information received by the video information reception unit 14 in a predetermined recording medium. The recording medium is, for example, a semiconductor memory, an optical disk, a magnetic disk, or the like, and may be included in the video information storage unit 15 or may exist outside the video information storage unit 15. Further, this recording medium may or may not temporarily store the second video information.
In the present embodiment, the video information storage unit 15 stores all of the second video information received by the video information reception unit 14.

The synchronization information management unit 16 synchronizes the display time point of the first video information on the display unit 12 and the shooting time point of the second video information that is the video of the meeting scene in which the first video information is displayed. Create and store synchronization information, which is information indicating. With this synchronization information, it is possible to know the temporal position of the first video information displayed at the conference when the video at the desired temporal position of the second video information is captured.
Here, the synchronization information may not be information indicating the synchronization between the display time of the first video information and the shooting time of the second video information in a strict sense. For example, it may be information indicating the synchronization between the display time of the first video information and the storage time of the second video information. This is because it is considered that the shooting time of the second video information and the storage time of the second video information are almost the same time. Creating the synchronization information may be creating new information, or by reading or acquiring information included in the synchronization information from a predetermined memory or register. There may be.

  The synchronization information management unit 16 receives information indicating the temporal position of the first video information displayed by the display unit 12 and information indicating the temporal position of the second video information stored by the video information storage unit 15. The synchronization information may be created using information indicating the temporal position of the first video information and information indicating the temporal position of the second video information.

  Hereinafter, a specific example of this synchronization information will be described. This synchronization information may be (1) information configured separately from the first video information and the second video information, or (2) may be information included in the first video information. It may be (3) information included in the second video information, or (4) information included in the first video information and the second video information.

(1) When the synchronization information is different from the first video information and the second video information In this case, the synchronization information includes, for example, information indicating the temporal position of the video in the first video information, It may be information that associates information indicating the temporal position of the video in the second video information.
Specifically, the synchronization information may be information associating the time code of the first video information with the time code of the second video information, the time from the head of the first video information, the second It may be information associating with the time from the beginning of the video information, or other information.

  In addition, the synchronization information may be, for example, information that associates all the frames of the first video information and the second video information, and specifies the first video information and the second video information. May be information that associates one or more frames (for example, each synchronized first frame). In the former case, the first video information and the second video information are also displayed when the first video information is displayed while being played back at a high speed during the shooting of the second video information. It is possible to properly synchronize the video information. On the other hand, in the latter case, it is assumed that the first video information and the second video information are played and recorded at the same speed except for a specific frame, but the data amount of the synchronization information is reduced. can do.

In this embodiment, as in this case, the synchronization information management unit 16 creates synchronization information that associates the time code of the first video information with the time code of the second video information.
In the case of (1), the synchronization information is stored in a predetermined recording medium included in the synchronization information management unit 16 or other components. This recording medium is, for example, a semiconductor memory, an optical disk, a magnetic disk, or the like. Further, this recording medium may or may not store the synchronization information temporarily.

(2) When the synchronization information is included in the first video information In this case, the synchronization information is, for example, information indicating the temporal position of the video in the second video information, and the information is the first video information. It may be included in the corresponding frame in the video information. In such a case, when the first video information is being reproduced, the synchronization information is added to the first video information.
This synchronization information may also be information for associating all the frames of the first video information and the second video information, and one or more specific ones of the first video information and the second video information. (For example, each synchronized first frame) may be information.

(3) When the synchronization information is included in the second video information Contrary to the case of (2) above, the synchronization information is information indicating the temporal position of the video in the first video information, for example. Information may be included in a corresponding frame in the second video information. In such a case, when the second video information is stored, the second video information including the synchronization information is stored.
This synchronization information may also be information for associating all the frames of the first video information and the second video information, and one or more specific ones of the first video information and the second video information. (For example, each synchronized first frame) may be information.

(4) When the synchronization information is included in the first video information and the second video information In this case, the synchronization information is, for example, for associating the first video information with the second video information. Information, and the synchronization information may be included in the corresponding first video information frame and second video information frame, respectively. Therefore, in the first video information and the second video information, a frame including the same synchronization information is a synchronized frame.
This synchronization information may also be information for associating all the frames of the first video information and the second video information, and one or more specific ones of the first video information and the second video information. (For example, each synchronized first frame) may be information.

  When the synchronization information is included in the second video information, the function of storing the synchronization information of the synchronization information management unit 16 and the function of storing the second video information of the video information storage unit 15 are: It may be configured as a single unit or may be configured separately. When the synchronization information is included in the first video information, the synchronization information management unit 16 adds the synchronization information to the first video information stored in the video information storage unit 11.

  The information combining unit 17 uses the first video information stored in the video information storage unit 11 and the second video information stored in the video information storage unit 15 as synchronization information stored in the synchronization information management unit 16. And synthesizing video information that is information indicating a video obtained by synthesizing the first video information in the display area of the display unit 12 in the second video information.

Here, creation of composite video information will be described. First, the information synthesizing unit 17 detects the display area of the first video information in the second video information. Then, the information synthesizing unit 17 synthesizes the first video information synchronized with the second video information in the detected display area.
The display area of the first video information in the second video information can be detected as follows, for example.
As shown in FIG. 2, the information synthesizing unit 17 uses the first video information frame that is synchronized with the second video information frame, and uses the first video information frame in the second video information frame. The display area may be detected by detecting an area that matches the frame using a technique such as pattern matching.

Further, as shown in FIG. 3, the information synthesizing unit 17 may accept designation of a display area input by a user or the like with an input device and detect the designated display area. In general, since people do not move much in a meeting, it is considered that the position of the display area does not change much when shooting the meeting, and such a method is also effective.
In addition, the information compositing unit 17 detects the display area, which is the area inside the frame, by detecting four points of the frame of the display 18 and the like on which the first video information is displayed and the corners of the frame. Also good. Predetermined colors, patterns, markers, etc. are arranged on the frame of the display 18 and the four corners of the frame so that the frame of the display 18 and the corners of the frame can be detected. May be. The predetermined color is preferably a color that is not generally used in a meeting scene. The marker may be, for example, an optical marker used in motion capture or the like. Further, the method of detecting the display area is not limited to these methods, and other methods may be used.

The synthesis of the first video information to the display area of the first video information detected in the second video information can be performed as follows, for example.
The information synthesizing unit 17 transforms the first video information so as to be the size of the detected display area in the second video information. For example, when the display area is smaller, the first video information is reduced and the resolution is the same as the second video information.
In addition, in the second video information, when the first video information is not taken from the front but is taken obliquely, the display area is not a strict rectangle but a rhombus, a trapezoid, or the like. . In that case, the information composition unit 17 transforms the first video information so that the first video information matches the shape of the detected display area.

  When the first video information is synthesized with the second video information, the synthesis may be performed as layer synthesis. In that case, since the layer of the second video information is included in the synthesized video information, not only the synthesized video information but also the second video information can be viewed using the synthesized video information.

When audio information is included in at least one of the first video information and the second video information, the information synthesis unit 17 may output synthesized video information including audio information. In this case, the audio information included in the synthesized video information may be the audio information of the first video information, the audio information included in the second video information, or both audio information. May be.
Here, this output may be, for example, display on a display device (for example, a CRT or a liquid crystal display), audio output to a speaker, transmission via a communication line to a predetermined device, or accumulation in a recording medium. But you can. The information synthesizing unit 17 may or may not include an output device (for example, a display device or a communication device) and a speaker.

In the present embodiment, the information composition unit 17 displays the composite video information on the display 19. The information synthesizing unit 17 may be realized by hardware, or may be realized by software such as a driver that drives these devices.
Further, the video information storage unit 11 and the recording medium on which the video information storage unit 15 stores the second video information may be the same recording medium or may be separate recording media. In the former case, for example, the area where the first video information is stored is the video information storage unit 11.

  Next, the operation of the video conference system according to the present embodiment will be described with reference to the flowchart of FIG. Note that the operation of the video conference system according to the present embodiment is not limited to that shown in the flowchart of FIG.

  (Step S101) The display unit 12 determines whether or not a meeting for displaying the first video information is started. For example, when an instruction to display the first video information is input, the display unit 12 may determine that a meeting for displaying the first video information is started. If the conference is started, the process proceeds to step S102. If not, the process proceeds to step S103.

(Step S102) The display unit 12 and the like display the first video information, store the second video information, create and store synchronization information, and the like. Then, the process returns to step S101.
Details of the processing in step S102 will be described later with reference to the flowchart of FIG.

  (Step S103) The information composition unit 17 determines whether to display the second video information. For example, when an instruction to display the second video information is input, it may be determined to display the second video information. If the second video information is displayed, the process proceeds to step S104. If not, the process returns to step S101.

(Step S104) The information synthesizing unit 17 synthesizes the first video information with the second video information using the synchronization information, and displays the synthesized video information after the synthesis on the display 19. Then, the process returns to step S101. Details of the processing in step S104 will be described later with reference to the flowchart of FIG.
In the flowchart of FIG. 4, the process ends when the power is turned off or the process ends. Moreover, although the case where the display unit 12 performs the determination in step S101 has been described, the determination in step S101 may be performed by other components.

FIG. 5 is a flowchart showing details of the process in step S102 in the flowchart of FIG.
(Step S201) The display unit 12 sets a counter i to 1.
(Step S202) The display unit 12 determines whether or not the i-th frame is present in the first video information stored in the video information storage unit 11. If it exists, the process proceeds to step S203, and if not, the process returns to the flowchart of FIG.

(Step S <b> 203) The display unit 12 reads the i-th frame of the first video information from the video information storage unit 11.
(Step S204) The display unit 12 displays the i-th frame of the first video information on the display 18. In addition, when audio information is included in the first video information, the display unit 12 outputs the audio information as audio.

(Step S205) The synchronization information management unit 16 acquires a time code corresponding to the i-th frame displayed by the display unit 12. The synchronization information management unit 16 temporarily holds the acquired time code in a recording medium (not shown).
(Step S206) The video information receiving unit 14 receives a frame of the second video information captured by the imaging unit 13. The second video information may include audio information.
(Step S207) The video information storage unit 15 stores the frames of the second video information received by the video information reception unit 14 in a predetermined recording medium.

(Step S208) The synchronization information management unit 16 acquires a time code corresponding to the frame of the second video information stored in the video information storage unit 15. The synchronization information management unit 16 temporarily holds the acquired time code in a recording medium (not shown).
(Step S209) The synchronization information management unit 16 is synchronization that is information that associates the time code of the first video information temporarily stored with the time code of the second video information in Step S205 and Step S208. Create information.
(Step S210) The synchronization information management unit 16 stores the created synchronization information in a predetermined recording medium.
(Step S211) The display unit 12 increments the count i by one.
Then, the process returns to step S202.

FIG. 6 is a flowchart showing details of the process of step S104 in the flowchart of FIG.
(Step S301) The information synthesizer 17 sets the counter j to 1.
(Step S <b> 302) The information composition unit 17 determines whether or not the j-th frame exists in the second video information accumulated by the video information accumulation unit 15. If it exists, the process proceeds to step S303, and if not, the process returns to the flowchart of FIG.

(Step S303) The information composition unit 17 reads the j-th frame in the second video information stored in the video information storage unit 15.
(Step S304) The information synthesizer 17 acquires a time code corresponding to the read j-th frame.
(Step S305) The information composition unit 17 uses the synchronization information accumulated by the synchronization information management unit 16 to acquire the time code in the first video information corresponding to the time code of the j-th frame in the second video information. To do.

(Step S306) The information composition unit 17 reads the frame of the first video information corresponding to the time code from the video information storage unit 11, using the time code in the acquired first video information.
(Step S307) The information composition unit 17 detects the display area of the display unit 12 displaying the first video information in the j-th frame of the second video information.
(Step S308) The information synthesizer 17 synthesizes the read frame of the first video information with the detected display area. In this way, a frame of composite video information is created.

(Step S309) The information synthesizer 17 outputs synthesized video information.
(Step S310) The information synthesizer 17 increments the counter j by 1. Then, the process returns to step S302.

Next, the operation of the video conference system according to the present embodiment will be described using a specific example.
In this specific example, it is assumed that the video information storage unit 11 stores the first video information shown in FIG. In the first video information, it is assumed that the time code “10: 00: 00: 00” or the like is assigned in order from the first frame.

First, the process in which the second video information and the synchronization information are accumulated will be described.
Assume that the user operates a predetermined input device connected to the video conference system and inputs an instruction to start a conference. Then, the display part 12 judges that a meeting is started (step S101).
First, the synchronization information management unit 16 stores the video ID for identifying the first video information and the video ID for identifying the second video information in association with each other in the synchronization information. Assume that the video ID of the first video information is “V001” and the video ID of the second video information is “V002”.

Thereafter, the first frame of the first video information identified by the video ID “V001” stored in the video information storage unit 11 is read and displayed on the display 18 (steps S201 to S204).
In addition, the display unit 12 passes the first frame of the first video information including the time code “10: 00: 00: 00” to the synchronization information management unit. In this way, the synchronization information management unit 16 acquires the time code corresponding to the frame from the first frame of the first video information (step S205).
The photographing unit 13 photographs a meeting scene and passes the photographed second video information to the video information receiving unit 14. The video information receiving unit 14 receives the second video information frame and passes it to the video information storage unit 15 (step S206).

The video information storage unit 15 stores the frame of the second video information as second video information identified by the video ID “V002” in a predetermined recording medium (step S207).
In addition, the video information storage unit 15 passes the frame of the stored second video information including the time code to the synchronization information management unit 16.
In this way, the synchronization information management unit 16 acquires the time code corresponding to the frame from the frame of the second video information (step S208). Here, it is assumed that the time code is “0: 15: 00: 00”.
The synchronization information management unit 16 creates synchronization information that associates the time code of the displayed first video information with the time code of the captured second video information (step S209), and stores it in a predetermined recording medium. (Step S210).

The synchronization information accumulated in this way is the first record of the time code in the synchronization information shown in FIG. In FIG. 8, the video ID “V001” of the first video information and the video ID “V002” of the second video information are associated with each other.
In this manner, the second video information and the synchronization information are repeatedly stored until there is no first video information frame (steps S202 to S211).

As a result, the second video information stored in the video information storage unit 15 is as shown in FIG. In the second video information, a time code “00:15:00: 00” or the like is assigned in order from the first frame. The synchronization information accumulated by the synchronization information management unit 16 is as shown in FIG.
Note that the flowchart of FIG. 5 shows a case where the accumulation of the second video information and the accumulation of the synchronization information are repeated until there is no frame of the first video information, but the second video information is accumulated. In response to the reception of the instruction to end the second video information, the second video information storage and the synchronization information storage are ended regardless of whether or not the first video information frame is lost. Good.

Next, a process for displaying composite video information, which is video information obtained by combining the first video information with the second video information using the synchronization information, will be described. It is assumed that the user operates a predetermined input device connected to the video conference system and inputs an instruction to start displaying the second video information corresponding to the video ID “V002”. Then, the information synthesizing unit 17 determines to start displaying the synthesized video information (step S103).
First, the information compositing unit 17 reads the first frame of the second video information shown in FIG. 9 corresponding to the video ID “V002” (steps S301 to S303), and corresponds to the first frame. The time code “00: 15: 00: 00” to be acquired is acquired (step S304).

The information composition unit 17 refers to the synchronization information shown in FIG. 8 and performs a search using the time code “00: 15: 00: 00” of the acquired second video information (video ID: V002) as a key. The time code “1: 00: 00: 00” of the first video information (video ID: V001) corresponding to the time code “00: 15: 00: 00: 00” of the second video information is acquired (step S305). ).
Then, the information synthesizing unit 17 reads out a frame corresponding to the time code “1: 00: 00: 00” from the first video information shown in FIG. 7 stored in the video information storage unit 11 ( Step S306).

Thereafter, the information synthesizing unit 17 detects a display area in which the first video information is displayed in the first frame of the second video information (step S307).
Then, the information synthesizing unit 17 synthesizes the read first video information frame with the detected display area (step S308).
In this synthesis, the resolution of the first video information to be synthesized may be changed so as to match the resolution of the second video information. In addition, when the first video information displayed in the first frame of the second video information is not in the frontal direction but in an oblique direction, the first video information is matched to the direction. May be modified.

The information synthesizing unit 17 outputs a frame of synthesized video information obtained by synthesizing the frame of the first video information with the frame of the second video information (step S309).
In this way, until the frame of the video information of the measure 2 disappears, the synthesis of the first video information frame and the second video information frame synchronized with each other and the output of the synthesized video information are repeated. This is to be performed (steps S302 to S310).

FIGS. 10 and 11 are diagrams for comparing the second video information frame and the synthesized video information frame output by the information synthesis unit 17. FIG. 10 is a diagram showing a frame of the second video information, and FIG. 11 is a diagram showing a frame of the composite video information.
As shown in FIG. 10, in the frame of the second video information obtained by photographing the first video information displayed on the display 18, the display of the first video information becomes blurry and clearly. It is not.
On the other hand, as shown in FIG. 11, in the synthesized video information output from the information synthesizing unit 17, the display area of the first video information in the frame of the second video information is replaced with the first video information. Therefore, the display of the first video information is also clear.

Note that the flowchart of FIG. 6 shows the case where the output of the composite video information frame is repeated until there is no second video information frame, but in response to the reception of an instruction to end the display. The display of the first video information frame and the second video information frame may be terminated regardless of whether or not the second video information frame disappears.
Further, in this specific example, the output of audio has not been described. However, as described above, when the audio information is included in the video information, the display unit 12 and the information synthesis unit 17 output the audio information. May be performed. In that case, the information synthesizer 17 may output the audio information of the first video information, may output the audio information of the second video information, or may output both.

Further, as described above, the synchronization information may be included in the first video information. For example, as shown in FIG. 12, the synchronization information may be included in each frame of the first video information.
In FIG. 12, the time code “0:15:00” of the video ID “V002” and the video ID “V003” are included in the frame of the time code “10: 00: 00: 00” of the first video information. The time code “0: 30: 00: 00” is included as synchronization information. With this synchronization information, the time code “0:15:00: of the second video information identified by the video ID“ V002 ”is added to the frame of the time code“ 10: 00: 00: 00 ”of the first video information. It is indicated that the frame of “00” and the frame of the time code “0: 30: 00: 00” of the second video information identified by the video ID “V003” are synchronized. This synchronization information may be added to the first video information when the first video information is displayed in the conference.

  Also, as shown in FIG. 12, the synchronization information includes one first video information and two or more second video information (video information identified by video ID “V002” in FIG. 12). , Two pieces of video information with the video information identified by the video ID “V003”) may be associated with each other. This is because even in such a case, the frame of the first video information corresponding to an arbitrary frame of the second video information can be specified by using the synchronization information. As a situation in which two or more pieces of second video information are synchronized with one piece of first video information, for example, the first video information is displayed twice or more, and the first video information is displayed. It is possible that the scenes of two or more meetings that have been taken are photographed as two or more pieces of second video information.

  Further, as described above, the synchronization information may be included in the second video information. For example, as shown in FIG. 13, the synchronization information may be included in each frame of the second video information. In FIG. 13, the time code “00:00:00” of the video ID “V001” is included as synchronization information in the frame of the time code “0: 15: 00: 00” of the second video information. . With this synchronization information, the frame of the second video information time code “0: 15: 00: 00” and the first video information time code “1: 00: 00: 00” identified by the video ID “V001”. It is shown that the frame of “00” is synchronized. This synchronization information may be recorded in the second video information when the second video information is accumulated.

Further, as described above, the synchronization information may be included in the first video information and the second video information. For example, as shown in FIGS. 14 and 15, the synchronization information may be included in each frame of the first video information and each frame of the second video information.
In FIG. 14 and FIG. 15, the synchronization information “syn001-001” is included in the frame of the time code “10: 00: 00: 00” of the first video information, and the time code “0” of the second video information. : 15:00: 00 includes synchronization information “syn001-001”, which indicates that both frames are synchronized. This synchronization information may be added to the first video information when the first video information is displayed in the conference, and may be recorded in the second video information when the second video information is accumulated.

  As described above, according to the video conference system according to the present embodiment, it is possible to synchronize the display time of the video of the past conference and the shooting time of the video of the conference held while watching the past conference, It is possible to output composite video information obtained by combining both videos. As a result, it becomes possible to more appropriately understand the contents of the meetings held while looking at past meetings.

(Second Embodiment)
Hereinafter, a video conference system (video system) according to a second embodiment of the present invention will be described with reference to the drawings.
In the present embodiment, the video information storage unit 25 detects the display area, which has been performed by the information synthesis unit 17 according to the first embodiment. On the other hand, the information synthesizing unit 27 synthesizes video information using the detection result of the video information storage unit 25 without performing this detection.

  FIG. 16 is a diagram showing the configuration of the video conference system according to the present embodiment. When this embodiment (FIG. 16) is compared with the first embodiment (FIG. 1), the video information storage unit 25 and the information composition unit 27 are different. However, the functions of other components (video information storage unit 11, display unit 12, imaging unit 13, video information reception unit 14, synchronization information management unit 16, display 18, and display 19) are the same as those in the first embodiment. Since it is the same, description of the same function as 1st Embodiment is abbreviate | omitted.

The video information storage unit 25 detects the display area of the first video information in the second video information received by the video information reception unit 14.
The video information storage unit 25 detects the display area of the first video information in the second video information in the same manner as the information synthesis unit 17 according to the first embodiment. For example, the video information storage unit 25 receives detection using a technique such as pattern matching or designation of a display area input by a user or the like using an input device, and detects the designated display area to detect the first video. Detect information display area. Further, the method of detecting the display area is not limited to these methods, and other methods may be used.

The video information storage unit 25 may store the second video information received by the video information reception unit 14 and the information of the display area of the detected first video information in a predetermined storage medium, or Of the second video information received by the information receiving unit 14, second video information excluding the display area of the detected first video information may be accumulated. Here, excluding the display area means, for example, that the video information in the display area is set to a predetermined specific value.
Note that this recording medium is, for example, a semiconductor memory, an optical disk, a magnetic disk, or the like, and may be included in the video information storage unit 25 or may exist outside the video information storage unit 25. Further, this recording medium may or may not temporarily store the second video information.

FIG. 17 is a diagram for describing an example of video information in the present embodiment.
FIG. 17A shows second video information excluding the display area of the detected first video information from the second video information received by the video information receiving unit 14 by the video information storage unit 25. . FIGS. 17B and 17C show information about the display area of the second video information received by the video information receiving unit 14 and the detected first video information, respectively.
The video information storage unit 25 may store only the video information shown in FIG. 17A, or may store FIGS. 17B and 17C.

In the present embodiment, the video information storage unit 25 stores the second video information obtained by removing the detected display area of the first video information from the second video information received by the video information reception unit 14 (FIG. 17 (a)). That is, the video information storage unit 25 stores video information excluding the display area of the first video information from the second video information received by the video information reception unit 14.
The second video information excluding the first video information display area may or may not include audio information. The video information may be digital data or analog data.

The information synthesizing unit 27 synchronizes the first video information stored in the video information storage unit 11 and at least a part of the second video information using the synchronization information accumulated by the synchronization information management unit 16. Then, composite video information that is information indicating a video obtained by synthesizing the first video information is output to the display area of the display unit 12 in the second video information.
Here, the information synthesizing unit 27 synthesizes the first video information by detecting an area where the first video information is removed from the second video information. For example, the information synthesizing unit 27 detects a display area in which the video information storage unit 25 uses video information as a predetermined value.

  When the video information storage unit 25 stores the second video information received by the video information reception unit 14 and the information of the display area of the detected first video information, the information composition unit 27 Information on the display area of one video information is acquired, and the first video information is combined with this display area.

The information synthesizing unit 27 synthesizes the first video information in the second video information in the same manner as the information synthesizing unit 17 according to the first embodiment. For example, the information synthesizing unit 27 transforms the first video information so as to be the size of the display area detected in the second video information.
In addition, when audio information is included in at least one of the first video information and the second video information, the information synthesis unit 27 may output synthesized video information including audio information. In this case, the audio information included in the synthesized video information may be the audio information of the first video information, the audio information included in the second video information, or both audio information. May be.

  In the present embodiment, the information composition unit 27 displays the composite video information on the display 19. The information synthesizing unit 17 may be realized by hardware, or may be realized by software such as a driver that drives these devices.

Next, the operation of the video conference system according to the present embodiment will be described with reference to the flowchart of FIG. Note that the operation of the video conference system according to the present embodiment is not limited to that shown in the flowchart of FIG. 18 and can be changed without departing from the scope of the present invention.
When this embodiment (FIG. 18) is compared with the first embodiment (FIG. 4), step S402 and step S404 are different. However, since other operations (S101, S103) are the same as those in the first embodiment, description of the same operations as those in the first embodiment is omitted.

(Step S402) The display unit 12 and the like display the first video information, store the second video information, create and store synchronization information, and the like. At this time, the video information storage unit 25 stores the second video information obtained by removing the detected display area of the first video information from the second video information received by the video information reception unit 14. Then, the process returns to step S101.
Details of the process of step S402 will be described later with reference to the flowchart of FIG.

  (Step S404) The information composition unit 27 synthesizes the second video information excluding the display area of the first video information and the first video information using the synchronization information, and the synthesized video information after the synthesis. Is displayed on the display 19. Then, the process returns to step S101. Details of the processing in step S404 will be described later with reference to the flowchart of FIG.

FIG. 19 is a flowchart showing details of the process of step S402 in the flowchart of FIG.
When this embodiment (FIG. 19) is compared with the first embodiment (FIG. 5), step S5071 and step S5072 are different. However, since the other processes (S201 to S206, S208 to S211) are the same as those in the first embodiment, description of the same processes as those in the first embodiment is omitted.

(Step S5071) The video information storage unit 25 detects the display area of the first video information in the frame of the second video information received by the video information receiving unit 14.
(Step S5072) The video information storage unit 25 extracts the second video information frame excluding the detected first video information display area from the second video information frame received by the video information reception unit 14. Accumulate on a predetermined recording medium.

FIG. 20 is a flowchart showing details of the process of step S404 in the flowchart of FIG.
When this embodiment (FIG. 20) is compared with the first embodiment (FIG. 6), step S607 is different. However, since the other processes (S301 to S306, S308 to S210) are the same as those in the first embodiment, description of the same processes as those in the first embodiment is omitted.

(Step S607) The information composition unit 27 detects the display area of the display unit 12 from which the first video information is removed in the j-th frame of the second video information.

As described above, according to the video conference system according to the present embodiment, when the second video information is stored, the display area of the first video information is detected. The load caused by the detection process can be reduced. In addition, if the user of the video conference system confirms the second video information stored before the output of the composite video information, it confirms whether there is an error in the first display area detected by the second video information. can do.
As a result, delay and stop of composite video information output due to load, and loss of video information due to display area errors can be prevented, and as a result, the contents of conferences held while viewing past conferences can be understood more appropriately Will be able to.
In addition, according to the video conference system according to the present embodiment, when the second video information is stored, the display area of the first video information is excluded, so that the capacity of the stored second video information is reduced. can do. For example, when the video information of the removed display area is set to a specific value, when the second video information excluding the display area is compressed, the information of the information is compared with the second video information not excluding the display area. Capacity is reduced. In the second video information, since the video in the display area where the first video information is displayed is not required, there is no problem even if the video information excluding the display area is accumulated.

(Third embodiment)
Hereinafter, a video conference system (video system) according to a third embodiment of the present invention will be described with reference to the drawings.
In the present embodiment, the first video information is synthesized video information obtained by synthesizing two or more pieces of video information. Then, when the first video information is synthesized with the second video information, the second video information is synthesized with two or more pieces of video information before being synthesized as the first video information.

FIG. 21 is a diagram illustrating an example of the synthesis of video information according to the present embodiment.
FIG. 21B is an example of the first video information, and is composite video information obtained by synthesizing video information with the video ID “V001” (FIG. 21A) and video information with the video ID “V002”. Indicates that
FIG. 21C is an example of the second video information. The video information of the video ID “V002” is synthesized with the video information of the video ID “V003”, and further, the video ID “V002”. It indicates that the video information of the video ID “V001” is also synthesized video information through the video information.
For example, each piece of video information is displayed as video information (video ID “V002”) shooting a conference scene displaying video information (video ID “V001”) shooting the conference scene. As video information (video ID “V003”).

  FIG. 22 is a diagram showing the configuration of the video conference system according to the present embodiment. When this embodiment (FIG. 22) is compared with the first embodiment (FIG. 1), the information synthesis unit 32, the synchronization information management unit 36, and the information synthesis unit 37 are different. However, the functions of other components (video information storage unit 11, imaging unit 13, video information receiving unit 14, video information storage unit 15, display 18, and display 19) are the same as those in the first embodiment. The description of the same function as in the first embodiment is omitted. The operation according to the present embodiment is the same as the operation according to the first embodiment (FIGS. 4 to 6).

The information synthesizing unit 32 synthesizes two or more pieces of video information stored in the video information storage unit 11 synchronously using the synchronization information stored in advance in the synchronization information management unit 36, and the synthesized synthesized video information Is output as the first video information.
In addition, when audio information is included in the first video information, the information synthesis unit 32 may display the first video information and output the audio information as audio. In addition, the information synthesis unit 32 may or may not include a display device (for example, a CRT or a liquid crystal display) that performs display and a speaker.

In the present embodiment, the two or more pieces of video information stored in the video information storage unit 11 are set as video information with the video ID “V001” (FIG. 7) and video information with the video ID “V002” (FIG. 9). .
In the present embodiment, it is assumed that the video information of the video ID “V001” and the video information of the video ID “V002” each include a time code as information indicating a temporal position (FIG. 7). FIG. 9).
The video information of the video ID “V001” and the video information of the video ID “V002” may or may not include audio information. Also, the video information of the video ID “V001” and the video information of the video ID “V002” may be digital data or analog data.

  In the present embodiment, the information composition unit 32 displays the first video information on the display 18. The information synthesis unit 32 may be realized by hardware, or may be realized by software such as a driver that drives a display device.

The synchronization information management unit 36 stores in advance synchronization information indicating synchronization at the time of display of two or more pieces of video information stored in the video information storage unit 11.
In addition, the synchronization information management unit 36 displays the first video information display time by the information combining unit 32 and the shooting time of the second video information that is the video of the meeting scene in which the first video information is displayed. Create and store synchronization information indicating synchronization with
The synchronization information management unit 36 creates synchronization information indicating the synchronization between the display time of the first video information and the display time of the second video information in the same manner as the synchronization information management unit 16 according to the first embodiment. Do.
The synchronization information may be information configured separately from (1) the first video information and the second video information, as in the first embodiment. (2) First (3) Information included in the second video information, and (4) Information included in the first video information and the second video information. It may be.

In the present embodiment, the synchronization information management unit 36 stores in advance synchronization information that is information indicating the synchronization between the time code of the video information with the video ID “V001” and the time code of the video information with the video ID “V002”. .
In the present embodiment, the video ID of the second video information is “V003”.

FIG. 23 is a diagram illustrating an example of synchronization information according to the present embodiment.
FIG. 23B shows synchronization information indicating synchronization between the time code of the video information of the video ID “V001” and the time code of the video information of the video ID “V002” stored in advance by the synchronization information management unit 36.
Here, the synchronization information in FIG. 23 stores the video ID with the video information having the display area to be combined as the second video information, and the video information to be combined with the second display area as the first video information. Suppose that
In FIG. 23B, for example, the time code of the video ID “V002” associated with the time code “10:00:00” of the video ID “V001” is “0: 15: 00: 00”. It represents that. The video information of the video ID “V001” is combined with the display area of the video information of the video ID “V002”.

FIG. 23A shows synchronization information indicating the synchronization between the time code of the first video information and the time code of the second video information created by the synchronization information management unit 36.
Here, the time code of the video information of the video ID “003” as the second video information is video information (second video information in FIG. 23B) synthesized as the first video information. It is associated with the time code of the video information of the video ID “V002”.
In FIG. 23A, for example, the time code of the video ID “V003” associated with the time code “0: 15: 00: 00: 00” of the video ID “V002” is “0: 20: 00: 00: 00”. And the video information of the video ID “V002” is combined with the display area of the video information of the video ID “V003”.

  The information synthesizing unit 37 uses the synchronization information stored by the synchronization information managing unit 36 as the two or more pieces of video information stored in the video information storage unit 11 and the second video information stored by the video information storage unit 15. Synthesizing video information, which is information indicating a video obtained by synthesizing two or more pieces of video information stored in the video information storage unit 11, is output to the display area of the first video in the second video information. .

The information synthesis unit 37 specifies video information to be synthesized by searching for synchronization information stored in the synchronization information management unit 36.
Specifically, the information synthesis unit 37 searches the synchronization information stored in the synchronization information management unit 36 for the synchronization information whose video ID of the second video information is “V003”. As a result of the search, the information composition unit 37 identifies the synchronization information shown in FIG. 23A and identifies that the first video information is the video ID “V002”. Then, the information synthesizing unit 37 searches the synchronization information stored in the synchronization information managing unit 36 for the synchronization information whose video ID of the second video information is “V002”. As a result of the search, the synchronization information in FIG. 23B is specified, and it is specified that the first video information is the video ID “V001”.
Further, the information synthesizing unit 37 searches the synchronization information stored in the synchronization information managing unit 36 for the synchronization information in which the video ID of the second video information is “V001”. In this embodiment, it is assumed that there is no synchronization information in which the video ID “V001” is associated with the second video information.

The information combining unit 37 combines the specified video information as a result of the search.
Specifically, the information combining unit 37 combines the video information of the video ID “V002” with the video information of the video ID “V003”, and further, the video information of the video information ID “V002” to the video ID “V001”. "Is synthesized.
The video information storage unit 37 detects the display area of the video information of the video ID “V002” in the video information of the video ID “V003” and the video of the video ID “V001” in the video information of the video ID “V002”. The information display area is detected in the same manner as the information synthesizing unit 17 according to the first embodiment.

FIG. 24 is a diagram for explaining an example of the synthesis of video information according to the present embodiment.
The information combining unit 37 combines the video information in the order from right to left in FIG.
First, the information composition unit 37 performs modification 1 to convert the video information with the video ID “V001” into the shape of the display area of the video information with the video ID “V002”.
Next, the information composition unit 37 performs modification 2 to convert the video information with the video ID “V002” into the shape of the display area of the video information with the video ID “V003”. At this time, the information composition unit 37 also performs modification 2 on the video information whose video ID is “V001” that has undergone modification 1.
Then, the information composition unit 37 synthesizes the video information with the video IDs “V001” and “V002” and the video information with the video ID “V003”, which have undergone the above modification.

  Further, for example, the information combining unit 37 may set the number of times of combining video information in advance and combine the video information up to a predetermined number of times, or display area size for combining the video information May be set in advance, and the video information may be synthesized while the size of the display area is larger than the set value.

  As described above, according to the video conference system according to the present embodiment, since the video information related by the synchronization information is synthesized, even when the conference is repeated many times, the video is displayed without deterioration. be able to. As a result, it becomes possible to more appropriately understand the contents of the meetings held while looking at past meetings.

In the explanatory diagram of FIG. 24, the case where the display area to be combined is smaller than the image to be combined is described. However, the present invention is not limited to this, and the display area to be combined is larger than the image to be combined. Also good. In general, when a video is shot in a situation where the resolution is low and the shot video is displayed, the video is degraded compared to the original video. However, according to the video conference system according to the present embodiment, the video information related by the synchronization information is synthesized, so that the video information to be synthesized can be displayed as synthesized video information while maintaining the original resolution.
For example, the video information of the image ID “001” displayed in the first video information is smaller than the video information of the image ID “001”, that is, the resolution is small and is included in the second video information. Even if the video information of the displayed image ID “001” is larger than the video information of the image ID “001” displayed in the first video information, the video conference system according to the present embodiment For example, the video information of the image ID “001” can be displayed as composite video information while maintaining the original resolution.

  Note that the video conference system according to each of the above embodiments may not include the photographing unit 13 and the displays 18 and 19. In such a case, the video conference system receives the second video information captured by the imaging unit 13 outside the system, and displays the first video information and the like on the displays 18 and 19 outside the system. You may end up doing it.

  In addition, the video conference system according to each of the above embodiments has a communication function and may be able to see other conference scenes, or shown in FIG. 1 without using the communication function. It is also possible to shoot only the scenes of the conferences to be performed. In the former case, the video received by the video information receiving unit 14 may include video of two or more conference scenes connected via a communication line, or only video of one of the conference scenes. It may be.

  Further, in each of the above embodiments, the information synthesizing units 17, 27, and 37 combine the first video information with the second video information to create the synthesized video information. After the second video information is accumulated, Although the case where the processing is performed as a batch process has been described, the information synthesis units 17, 27, and 37 perform the process of creating the composite video information while performing the real-time processing (that is, the sequential video information) while the second video information is being accumulated. Processing). In this case, when the second video information is captured, composite video information obtained by synthesizing the first video information with the second video information is sequentially output.

In each of the above embodiments, when the information compositing units 17, 27, and 37 store the composite video information, if there is no need to leave the second video information, the composite video information is added to the second video information. It may be overwritten and accumulated.
In the above embodiment, each process or each function may be realized by centralized processing by a single device or a single system, or may be distributedly processed by a plurality of devices or a plurality of systems. May be realized.

In each of the above embodiments, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.
The software that realizes the video conference system in each of the above embodiments is the following program. That is, the program includes a display unit that displays first video information that is information indicating a captured video stored in the video information storage unit, and the display unit that displays the first video information. A video information receiving unit that receives second video information that is information indicating a video including a scene including the display area in the video, and video information that accumulates at least a part of the second video information received by the video information receiving unit Information indicating synchronization between the display time point of the first video information by the storage unit and the first display unit and the shooting time point of the second video information which is a video of the scene where the first video information is displayed A synchronization information management unit that creates and stores the synchronization information, the first video information stored in the video information storage unit, and the second video information stored in the video information storage unit Accumulated in the information management department Synthetic video that is information indicating a video obtained by synthesizing the first video information read from the video information storage unit according to the synchronization in the display area in the second video information. It functions as an output unit that outputs information.

In the program, the functions realized by the program do not include functions that can be realized only by hardware. For example, a function that can be realized only by hardware such as a modem or an interface card in a reception unit that receives information, an information synthesis unit that outputs information, and the like is not included in at least the functions realized by the program.
Further, this program may be executed by being downloaded from a server or the like, and a program recorded on a predetermined recording medium (for example, an optical disk such as a CD-ROM, a magnetic disk, a semiconductor memory, or the like) is read out. May be executed by
Further, the computer that executes this program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.
Further, the present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these are also included in the scope of the present invention.

  As described above, according to the video system and the like according to the present invention, it is possible to more appropriately understand the content of the conference held while viewing the past video, and the processing related to the video information obtained by capturing the conference It is useful as a video system for performing

The figure which shows the structure of the video conference system by the 1st Embodiment of this invention. The figure for demonstrating an example of the synthetic | combination of the video information by the embodiment The figure for demonstrating another example of the synthesis | combination of the video information by the embodiment A flowchart showing the operation of the video conference system according to the embodiment The flowchart which shows another operation | movement of the video conference system by the embodiment The flowchart which shows another operation | movement of the video conference system by the embodiment The figure which shows an example of the 1st video information in the embodiment The figure which shows an example of the synchronous information in the embodiment The figure which shows an example of the 2nd video information in the embodiment The figure which shows an example of the flame | frame of the 2nd video information in the embodiment The figure which shows an example of the flame | frame of synthetic | combination video information in the embodiment The figure for demonstrating another example of the synchronous information in the embodiment The figure for demonstrating another example of the synchronous information in the embodiment The figure for demonstrating another example of the synchronous information in the embodiment The figure for demonstrating another example of the synchronous information in the embodiment The figure which shows the structure of the video conference system by the 2nd Embodiment of this invention. The figure for demonstrating an example of the 2nd video information in the embodiment A flowchart showing the operation of the video conference system according to the embodiment The flowchart which shows another operation | movement of the video conference system by the embodiment The flowchart which shows another operation | movement of the video conference system by the embodiment The figure for demonstrating the video conference system by the 3rd Embodiment of this invention. The figure which shows the structure of the video conference system by the embodiment The figure which shows an example of the synchronous information by the embodiment The figure for demonstrating an example of the synthetic | combination of the video information by the embodiment

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Image | video information storage part 12 Display part 13 Image | photographing part 14 Image | video information reception part 15 Image | video information storage part 16 Synchronization information management part 17 Information composition part 18, 19 Display 25 Image | video information storage part 27 Information composition part 32 Information composition part 36 Synchronization information Management unit 37 Information composition unit

Claims (6)

A first video information storage unit for storing first video information;
A first display unit for displaying the first image information,
A second image information storing unit for storing the second image information obtained by photographing a scene including a display area of the first said image information is displayed in the first display portion,
Using the synchronization information among the video, the display area of the first display portion in the second image information, the second information combining for outputting the second synthesized image information obtained by combining the first image information And
A second display unit for displaying the second composite video information ;
A third video information storage unit for storing third video information obtained by photographing a scene including a display area of the second display unit on which the second composite video information is displayed ;
Third information for outputting third synthesized video information obtained by synthesizing the second synthesized video information to the display area of the second display unit in the third video information using synchronization information between videos. A synthesis unit ;
With
In the process of combining the second combined video information with the display area of the second display unit, the first video information is combined with the display area of the first display unit in the second video information. A video system characterized by The second video information storage unit stores video information excluding the display area of the first display unit among the second video information,
The third image information storage unit, a third of the video information, the video system of claim 1, wherein the storing the video information except for the display region of the second display unit. The video system according to claim 1 , wherein the synchronization information is information using a video time code . A display step of displaying first video information, which is information indicating a captured video, on the first display unit ;
A second image information storing step of storing the second image information obtained by photographing a scene including a display area of the first said image information is displayed in the first display portion,
Using the synchronization information among the video, the display area of the first display portion in the second image information, the second information combining for outputting the second synthesized image information obtained by combining the first image information Steps ,
A second display step of displaying the second composite video information ;
A third video information storage step for storing third video information obtained by photographing a scene including a display area of the second display unit on which the second composite video information is displayed ;
Third information for outputting third synthesized video information obtained by synthesizing the second synthesized video information to the display area of the second display unit in the third video information using synchronization information between videos. A synthesis step ;
I have a,
In the process of combining the second combined video information with the display area of the second display unit, the first video information is combined with the display area of the first display unit in the second video information. A video information processing method characterized by:   The program for functioning a computer as each means which comprises the video system of any one of Claim 1 thru | or 3.   A computer-readable recording medium on which the program according to claim 5 is recorded.

Images