JPH05191803A - Moving image synthetic device and inter-multi spot conference equipment - Google Patents

Abstract

PURPOSE:To provide a picture processing method capable of dividing an input picture into plural pictures and displaying the divided pictures on an arbitrary place of a display device, respectively. CONSTITUTION:A control circuit 6 sets the location where a moving image 1 is synthesized to a background picture 7 in a synthetic circuit 4 to a location control circuit 3 and the moving image 1 to be inputted by a picture element unit is identified as the corresponding picture block by an identification circuit 2 in order of the input. Next, in accordance with the picture block identified by the identification circuit 2, the moving image inputted at the location showed by the location control circuit 3 is synthesized to the background picture 7 by the synthetic circuit 4. This processing is repeated till inputted moving image 1 for one frame is terminated. Subsequently, the synthetic picture synthesized by a synthetic circuit 4 is displayed on a display device 5. When the synthesized location is changed, the content of the location control circuit 3 is rewritten by the control circuit 6. Therefore, by this constitution, the division of at least a picture into plural blocks is possible and further the display of the divided blocks on an arbitrary location on the display screen is possible.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multipoint conferencing system in which terminals such as workstations and personal computers are connected via a network and video conferencing is carried out mutually.
For example, the present invention relates to a method for processing a moving image in which moving images input by a TV camera in each terminal are combined as one moving image and the combined moving image is divided on the display screen of each terminal and displayed at an arbitrary position. Is.

[0002]

2. Description of the Related Art A conventional apparatus for displaying a moving image is described in, for example, Japanese Patent Application Laid-Open No. 2-63288 or 2-63289. In a known example, moving image inputs from a plurality of terminals are combined into one moving image, and the input moving image is displayed as one image. In addition, in the embodiment, the input of moving images from a plurality of terminals is sequentially switched, and output is performed in the input order.

[0003]

The above-mentioned prior art is not configured to divide an input moving image, and the input moving image is combined as a single image with a background image to be displayed. The image obtained by combining the moving images of 1 into one moving image cannot be divided into a plurality of original moving images, and the divided moving images cannot be arranged at arbitrary positions.

[0004]

According to a first aspect of the present invention, a moving image is input on a pixel-by-pixel basis, an image block corresponding to the input pixel is identified, and each identified pixel is assigned a designated position on a background image. It is characterized by combining.

According to a second aspect of the present invention, a moving image is input pixel by pixel, an image block corresponding to the input pixel is identified,
It is characterized in that the identified pixels are stored in respective designated divided memories, and the respective images stored in the divided memories are combined in a designated position of the background image in a designated order.

According to a third aspect of the present invention, a moving image is input on a pixel-by-pixel basis, the input pixel is selected under specified conditions, the corresponding image block of the selected pixel is identified, and the identified image is backgrounded. The feature is that the image is combined at a specified position.

According to a fourth aspect of the present invention, a moving image is input pixel by pixel, the input pixels are counted by a four-stage counting circuit for each frame, and the sequentially input pixels are counted according to the counted result. The feature is that the corresponding image block is identified.

A fifth aspect of the present invention is characterized in that reduced moving images sent from a plurality of terminals are combined into one image and the combined image is divided and displayed.

[0009]

According to the present invention, by providing a dividing means during the inputting and combining of moving images, one moving image can be displayed as a plurality of divided moving images. Therefore, under the control of the user, it is possible to divide the image into any size and display it at any position.

Further, it becomes possible to temporarily store the divided moving images in separate memories and combine the moving images stored in any order. Therefore, under the control of the user, it is possible to display the displayed moving image in a designated overlap.

Further, it becomes possible to select the input of the moving image for each pixel. Therefore, the moving image can be displayed in an arbitrary shape under the control of the user. In the division of a moving image, controlling the division of an image using four counters enables high speed operation. Therefore, the moving image can be processed in real time.

[0012]

Embodiments of the present invention will be described in detail below with reference to the drawings. In the following embodiments, one frame of a moving image that is input has 100 × 100 pixels in the horizontal and vertical directions, and the output image of one frame that is output to the output device has 200 × 200 pixels. One frame of the moving image is divided into four image blocks. The number of pixels of the input and output images of one frame can be set to any value, and the divided image blocks of one frame can be set to any size and number.

FIG. 1 is a block diagram showing a first embodiment of the present invention, and FIG. 6 is a display example of a display screen in the first embodiment.

In FIG. 1, 1 is a moving image sequentially input in pixel units, 7 is a background image, 2 is an identification circuit for identifying the input moving image 1 in pixel units, and 4 is an input in the background image 7. A synthesizing circuit for synthesizing pixels at a specified position, 3 is a position control circuit for controlling the position for synthesizing the pixels identified by the identifying circuit 2 by the synthesizing circuit 4, 6 is a control circuit for setting the synthesizing position, and 5 is a synthesizing device. It is a display device for displaying the image combined by the circuit 4 on a display or the like.

In FIG. 6, reference numeral 51 designates one input frame.
Of the input image of the image, 53-1 to 4-4 are image blocks obtained by dividing the input image 51 into four images, and 52 is an example of the output image.
54-1 to 54-4 are examples of combined image blocks divided corresponding to the image blocks 53-1 to 5-4. Of course, the image blocks 54-1 to 54-4 can be arranged at arbitrary positions.

Next, the operation of each part of FIG. 1 will be described based on the flowchart of FIG. 7 by taking the display screen of FIG. 6 as an example.

First, the control circuit 6 sets in the position control circuit 3 the position where the image blocks 53-1 to 5-4 are combined with the combining circuit 4 (201), and the moving image 1 is input in pixel units (20).
2), and the input pixels identified by the identification circuit 2 into corresponding image blocks 53-1 to 5-4 in the input order (203), and the input pixels identified by the identification circuit 2 are the position control circuit 3.
Then, the synthesizing circuit 4 synthesizes the background image 7 at the designated position (204). This process is repeated until the input moving image 1 is completed for one frame (205).
After that, the image synthesized by the synthesizing circuit 4 is displayed on the display device 5.
Is output (206) by and is displayed as an example of the output image 52. When the writing position has changed (207)
Controls the setting of the position control circuit 3 by the control circuit 6 (201).

FIG. 2 is a block diagram showing a second embodiment of the present invention.

In FIG. 2, 21 is a moving image sequentially input in pixel units, 32 is a background image, 22 is an identification circuit for identifying the input moving image 21 in pixel units, and 29 is a background image 32. Synthesis circuit for synthesizing images, 25-1 to 25-1
Reference numeral 4 denotes a block storage circuit that stores each divided image, and 24 denotes a block storage circuit 25 that sequentially selects moving images 21 that are sequentially input in pixel units by a discrimination circuit 22.
1 to 4, a dividing circuit, 27 is a block storage circuit 2
Switches for selecting the outputs of 5-1 to 4-4, 26 is a sequence control circuit for controlling the switching order of the switch 27, and 28 is a background image by a synthesizing circuit 29 of the respective images stored in the block storage circuits 25-1 to 25-4. A position control circuit for controlling the position to be combined with 31, a control circuit for setting the contents of the position control circuit and the sequence control circuit 26, and 30 for a combining circuit 29.
It is a display device for displaying the image combined in (1) on a display or the like.

Next, taking the display screen of FIG. 6 as an example, the operation of each part of FIG. 2 will be described based on the flowchart of FIG.

The control circuit 31 sets the order of reading the divided images in the order control circuit 26, and sets the position where the divided images are combined by the combining circuit 29 in the position control circuit 28 (221). Input the moving image 21 pixel by pixel (2
22), and the discrimination circuit 22 discriminates pixel by pixel (22
3) and the dividing circuit 24 causes the image blocks 53-1 to
Is divided into four blocks and designated block storage circuits 25-
It is stored (224) in 1 to 4. The division by the division circuit 24 is repeated for one frame (225).

The images stored in the block storage circuits 25-1 to 25-4 are switched by the switch 2 in the order set by the order control circuit.
7 and the combining circuit 29 outputs the position control circuit 2
8 is combined (226) at the position of the background image 32 designated by 8. After the composition of the contents of the block storage circuits 25-1 to 25-4 is completed (227), the display device 30 displays (228).
To be done. When the writing position and order change (22
In 9), the control circuit 31 corrects the settings of the sequence control circuit 26 and the position control circuit 28 (221).

FIG. 3 is a block diagram showing a third embodiment of the present invention.

In FIG. 3, 11 is a moving image, 19 is a background image, 12 is an identification circuit for identifying the input moving image 11 in pixel units, and 16 is a synthesizing circuit 15 for synthesizing the background image 19 and input pixels. Is a background image 19 by the synthesizing circuit 16.
The position control circuit that controls the position where the pixels identified by the identification circuit 12 are combined, 14 is a switch that selects and outputs the moving image 11 that is sequentially input in pixel units, and 13 is the pixel that is selected and output by the switch 14. Reference numeral 17 designates a selection control circuit, 17 is a display device for displaying the image synthesized by the synthesis circuit 16 on a display, and 18 is a control circuit for setting the setting contents of the selection control circuit 12 and the position control circuit.

Next, taking the display screen of FIG. 6 as an example, the operation of each part of FIG. 3 will be described based on the flowchart of FIG.

First, the control circuit 18 includes the position control circuit 15
In the synthesizing circuit 16, a position for synthesizing the moving image 11 input to the background image 19 is set, and control information for selecting the output of the moving image 11 input by the switch 14 in units of pixels is set in the selection control circuit 13 (211). ) Do.

The moving image 11 is input in pixel units (212), and the switch 14 selects the moving image 11 input in pixel units according to the control of the selection control circuit 13 and outputs (213). The discriminating circuit 12 discriminates (214) the inputted images into corresponding image blocks in order, and the inputted pixels discriminated by the discriminating circuit 12 are detected by the position control circuit 1.
5, the composition circuit 16 combines the background image 19 with the designated position (215). This process is repeated until the input moving image 11 is completed for one frame (2
16). After that, the image combined by the combining circuit 16 is output (217) by the display device 17 and output image 52
Is displayed as in the example. When the writing position is changed (218), the control circuit 18 corrects the settings of the position control circuit 15 and the selection control circuit 13 (211).

FIG. 4 is a block diagram showing a fourth embodiment of the present invention, and FIG. 10 is a time chart showing the operation of the fourth embodiment.

In FIG. 4, 100 is a moving image input in pixel units, 114 is a storage circuit for storing the output image, 115 is a display device for displaying the images stored in the storage circuit 114, and 101 is a sequential input. A first counter that counts up to 100 for each pixel of a moving image that is generated, and a second counter that counts up to 2 by carrying the carry of the first counter 101.
Counter, 103 is a third counter that counts up to 100 by carrying the second counter 102, and 104 is a third counter.
Of the counter 103, which counts up to 2 by carry, 105 is a multiplication circuit which doubles the output of the fourth counter 104, and 106 adds the outputs of the second counter 102 and the multiplication circuit 105 and adds them. A first addition circuit 107 that sets the result to the number of the image block to be divided, and 107 is a position information storage circuit that stores the origin coordinates to be combined for each image block number whose output is the output of the first addition circuit 106. Is X output from the position information storage circuit 107
Origin coordinates, 109 is the Y origin coordinates output from the position information storage circuit 107, 110 is a second addition circuit that adds the output of the first counter 101 and the X origin coordinates 108, 112
Is the X coordinate for writing the moving image 100 input in pixel units, which is output from the second adding circuit 110, and 111 is the third
Of the counter 103 and a Y addition coordinate for adding the Y origin coordinate 109, 113 is a Y coordinate for writing the moving image 100 input in pixel units, which is output from the third adding circuit 111, and 116 is a moving image. It is a frame signal indicating one frame of 100.

In FIG. 10, reference numeral 116 is a frame signal,
120 is the output of the first counter 101, 121 is the output of the second counter 102, and 122 is the third counter 103.
, 123 is the output of the fourth counter 104, 124
Is an address of the position information storage circuit 107.

Next, the operation of each part in FIG. 4 will be described with reference to the time chart in FIG.

The first to fourth counters 101, 102, 103, 104 are reset by the frame signal 116, and the moving image 100 is input, whereby the first to fourth counters 101, 102, 103, 104 of the pixel units are input. The operation starts.
Output 121 of second counter 102 and fourth counter 1
The output 124 of 04 determines the address 124 of the position information storage circuit 107, and the X origin coordinate 108 and the Y origin coordinate 1
09 is output, and the moving image 10 input by adding the output 120 of the first counter 101 and the X origin coordinate 108
The X coordinate 110 for writing the 0 pixel in the storage circuit 114 is determined, the Y coordinate 111 is determined by adding the output 122 of the third counter 103 and the Y origin coordinate 109, and the moving image 100 is sequentially written in the storage circuit 114. Be done. The image stored in the storage circuit 114 after repeating one frame is output by the display device 115.

FIG. 5 is a block diagram showing a fifth embodiment of the present invention. In this embodiment, the number of terminals is four, but the number of terminals is of course free.

In FIG. 5, 69 is a communication path connecting the terminals, 61 is a transmitter of the terminal A, 70 is an input circuit for inputting a moving image, and 71 is a reduction for reducing the moving image input by the input circuit 70. A circuit 72 is a transmission circuit for transmitting the moving image reduced by the reduction circuit 71 to another terminal via the communication path 69.

The transmitter 62 of the terminal B and the transmitter 6 of the terminal C
3, and the transmission unit 64 of the terminal D is the transmission unit 61 of the terminal A.
It has the same configuration as.

Reference numeral 65 is a receiver of the terminal A, and 73 is a communication path 6.
A receiving circuit for receiving the reduced moving image sent from each terminal sent via 9; and 74, a composition for synthesizing the reduced image sent from each terminal received by the receiving circuit 73 into one moving image. A circuit, 75 is a display circuit for dividing the moving image synthesized by the synthesizing circuit 74 and displaying it at an arbitrary position on the display screen.

Reception unit 66 of terminal B, reception unit 6 of terminal C
7, and the receiving unit 68 of the terminal D is the receiving unit 65 of the terminal A.
It has the same configuration as.

Next, the operation of each section of FIG. 5 will be described using the example of FIG.

Input circuit 7 for each of terminals A, B, C, D
The moving image input from 0 is reduced by the reduction circuit 71, and is received by the transmission circuit 72 via the communication path 69 to the reception circuit 73 of the reception unit of each terminal. The reduced moving image received from each terminal by the receiving circuit 73 is combined into one moving image like the input image 51 by the combining circuit 74. The moving image synthesized as one moving image by the synthesizing circuit 74 is divided by the display circuit 75 into the original reduced moving image by the configuration shown in the first, second, third, and fourth, and is output to the output image 52. It is displayed at an arbitrary position on the display device as shown.

Although the circuit for synthesizing the reduced images is included in the receiving circuit in this embodiment, it is of course possible to provide the circuit for synthesizing the image in the middle of the communication path.

[0041]

According to the first aspect of the invention, one image input can be arbitrarily divided and displayed at arbitrary positions on the display screen.

According to the second invention, one image input can be arbitrarily divided and displayed at arbitrary positions on the display screen, and the order of synthesizing the divided images can be designated. Can be overlaid in the specified hierarchical relationship by.

According to the third invention, the image input can be displayed on the display screen in an arbitrary shape.

According to the fourth invention, even if the input image is a high speed image such as a moving image, one image input can be arbitrarily divided and further divided into arbitrary positions on the display screen for display. it can.

According to the fifth aspect of the invention, it is possible to unify the moving image formats by providing means for combining the moving images sent from the respective terminals into one image under any condition.

[0046]

[Brief description of drawings]

FIG. 1 is a block diagram showing a first embodiment of the present invention.

FIG. 2 is a block diagram showing a second embodiment of the present invention.

FIG. 3 is a block diagram showing a third embodiment of the present invention.

FIG. 4 is a block diagram showing a fourth embodiment of the present invention.

FIG. 5 is a block diagram showing a fifth embodiment of the present invention.

FIG. 6 is an example of an input image and an output image in the embodiment.

FIG. 7 is a flowchart of the first embodiment of the present invention.

FIG. 8 is a flowchart of the second embodiment of the present invention.

FIG. 9 is a flowchart of the third embodiment of the present invention.

FIG. 10 is a time chart showing the operation of the fourth embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Moving image, 2 ... Identification circuit, 3 ... Position control circuit, 4 ... Compositing circuit, 5 ... Display device, 6 ... Control circuit, 7 ... Background image

Front page continuation (72) Inventor Tomohisa Kobinoyama 292 Yoshida-cho, Totsuka-ku, Yokohama-shi, Kanagawa Hitachi, Ltd. Microelectronics Equipment Development Laboratory (72) Inventor Masami Yamagishi 292 Yoshida-cho, Totsuka-ku, Yokohama, Kanagawa Bunch Co., Ltd. Hitachi, Ltd. Microelectronics Equipment Development Laboratory

Claims (5)

[Claims] 1. Inputting one or a plurality of moving images, inputting one background image, and combining means for combining the moving image input by the input means with the background image, and the input means by the combining means. In an image display device comprising control means for controlling a position for combining the input moving images and output means for displaying the image combined by the combining means, in the path between the input means and the combining means, The moving image input by the input means is input pixel by pixel on a frame-by-frame basis, and an identifying means for identifying the input pixel into an image block corresponding to each pixel is provided. A moving image synthesizing device, characterized in that it controls a position at which the pixel identified by the identifying means is synthesized with a background image. 2. Inputting one or a plurality of moving images, inputting one background image, synthesizing means for synthesizing the image input by the input means with the background image, and the synthesizing means by the input means. In an image display device composed of a combination control means for controlling a position for combining input moving images and an output means for displaying an image combined by the combining means, in a path between the input means and the combining means, A moving image input by the input means is input pixel by pixel on a frame-by-frame basis, and the input pixel is identified by the image block corresponding to each pixel, and the input pixel is identified by the identification means. Dividing means for dividing into a plurality of image blocks based on the result obtained, image block storing means for storing the images divided by the dividing means, and the image block storing An order control means for controlling the order of outputting the images stored in the stages and a switching means for outputting the images sequentially stored in the image block storage means by the order control means are provided, and the combining control means is provided in the combining means. A composite apparatus for a moving image, characterized in that it controls a position where an image output from the switching means is combined with a background image. 3. The moving image processing method according to claim 1 or 2, further comprising: selecting means for selecting, for each pixel, the moving image input by the input means before the identifying means, and the selecting means. A device for synthesizing a moving image, comprising selection control means for designating pixels output by the means. 4. The identifying means according to claim 1 or 2, wherein an input image is dot-sequentially input pixel by pixel for each frame, and one frame is input in the order of the input pixels. First counting means for counting the number of pixels in the horizontal direction of the image block to be divided, second counting means for counting the number of blocks in the horizontal direction of the image block to be divided, and By providing a third counting means for counting the number of pixels and a fourth counting means for counting the number of vertical blocks of the image block to be divided, the values obtained by the second and fourth counting means are inputted. An apparatus for synthesizing moving images, characterized in that pixels are corresponding image blocks. 5. A conference apparatus comprising a plurality of terminals connected to a communication path, wherein each terminal has an input means for inputting a moving image, a reducing means for reducing the moving image, and the reducing means for reducing the moving image. Transmitting means for transmitting the output of the moving image to another terminal using a communication path, receiving means for receiving the reduced moving image transmitted by the transmitting means of each terminal, and the above-mentioned receiving of each terminal It is composed of a synthesizing unit for synthesizing the reduced moving image into one moving image and a display unit for displaying the one moving image synthesized by the synthesizing unit by using the moving image synthesizing apparatus according to claim 1. A multipoint conference device characterized by the following.