JP2002344918A - Conference system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a conference system that can display a plurality of different images on the same screen in an optional state. SOLUTION: The conference system is provided with an image display device and a controller that can control a display state of an image on the image display device. The image display device is provided with an image processing section that generates one overlay image signal resulting from overlapping n-sets (n is an integer of 2 or over and m or below) of image signals among received m-sets (m is an integer of 2 or more) of image signals, and a display section that displays the image represented by the overlay image signal. The controller is provided with a display state control section that permits a user to set a desired display state of the image display device and supplies control information to control the operation of the image processing section to the image processing section depending on the set desired display state.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] The present invention relates to a conference system.

[0002]

2. Description of the Related Art In recent years, the use of conference systems has been expanding. A conference system is a communication tool that allows a user to talk in real time to a remote party using a communication line while looking at the remote party's face. Recently, it has been widely used not only in meetings and meetings, but also in education and medical care.

As a conference system, a system using a personal computer (hereinafter, also referred to as a “PC conference system”) or a system using a dedicated control device for the conference system (hereinafter, “dedicated conference”) A system is also provided.

[0004]

In a conventional personal computer conference system, a plurality of images can be arbitrarily displayed on a single display device in various states. However, the personal computer conference system is realized by executing software for constructing the conference system on a general personal computer. For this reason, the performance of the personal computer conference system largely depends on the processing capability of the personal computer used, and is generally lower than that of the dedicated conference system. For example, it may not be possible to reproduce in real time an image such as a moving image that requires processing exceeding the processing capability of a personal computer. There is also the inconvenience that only media that can be played back by a playback device supported by the personal computer used can be used.

In a conventional dedicated conference system, a dedicated control device for constructing a conference system is used, so that the capability of the conference system is generally higher than that of a personal computer conference system. In addition, usually, the dedicated control device can connect an arbitrary reproducing device, and can reproduce an image recorded on a medium corresponding to the connected reproducing device. However, as a configuration of one conference system, usually, a display device for displaying an image reproduced by a reproduction device included in a conference system used by the user (also referred to as “own system”) or a partner of a conference or the like is used. Conference system to be used (also called "partner system")
A display device for displaying an image sent from the company is required. In some cases, a plurality of display devices may be required according to the number of images to be displayed.

As described above, the conventional two types of conference systems have their advantages and disadvantages, and it is desired to provide a conference system having both advantages. That is, it is desired to provide a conference system that can display a plurality of different images in an arbitrary state on the same screen and that can display the images in real time.

The present invention has been made in order to solve the above-mentioned problems in the prior art, and has as its object to provide a conference system capable of displaying a plurality of different images in an arbitrary state on the same screen. I do.

[0008]

In order to solve at least a part of the above-mentioned problems, a first conference system according to the present invention comprises an image display device and a display state of an image on the image display device. And a control device that can control the number of image signals (m is an integer of 2 or more) among the input image signals (m is an integer of 2 or more). A) an image processing unit that generates one overlay image signal on which the image signals of
A display unit for displaying an image represented by the one overlay image signal, wherein the control device allows a user to set a desired display state on the image display device, and the set desired display state. And a display state control unit that supplies control information for controlling the operation of the image processing unit to the image processing unit.

According to the conference system of the present invention, based on the control information supplied from the control device, an image represented by n image signals out of m input image signals is superimposed on the image display device. Images can be displayed. Thereby, a plurality of different images can be displayed on the same screen.

Here, the image processing section selects one of the m image signals as a reference image signal and selects n-1 image signals as a superimposed image signal. Unit, a resolution conversion processing unit that converts the n image signals selected by the image selection unit into image signals each representing an image of a desired resolution, and the (n-1) superimposition on the one reference image signal An image synthesis unit that superimposes an image signal on a desired position, an image processing control unit that controls operations of the image selection unit, the resolution conversion unit, and the image synthesis unit; and the display state control unit includes a setting unit. Preferably, control information for controlling operations of the image selection unit, the resolution conversion unit, and the image synthesis unit is supplied to the image processing control unit in accordance with the desired display state.

According to the image processing section, images represented by n image signals out of m input image signals can be superimposed in an arbitrary order. Further, it is possible to display an image represented by n-1 superimposed image signals at a desired resolution and a desired position on the image represented by one reference image signal.

Further, the control device further generates a communication device connectable to a predetermined communication line and an image signal corresponding to image data received by the communication device, and outputs the image signal to the image display device. It is preferable to include a reception image processing unit and a transmission image processing unit that acquires image data represented by an input image signal and transmits the image data by the communication device.

According to the above configuration, for example, when two conference systems are connected to a communication line, image data representing an image signal input to one conference system from one conference system to the other conference system. Can be obtained and transmitted. Further, it becomes possible to receive image data transmitted from the other conference system, and display an image represented by the received image data in one of a plurality of images simultaneously displayed on the image display device. .

In the conference system, it is preferable that an image signal output from a computer can be input as at least one of the m image signals.

This makes it possible to display an image using an arbitrary computer.

The second conference system includes an image display device capable of displaying a plurality of images (m is an integer of 2 or more) of input m image signals on the same screen, and an image display device input to the image display device. An instruction for setting a desired display state of each of the images represented by the m image signals to the image display device,
A display state control unit capable of communicating with the image display device.

According to the above configuration, the display state of the image on the image display device can be easily controlled via the display state control unit.

The desired display state includes a display position,
It includes at least one of the display size and the priority condition for superimposing the display.

Here, it is preferable that a communication control unit capable of bidirectionally communicating at least one of the image signal and the audio signal from the other party to the display state control unit is provided.

In this case, the image signal and the audio signal from the other party can be exchanged with each other.

Further, the display state control unit is configured to output one of m audio signals corresponding to the input m image signals.
Preferably, an instruction for selecting one audio signal as an audio output can be communicated to the image display device.

This makes it possible to easily control the selection of the sound to be output on the image display device via the display state control unit.

Further, it is preferable that the display state control unit can communicate a command of a desired sound output state of the sound output to the image display device.

This makes it possible to easily control the output state of the sound output in the image display state via the display state control unit.

The control device of the present invention has m (m
Is an integer greater than or equal to 2) is a control device capable of controlling the display state of an image display device capable of displaying a plurality of images on the same screen, wherein m image signals input to the image display device And a display state control unit capable of communicating with the image display apparatus a command for setting a desired display state for each image represented by the image display apparatus.

If a conference control system is configured using the control device of the present invention, the same operation and effect as those of the second conference system can be obtained.

[0027]

DETAILED DESCRIPTION OF THE INVENTION Outline of Configuration of Conference System: FIG. 1 is an explanatory diagram showing an example of the configuration of a conference system of the present invention. In this example, two conference systems KS1, KS2
Are connected to each other via a communication line CL.

The first conference system KS1 includes a projector PJ1, a conference control unit CU1, and a conference control unit CU.
1 provided with a remote controller (hereinafter simply referred to as “remote controller”) RC1. The conference control unit CU1 includes a personal computer PC1 functioning as a playback device for images and sounds, a microphone (hereinafter simply referred to as a "microphone") MK1, and an imaging camera (hereinafter simply referred to as a "camera") CM1. And the DVD player DV1 are connected. Second conference system KS2
Has exactly the same configuration as the first conference system KS1,
Each component of the second conference system has a numeral at the end of the reference numeral assigned to each component of the first conference system KS1.
The code is obtained by replacing 1 "with" 2 ".
In the following description, the configuration of the first conference system KS1 will be mainly described.

The remote controller RC1 is an input device for making various settings for the conference control unit CU1.

The personal computer PC1, the camera CM1, and the microphone MK connected to the conference control unit CU1
1. Image signals and audio signals output from the DVD player DV1 are supplied to the projector PJ1 via individual signal lines as described later. In the second conference system KS2, the personal computer PC
2, the image signal and the audio signal corresponding to the image signal and the audio signal from the camera CM2 and the DVD player DV2, the image data supplied from the conference control unit CU2 of the second conference system KS2 via the communication line CL, and the like. In accordance with the audio data, the projector PJ is connected via individual signal lines.
1 is supplied.

The projector PJ1 projects an image represented by an image signal supplied via a signal line according to projector control information supplied via a control signal line from the first conference control unit CU1, and represents an audio signal. Output audio. The projector PJ2 is also connected to the second conference control device CU2.
According to the projector control information supplied through the control signal line, the image represented by the image signal supplied through the signal line is projected according to the projector control information supplied through the control signal line, and the audio signal is represented by Output audio.

Hereinafter, the conference system KS1 will be further described by sequentially describing the projector PJ1 and the conference control unit CU1 which constitute the conference system KS1.

B. Internal configuration of projector PJ1: FIG.
Is an explanatory diagram showing the internal configuration of the projector PJ1. The projector PJ1 includes a CPU 310 and an RO
This is a computer system including M320, RAM 330, external control unit 340, image display control unit 350, audio output control unit 360, projection display unit 370, and speaker 380. ROM 320 and RAM 330
, The external control unit 340, the image display control unit 350, and the audio output control unit 360 are connected to the CPU via the bus 310b.
Connected to 310.

The CPU 310 performs various processes and controls in accordance with the computer programs stored in the ROM 320, specifically, the operation of each block of the external control unit 340, the image display control unit 350, and the audio output control unit 360. Control. The RAM 330 stores data obtained during processing by the CPU 310 and the like.

The projector PJ1 usually includes an input device (not shown) such as a remote controller and an operation panel. The external control device 340 is configured to be able to input various projector control information set by the input device.

As the projector control information set by the input device, for example, “resolution of original image”, “order of superposition”, “image to be superimposed” (hereinafter referred to as “superimposed image”) Control information (hereinafter, referred to as "image display control information") relating to an image display state, such as the resolution of a screen on which is displayed (hereinafter, referred to as "overlapping screen"), "position of the overlapping screen", and audio described later. There is control information relating to the output state (hereinafter, referred to as "sound output control information").

The input projector control information is transferred from the external control unit 340 to a corresponding block according to the content of the information. For example, the image display control information is sent to the image display control unit 350, and the audio output control information is sent to the audio output control unit 3.
Transferred to 60.

The external control unit 340 includes a connection terminal 3
The conference control unit CU1 is connected via a control line connected to. The external control unit 340 is configured to be able to input information corresponding to the projector control information set by the input device (hereinafter, simply referred to as “projector control information”) from the conference control device CU1 as described later. .

The configuration of the external control unit 340 connected to the conference control unit CU1 is, for example, RS-232C or U.S.
This is realized by a serial communication interface such as an SB. In addition, it may be realized by various communication interfaces such as a parallel communication interface such as Centronics and a wireless communication interface.

The projector PJ1 is provided with six input ports PJIN1 to PJIN6. Each of these input ports has an image signal input terminal and an audio signal input terminal. Each input port PJIN1-PJ
IN3, PJIN4 to PJIN6 are output ports AOUT1 to A1 corresponding to the conference control device CU1 described later.
AOUT3, BOUT1 to BOUT3 (FIG. 6).

The audio signal A input through the audio signal input terminals of the input ports PJIN1 to PJIN6
P1 to AP6 are input to the audio output control unit 360.
The audio output control section 360 converts the audio signals AP1 to AP6 into one audio signal APOUU based on the audio output control information.
Output to the speaker 380 as T. For example, the audio signals AP1 to AP6 are switched and output in the order of input,
A corresponding audio signal can be switched and output according to an image displayed on a projection display unit 370 described later, and various controls can be performed. The output audio signal APOUT is converted into audio by the speaker 380. The configuration of the audio output control unit can be easily realized by a general audio control circuit such as a mixer.

The image signal V input via the image signal input terminals of the input ports PJIN1 to PJIN6
P1 to VP6 are input to the image display control unit 350.
The image display control unit 350 outputs the image signals VP1 to VP6 as one image signal OVD based on the image display control information. The image represented by the one output image signal OVD is displayed on the screen SCR1 by the projection display unit 370.
(FIG. 1). From the above, the image display control unit 350 corresponds to the image processing unit of the present invention, and the projection display unit 370 corresponds to the display unit of the present invention.

FIG. 3 is an explanatory diagram showing an example of the internal configuration of the image display control section 350. This image display control unit 350
Is a decoder unit 410 having six decoders 410a to 410f, a selector 420, and a resolution conversion processing unit 430 having six resolution conversion units 430a to 430f.
And five overlay (OVL) units 440a to 440e
, An on-screen display (OSD) unit 450, and an overlay (OVL) control unit 460. The OVL control unit 460 is connected to the bus 310b. The OVL control unit 460 controls each of the units 410 (410a to 410) according to the image display control information input via the bus 310b.
f), 420, 430 (430a to 430f), 440
(440a to 440e) and 450 are controlled.

First decoder 410 of decoder section 410
a to sixth decoder 410f have corresponding first input port PJIN1 to sixth input port PJIN, respectively.
6 are input. As the image signal, for example, as an image signal output from a computer (hereinafter, also referred to as a “computer signal”),
There are analog image signals such as a signal including an analog RGB signal, a horizontal synchronization signal, and a vertical synchronization signal, or a signal in which a synchronization signal is superimposed on a G signal of an RGB signal. Also,
As an image signal (hereinafter, also referred to as a “television signal”) output from an imaging camera, a DVD player, or the like, there is also a composite signal or an analog image signal such as a luminance / color difference component signal. There are digital image signals as well as analog image signals.

Each of the decoders 410a to 410f samples the image data contained in each of the corresponding image signals VP1 to VP6 according to the type of the corresponding image signal, and outputs them as digital image signals VD1 to VD6.

In order to support all of a plurality of different image signals at one input port, a plurality of decoders corresponding to a plurality of different image signals are required for each input port, and the configuration of the apparatus becomes complicated. For this reason, a method is generally used in which one type of image signal that can be handled by one input port is specified, and a decoder corresponding to the specified image signal is configured for each input port.

In the projector PJ1 of the present embodiment, a computer signal is input from the conference control unit CU1 to the first and second input ports PJIN1 and PJIN4 as described later, and the second, third, fifth and fifth input ports are input. 6 input ports PJ
Television signals are input to IN2, PJIN3, PJIN5, and PJIN6. Therefore, the first and fourth decoders 410a and 410d are constituted by decoders corresponding to computer signals, and the second, third, fifth and sixth decoders are provided.
Of decoders 410b, 410c, 410e and 410f are constituted by decoders corresponding to television signals. The decoder corresponding to the computer signal is A
It can be easily realized by a D conversion circuit and a PLL circuit. The decoder corresponding to the television signal can be easily realized by various commercially available decoders, for example, Philips SAA7114 or the like.

The selector 420 arbitrarily selects one of the six digital image signals VD1 to VD6 output from the decoder unit 410 as the reference image signal SS10.
It has a function of arbitrarily selecting the remaining five as the five superimposed image signals SP10 to SP50. That is, the selector 420 corresponds to the image selection unit of the present invention. In addition,
The selection condition is set by the OVL control unit 460 according to the image display control information indicating the “overlapping order” input to the OVL control unit 460 via the bus 310b.

The resolution conversion processing unit 430 performs the following operations on the reference image signal SS input from the selector 420
The resolutions of the images represented by the ten and five superimposed image signals SP10 to SP50 are respectively converted.

The first resolution conversion section 430a converts the image represented by the reference image signal SS10 into an image having a resolution equal to the resolution (number of pixels) of the display screen by the projection display section 370, and outputs the converted image as the reference image signal SD1. I do. In addition,
This conversion condition is transmitted to the OVL control unit 4 via the bus 310b.
The OVL control unit 460 sets the value according to the image display control information indicating the “resolution of the original image” input to 60.

Further, the second resolution conversion section 430b converts the image represented by the first superimposed image signal SP10 into an image having the same resolution as the first superimposed screen displayed as the first superimposed image, It is output as the first superimposed image signal SP1. Third to sixth resolution converters 430c to 430f
Also, like the second resolution conversion unit 430b, the second to fifth
Convert the images represented by the superimposed image signals SP10 to SP50 into images having the same resolution as the respective superimposed screens,
Output as second to fifth superimposed image signals SP1 to SP5. The second to sixth resolution conversion units 430b to 430
The resolution conversion condition at f is set to O via the bus 310b.
This is set by the OVL control unit 460 according to the image display control information indicating the “resolution of the original image” and the “resolution of the superimposed screen” input to the VL control unit 460.

The OVL processing section 440 superimposes the reference image signal SS1 input from the resolution conversion processing section 430 and the five superimposed image signals SP1 to SP5 to generate one overlay image signal OD5. Specifically, the following processing is performed.

The first OVL unit 440a superimposes the first superimposed image signal SP1 output from the second resolution converter 430b on the reference image signal SS1 output from the first resolution converter 430a. In addition, a first overlay image signal OD1 is generated.

FIG. 4 is a block diagram showing a schematic configuration of the first OVL unit 440a. The OVL unit 440a includes a memory write control unit 442, a memory control unit 444, a memory 446, and a memory read control unit 448.

The image data represented by the reference image signal SS1 is
The memory write control unit 442 causes the memory control unit 444
Are sequentially written to the memory 446 via the. The image data represented by the first superimposed image signal SP1 is temporarily stored in a buffer 442B provided in the memory writing control unit 442. Then, when image data is written in an area of the memory 446 corresponding to an area where the superimposed image is to be superimposed on the reference image, the superimposed image data is read from the buffer 442B and written into the memory 446. It is.

The image data stored in the memory 446 is transmitted to the memory control unit 4 by the memory read control unit 448.
It is read via 44.

As described above, the overlay image signal OD1 in which the first superimposed image signal SP1 is superimposed on the reference image signal SS1 is output. The operating conditions of the memory write control unit 442 and the memory read control unit 448 are based on image display control information indicating “resolution of the superimposed screen” and “position of the superimposed screen” input to the OVL control unit 460 via the bus 310b. According to the OVL control unit 4
60 is set.

FIG. 5 shows the memory 446 of the OVL unit 440a.
FIG. 4 is an explanatory diagram showing image data written to the.

To explain the overlay (overlay) processing of the OVL section 440a, the following assumption is made. That is, it is assumed that the reference image signal SS10 has image data having a resolution of 800 × 600 pixels as shown in FIG. Further, the first superimposed image signal S
It is assumed that P10 has image data having a resolution of 320 × 240 pixels as shown in FIG. The resolution of the display screen of the projection display unit 370 (FIG. 2) is 1024 × 768 pixels, and the reference image signal SS1
The image represented by 0 is the entire display screen, that is, 1024
It is assumed that the image is displayed at a resolution of × 768 pixels. Also, the first
It is assumed that the image represented by the superimposed image SP10 is superimposed and displayed at a resolution of 640 × 480 pixels with the position of the coordinates (x1, y1) when the upper left of the display screen is the origin as the upper left.

In the following description, each image signal and the image represented by each image signal may be described using the same reference numerals.

The reference image SS10 of FIG. 5A is converted into a reference image SS1 as shown in FIG. 5C by the first resolution converter 430a (FIG. 3) so that the resolution becomes equal to the resolution of the display screen. Is converted. Here, a reference image SS10 of 800 × 600 pixels (FIG. 5A) is converted to 1024 × 76 pixels.
An example in which the image is enlarged to a reference image SS1 of eight pixels (FIG. 5C) is shown.

[0062] The first superimposed image SP10 of FIG.
In the second resolution converter 430b (FIG. 3), the image is converted into a first superimposed image SP1 as shown in FIG. 5D so as to be equal to the resolution of the superimposed screen. Here, 32
An example is shown in which a superimposed image SP10 of 0 × 240 pixels is enlarged to a superimposed image SP1 of 640 × 480 pixels.

As described above, the image data of the reference image SS1 is stored in the memory write control unit 442 of the OVL unit 440a.
Is written to the memory 446. On the other hand, the image data of the first superimposed image SP1 is also written in an area corresponding to the image data of the first superimposed image SP1 in the area of the memory 446 where the image data of the reference image SS1 is written. Specifically, as shown in FIG.
In the case where the upper left of the area corresponding to the reference image SS1 of No. 6 is set as the origin, the coordinates of the upper left of the first superimposed image SP1 are (x1,
y1), the lower right coordinates are (x1 + 639, y1 + 47)
The data is written in the rectangular area indicated by 9).

As shown in FIG. 5E, by sequentially reading out the image data written in the memory 446, an overlay image obtained by superimposing the image represented by the first superimposed image signal SP1 on the image represented by the reference image SS1 Can be output.

In addition, according to the value of the coordinates (x1, y1),
It is possible to adjust the position where the first superimposed image SP1 is superimposed on the reference image SS1.

The second OVL unit 440b to the fifth OVL unit 440b in FIG.
The VL unit 440e has the same configuration as the first OVL unit 440a, and operates similarly. However, the second OVL
The unit 440b includes a second overlay image signal SP output from the third resolution conversion unit 430c on the first overlay image signal OD1 output from the first OVL unit 440a.
2 to generate a second overlay image signal OD2. Hereinafter, the third OVL unit 440c to the fifth OV
Similarly, the L unit 440e also includes the preceding OVL units 440b to 440b.
0d output from the second overlay image signal OD2.
The third overlay image signal SP3 to the fifth overlay image signal SP5 are superimposed on the fourth overlay image signal OD4 to output the third overlay image signal OD3 to the fifth overlay image signal OD5.

Therefore, the fifth overlay image signal OD5 output from the fifth OVL unit 440e is
A first superimposed image SP1 to a fifth superimposed image S are placed on S1.
One overlay image signal representing an overlay image obtained by superimposing P5 in order is obtained.

Note that a general overlay circuit can be used as the OVL units 440a to 440e.
For example, Pixel Works Inc. (PIXEL WO)
RKS) can be used.

The OSD section 450 includes a fifth OVL section 440
The image data of a menu screen or the like (hereinafter, referred to as an “OSD image”) is synthesized with the overlay image signal OD5 output from e and output as the overlay image signal OVD.
When the OSD image is not displayed, the image data of the OSD image is not combined. The operation of the OSD unit 450 is controlled by the control unit 460 according to the image display control information input to the control unit 460 via the bus 310b.

As described above, the image display control unit 350 selects any one of the input six image signals VP1 to VP6 as the reference image signal, and superimposes the other five image signals on the superimposed image signal. Can be selected in any order. Then, it is possible to generate one overlay image signal OVD representing an overlay image in which an image represented by an arbitrarily selected overlay image signal is sequentially superimposed on an image represented by the selected reference image signal. Further, the display resolution and the display position of the superimposed image can be arbitrarily set.

The overlay image signal OVD output from the image display control section 350 is applied to the projection display section 370 shown in FIG.
And the image represented by the overlay image signal OVD is projected and displayed.

In the projector PJ1, the selector 420 (FIG. 3) of the image display control unit 350 converts one reference image signal SS10 and five superimposed image signals SP10 to SP50 into six digital image signals VD1 to VD6. Can be selected arbitrarily.
For this reason, the order of superimposition of the images represented by the six input image signals VP1 to VP6 can be easily switched.

In the resolution conversion processing section 430 (FIG. 3) of the image display control section 350, the first superimposed image signal S
The resolution of the superimposed images represented by P10 to the fifth superimposed image signal SP50 is converted so as to be equal to the resolution of the superimposed screen on which each is displayed. Therefore, by adjusting the resolution of the superimposed screen on which these superimposed images are displayed,
The display size of the superimposed image can be easily adjusted.

The OVL processing unit 440 (FIG. 3) converts the input image data represented by the first superimposed image signal SD1 to the fifth superimposed image signal SD5 into any image data represented by the reference image signal SD1. Can be easily superimposed. For this reason, 5 displayed superimposed on the reference image
It is possible to easily adjust the positions of the two superimposed images.

As described above, this projector PJ1 outputs any one of the six input image signals.
One is selected as a reference image signal, the other five image signals are selected as superimposed image signals, and the images represented by the five superimposed image signals are displayed in an arbitrary order on the image represented by the reference image signal. be able to. Further, the display size and the display position of the superimposed image can also be set arbitrarily.

The image display control section 350 corresponds to the image processing section of the present invention, and the projection display section 370 corresponds to the display section of the present invention.

B. Internal configuration of conference control device: FIG. 6 is an explanatory diagram showing the internal configuration of the conference control device CU1. The conference control device CU1 includes a CPU 110, a ROM 120,
RAM 130, input control unit 140, communication control unit 15
0, a projector control unit 160, an image / audio control unit 170, and a camera control unit 180. ROM 120, RAM 130,
The input control unit 140, the communication control unit 150, the projector control unit 160, the image / audio control unit 170, and the camera control unit 180 are connected to the CPU 110 via the bus 110b.
It is connected to the.

The CPU 110 performs various processes and controls in accordance with the computer program stored in the ROM 120, specifically, the input control unit 140 and the communication control unit 1
The operation of each block of 50, projector control unit 160, image / audio control unit 170, and camera control unit 180 is controlled. The RAM 130 stores data obtained during processing by the CPU 110 and the like.

Input control section 140 analyzes information indicated by a remote control signal from remote control RC1 received by receiving section 142. The analyzed information is transferred to a corresponding block. For example, if the information is related to a camera CM1 described later, the camera controller 180 is notified of the projector P described later.
If the information is related to J1, the information is transferred to the projector control unit 160.

The camera controller 180 generates a camera control signal for controlling the operation of the camera CM1. This camera control signal is generated according to the camera control information input by the remote controller RC1. The generated camera control signal is supplied to the camera CM1 via a control line connected to the connection terminal 182. In the camera CM1, various operations such as zooming, panning, and tilting are controlled according to the camera control information represented by the input camera control signal.

The communication control unit 150 communicates with another conference system KS via the communication line CL connected to the connection terminal 152.
2 has a function of communicating with the communication device 2. For example, image data and audio data transmitted from the conference system KS2 via the communication line CL are received and transferred to an image / audio control unit 160 described later. Further, it transmits image data and audio data transferred from the image / audio control unit 160 to the conference system KS2 (FIG. 1) via the communication line CL. The communication control unit 150 corresponds to the communication device of the present invention.

The communication control unit 150 includes a modem, a terminal adapter, a network card, and the like according to the type of the communication line CL to be connected.

The conference control unit CU1 has three input ports VIN1 to VIN3 and six output ports AOUT1.
AOUT3, BOUT1 to BOUT3 are provided. Each of these input ports and output ports has an image signal terminal and an audio signal terminal.

The video input terminal and the audio output terminal of the personal computer PC1 are connected to the first input port VIN1. The second input port VIN2 has:
The video output terminal of the camera CM1 and the audio output terminal of the microphone MK1 are connected. The video output terminal and the audio output terminal of the DVD player DV1 are connected to the third video input port VIN3.

Each of the input ports VIN1 to VIN3
Is input from a video / audio control unit 16 to be described later.
0, and output port AOUT
1 to AOUT3. Note that each input port V
Input terminals of IN1-VIN3 and output ports AOUT1-A
An output terminal of OUT3 may be provided with an input buffer and an output buffer.

The image / audio control section 160 obtains image data and audio data from the image signals and audio signals input from the input ports VIN1 to VIN3. The acquired data is transmitted to the transmission destination (conference system KS2) by the communication control unit 150. It is preferable that the amount of data transmitted via the communication line CL be as small as possible. For this reason, the image / audio control unit 160 normally performs a process of compressing the acquired data.

The image data and audio data received by the communication control unit 150 and transferred to the image / audio control unit 160 are usually compressed.
At 60, a process of expanding the compressed image data and audio data is performed. The decompressed image data and audio data are converted into image signals and audio signals that can be input to the projector PJ1, and output from the output ports BOUT1 to BOUT3. Note that the second conference system KS2 is the first conference system KS2.
Of the personal computer PC2, the image data of the camera CM2 and the audio data of the microphone MK2, and the image data and the audio data of the DVD player DV1 in the second conference system KS1. It is supplied from the control unit CU2 to the first conference control unit CU1. Therefore, the image / audio control unit 160
Are an image signal and a sound signal corresponding to the personal computer PC2, an image signal and a sound signal corresponding to the microphone MK2 corresponding to the camera CM2, and the DVD player DV1.
Are output from the corresponding output ports BOUT1 to BOUT3.

As can be seen from the above description, the image / voice control section 160 corresponds to the reception image processing section and the transmission image processing section of the present invention.

The output ports AOUT1 to AOUT
3, BOUT1 to BOUT3 are connected to input ports PJIN1 to PJIN6 (FIG. 2) of projector PJ1. Output ports AOUT1-AOUT3, BOUT1-
Image signals and audio signals output from BOUT3 are input ports PJIN1 to PJIN6 of projector PJ1.
It is input as described above via FIG.

[0090] Projector control section 170 generates a projector control signal for controlling the operation of projector PJ1. This projector control signal is
This represents projector control information set based on the information input by C1. The generated projector control signal is input to the external control unit 340 of the projector PJ1 via a control line connected to the connection terminal 172. Note that the remote controller RC1, the input control unit 140, and the projector control unit 170 correspond to a display state control unit of the present invention.

In the projector PJ1, the conference control device C
The operation of the projector PJ1 is controlled according to the projector control information supplied from the projector control unit 170 of U1. Specifically, the plurality of output ports AOUT1 to AOUT3, BOUT1 to BO of the conference control device CU1
The display state of the image represented by the six image signals output from the UT 3 and input to the projector PJ1 and the output state of the audio represented by the audio signal are controlled.

FIG. 7 is an explanatory diagram showing a display state of an image by the projector PJ1 controlled by the conference control unit CU1 in the first conference system KS1. Note that in FIG. 7, an image from the personal computer PC1 connected to the conference control device CU1 is represented by an image P1,
The image from camera CM1 is image P2, and the image from DVD player is image P3, and second conference system KS2
The image by the personal computer PC2 connected to the conference control unit CU2 of FIG.
The image of No. 2 is referred to as a fourth image P5, and the image of the DVD player is referred to as image P6. FIG. 7A shows a case where the image P1 is set as a reference image and the images P2 to P6 are set as first to fifth superimposed images in order. FIG. 7B shows an example in which the image P1 of the personal computer PC1 and the image P4 of the personal computer PC2 are exchanged, and the image P4 of the personal computer PC2 is used as a reference image. To the fifth superimposed image.

The user exchanges the image P1 of the personal computer PC1 with the image P4 of the personal computer PC2 using the remote controller RC1, sets the image P4 of the personal computer PC2 as a reference image, and uses the images P2, P3, P1, and P5. , P6 as the first to fifth superimposed images, the display state of FIG. 7A can be easily changed to the display state of FIG. 7B.

FIG. 7 illustrates an example in which the reference image is replaced with the image P4 from the image P1, but as described above with respect to the projector PJ1, the order of superimposition of the five superimposed images, The position and display size of each of the three superimposed images can be arbitrarily adjusted.
The control of the display state of the plurality of images is performed by the projector control information set by the user using the remote controller RC1 from the projector control unit 170 (FIG. 6) of the conference control device CU1 to the image display control unit 350 of the projector PJ1.
(FIG. 2).

As described above, in the conference system KS1 of the present embodiment, the input projector PJ1
, One of the six image signals input to is selected arbitrarily as the reference image signal, and the remaining five image signals are selected in any order as the superimposed image signal, and the image represented by the selected reference image signal is selected. It is possible to sequentially display images represented by the superimposed image signals selected above. Therefore, the first
In each of the conference system KS1 and the second conference system KS2, not only the image reproduced by the own system,
A plurality of images including an image sent from the partner system can be displayed in any order, at any position, and at any size. In addition, the operation of displaying a plurality of images by the projector PJ1 is performed by the conference control device C.
It can be controlled by U1.

As can be seen from the above description, the conference control device CU1 corresponds to the control device of the present invention, and the projector P
J1 corresponds to the image display device of the present invention.

The present invention is not limited to the above-described examples and embodiments, but can be implemented in various modes without departing from the scope of the invention.
For example, the following modifications are possible.

(1) In the above embodiment, the case where all the images represented by the six input image signals are superimposed and displayed has been described as an example. It can be arbitrarily selected and displayed. For example, in the above embodiment, the OVL of the image display control unit 350
The processing unit 440 may perform control so as not to superimpose image signals representing images not to be displayed.

In the above embodiment, the case of six image signals has been described as an example. However, the present invention is not limited to this, and may be five or less or seven or more image signals. That is, the present invention generates one overlay image signal in which n (n is an integer of 2 or more and m or less) image signals among m input (m is an integer of 2 or more) image signals are superimposed. However, the present invention is applicable to a case where an image represented by one generated overlay image signal is displayed.

(2) In the above embodiment, the case where the input six image signals are analog image signals is described as an example, but the present invention is not necessarily limited to analog image signals. For example, the image signal generated by the image / audio control unit 160 based on image data transmitted from another conference system may be a digital image signal.
Further, the image signal output from the image reproducing device directly connected to the conference control device such as an imaging camera or a DVD player may be a digital image signal. However, when the image signal is a digital image signal, the input port and the decoder of the corresponding projector need to have a configuration corresponding to the digital image signal.

(3) In the above embodiment, the case where a projector is used as an image display device has been described as an example, but the present invention is not limited to this. It is also possible to use a plasma display capable of superimposing and displaying images represented by a plurality of image signals in an arbitrary order, or a direct-view image display device using a flat panel such as a liquid crystal panel.

Further, the configuration of the image display control section 350 described in the above embodiment is an example, and is not limited to this configuration, and is not limited to this configuration, and can be used for inputting m (m is an integer of 2 or more) image signals. Any configuration may be used as long as the configuration generates one overlay image signal in which n image signals (n is an integer of 2 to m) are superimposed.

(4) In the above embodiment, the case where the two conference systems KS1 and KS2 are connected via the communication line CL is described as an example, but the present invention is not limited to this. The conference system of the present invention can also be applied to a case where three or more conference systems are connected via a communication line. Also, not all conference systems need to be configured with the conference system of the present invention.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram showing an example of a configuration of a conference system of the present invention.

FIG. 2 is an explanatory diagram showing an internal configuration of a projector PJ1.

FIG. 3 is an explanatory diagram illustrating an example of an internal configuration of an image display control unit 350.

FIG. 4 is a block diagram illustrating a schematic configuration of a first OVL unit 440a.

FIG. 5 is an explanatory diagram showing image data written to a memory 446 of an OVL unit 440a.

FIG. 6 is an explanatory diagram showing the internal configuration of the conference control device CU1.

FIG. 7 is an explanatory diagram showing a display state of an image by a projector PJ1 controlled by a conference control device CU1 in the first conference system KS1.

[Explanation of symbols]

 CL: Communication line KS1, KS2: Conference system CU1, CU2: Conference control device RC1, RC2: Remote controller (remote controller) PJ1, PJ2: Projector SCR1, SCR2: Screen CM1, CM2: Imaging camera (camera) MK1, MK2: Microphone (Microphone) PC1, PC2 personal computer PJIN1 to PJIN6 input port 110 CPU 110b bus 120 ROM 130 RAM 140 input control unit 142 reception unit 150 communication control unit 152 connection terminal 160 image / voice Control unit 170 Projector control unit 172 Connection terminal 180 Camera control unit 182 Connection terminal VIN1 to VIN3 Input port AOUT1 to AOUT3 Output port BOUT1 to BOUT3 Output port 3 0 CPU 310b Bus 320 ROM 330 RAM 340 External control unit 342 Connection terminal 350 Image display control unit 360 Audio output control unit 370 Projection display unit 380 Speaker 410 Decoder units 410a to 410f Decoder 420 selector 430 resolution conversion processing unit 430a-430f resolution conversion unit 440 overlay (OVL) processing unit 440a-440e overlay (OVL) unit 450 OSD unit 460 overlay (OVL) control unit 442 memory writing control Unit 442B Buffer 444 Memory control unit 446 Memory 448 Memory read control unit

Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat II (reference) G09G 5/00 510 G09G 5/14 C5 / 14 H04M 3/56 C5 / 36 H04N 7/173 630 5/377 G09G 5/00 520V 5/391 5/36 520E H04M 3/56 520N H04N 7/173 630 F term (reference) 5B069 AA01 BA03 CA17 DD15 FA03 KA06 5C064 AA02 AB04 AC04 AC12 AC13 AC14 AD06 BB10 BC23 BD08 BD09 5C082 AA00 BA02 BA02 BA35 BA41 BB02 BB15 BD09 CA32 CA59 CA63 DA53 DA61 DA86 MM09 MM10 5E501 AA13 AB20 AC14 AC37 DA02 EB06 FA13 FA14 FA22 FA23 5K015 AA01 AB01 AB02 JA01 JA10 JA11

Claims (14)

[Claims] 1. A conference system comprising: an image display device; and a control device capable of controlling a display state of an image on the image display device, wherein the number of the input image display devices is m (m is 2 or more). An image processing unit that generates one overlay image signal in which n image signals (n is an integer of 2 or more and m or less) out of the image signals are superimposed, and an image represented by the one overlay image signal. A display unit for displaying, wherein the control device allows a user to set a desired display state on the image display device, and operates the image processing unit in accordance with the set desired display state. And a display state control unit that supplies control information for controlling the image processing unit to the image processing unit. 2. The conference system according to claim 1, wherein the image processing unit selects one image signal of the m image signals as a reference image signal, and further includes n-1 images. An image selection unit that selects a signal as a superimposed image signal; a resolution conversion processing unit that converts each of the n image signals selected by the image selection unit into an image signal representing an image of a desired resolution; An image synthesizing unit that superimposes the (n-1) superimposed image signals on the image signal at desired positions, an image processing control unit that controls operations of the image selecting unit, the resolution converting unit, and the image synthesizing unit; The display state control unit, for controlling the operation of the image selection unit, the resolution conversion unit, and the image synthesis unit for the image processing control unit, according to the set desired display state control A conference system that supplies information. 3. The conference system according to claim 1, wherein the control device further comprises: a communication device connectable to a predetermined communication line; and an image signal corresponding to image data received by the communication device. A conference system comprising: a reception image processing unit that generates and outputs the image data to the image display device; and a transmission image processing unit that obtains image data represented by an input image signal and transmits the image data by the communication device. 4. The conference system according to claim 1, wherein an image signal output from a computer is input as at least one of the m image signals. A possible conferencing system. 5. A conference system, comprising: an image display device capable of displaying a plurality of images represented by m input image signals (m is an integer of 2 or more) on the same screen; And a display state control unit capable of communicating with the image display device an instruction for setting a desired display state of each of the images represented by the m image signals. 6. The conference system according to claim 5, wherein the desired display state includes at least one of a display position, a display size, and a display superimposition priority condition.
Conference system. 7. The conference system according to claim 5, further comprising: a communication control unit capable of bidirectionally communicating at least one of an image signal and an audio signal from the other party to the display state control unit. system. 8. The conference system according to claim 5, wherein the display state control unit outputs one audio signal among m audio signals corresponding to the input m image signals as an audio output. A conference system, wherein instructions for selecting can be communicated to the image display device. 9. The conference system according to claim 7, wherein the display state control unit is capable of communicating a command for a desired audio output state of the audio output to the image display device. 10. An input m number (m is an integer of 2 or more)
A control device capable of controlling a display state of an image display device capable of displaying a plurality of images represented by the image signals on the same screen, wherein a desired display state for each of m image signals input to the image display device is displayed. A control device comprising: a display state control unit capable of communicating an instruction for setting to the image display device. 11. The control device according to claim 10, wherein the desired display state includes at least one of a display position, a display size, and a display superimposition priority condition.
Control device. 12. The control device according to claim 10, further comprising a communication control unit capable of bidirectionally communicating at least one of an image signal and an audio signal from a partner with respect to the display state control unit. apparatus. 13. The control device according to claim 10, wherein the display state control unit outputs one audio signal of m audio signals corresponding to the input m image signals as an audio output. A control device capable of communicating an instruction for selecting to the image display device. 14. The control device according to claim 12, wherein the display state control unit is capable of communicating a command for a desired sound output state of the sound output to the image display device.