JPH1198482A - Communication terminal and image display method by the communication terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an AV meeting terminal by which a still image and a moving image are displayed on one screen and their display positions are replaced. SOLUTION: In this method, a still image coder 202 that applies coding to an input image signal to output coded still image data, a moving image coder 201 that applies coding to the input image signal to output coded moving image data, a means that sends/receives the coded still image data or the coded moving image data, a still image decoder 207 that decodes the received coded still image data, and a moving image decoder 206 that decodes the received coded moving image data. Then two of the coded still image data, the coded moving image data and the input image signal are selected, the one is displayed on a 1st area of a display screen and the other is displayed on a 2nd area and the display areas of the two image signals are replaced according to operation information of an operation device.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an AV meeting terminal for real-time communication of voices, moving images, and the like via a high-speed digital communication network such as ISDN.

[0002]

2. Description of the Related Art As a conventional AV meeting terminal, a video telephone device, a video conference device and the like are known.

[0003] These conventional AV meeting terminals enable a call using video by mutually transmitting and displaying a still image and a moving image.

[0004] As a technique related to these, techniques described in JP-A-2-39790 and JP-A-2-22989 are known.

[0005]

A conventional AV meeting terminal includes an A / D converter and a D / A converter for a still image and a moving image, respectively, and outputs a still image output from the two D / A converters. Switching between a still image display and a moving image display on a display has been performed by switching between an image signal and a moving image signal.

Alternatively, a still image and a moving image are simultaneously displayed by outputting the still image signal and the moving image signal to two different displays, respectively.

[0007] However, switching between the still image display and the moving image display is not preferable because the switching operation becomes complicated and the dialogue with the communication partner does not smoothly proceed.

On the other hand, according to the method of displaying a still image signal and a moving image signal on two different displays, two displays are required, and the terminal becomes large. Also,
When the user is watching a still image, his line of sight moves greatly, so his line of sight with the communication partner is shifted.

[0009] Accordingly, the present invention provides a method for simultaneously recording a still image and a moving image.
It is an object of the present invention to provide an AV meeting terminal that can be displayed on one screen.

Another object of the present invention is to provide an AV meeting terminal capable of simultaneously displaying two images (for example, a still image and a moving image) on a single screen and changing the display positions.

[0011]

To achieve the above object, the present invention provides an A / D converter for converting an input analog image signal into digital image data, and a digital image data converted by the A / D converter. To the ISO standard JPE
A still image coder that outputs encoded still image data by encoding according to a coding rule or the like following the G algorithm and digital image data converted by the A / D converter are, for example, CCITT Recommendation H.264. In accordance with a coding rule or the like according to H.261, one of a moving image coder that encodes and outputs encoded moving image data and one of encoded moving image data output by the moving image coder and encoded moving image data output by the still image coder is selected. Selector for decoding the input coded still image data into decoded still image data, a moving image decoder for decoding the input coded moving image data into decoded moving image data, and a still image decoder From the decoded still image data, the decoded moving image data decoded by the moving image decoder, and the digital image data converted by the A / D converter. For generating picture-in-picture image data for generating a picture-in-picture image for at least two pieces of image data of It provides a char-picture processing unit, an image codec and having the D / A converter for converting the picture-in-picture processing unit is picture-in-picture image data created analog image signal.

An image input means for inputting an image signal, an image output means for outputting an image signal, and a first encoding process (for example, a still image encoding process) on the input image signal from the image input means. First encoding means for outputting first encoded image data, and applying second encoding processing (for example, moving image encoding processing) to the input image signal to output second encoded image data. A second encoding means,
Communication control means for transmitting and receiving the first or second encoded image data via the digital communication line, and decoding and decoding the first encoded image data received by the communication control means via the digital communication line; First decoding means for generating one piece of decoded image data, and decoding the second coded image data received by the communication control means via the digital communication line to generate second decoded image data A second decoding means, and two selected from the first or second decoded image data output from the first and second decoding means and the input image signal, and the selected two Screen display processing means for performing display control to display the first image signal of the image signals in the first area of the image output means, and to display the second image signal in the second area of the image output means, Operate the above communication terminal And an operation device for displaying the first image signal displayed in the first area according to the operation information input from the operation device. And performing a display process so that the second image signal displayed in the second area is displayed in the first area.

[0013]

According to the image codec of the present invention, the picture-in-picture processing unit includes: the decoded still image data decoded by the still image decoder, the decoded moving image data decoded by the moving image decoder, and the A / D converter. Generates picture-in-picture image data for generating a picture-in-picture image of at least two of the decoded still image data, the decoded moving image data, and the digital image from the converted digital image data. Accordingly, an image indicated by the decoded image data of the still image decoder and the image indicated by the decoded image data of the moving image decoder can be displayed and output. It is sufficient to provide one D / A converter for the still picture decoder and the moving picture decoder.

The selector selects and outputs one of the encoded moving image data output from the moving image coder and the encoded moving image data output from the still image coder in a time-sharing manner, thereby providing one A / D converter. Can be used in a time-sharing manner for still picture coder and moving picture coder.

According to the communication terminal of the present invention, two are selected from the first or second decoded image data output from the first and second decoding means and the input image signal. According to the operation information input from the operation device, the display area of the selected two image signals on the display screen is switched, so that two images (for example, a still image and a moving image) are simultaneously displayed on one screen, and The display positions can be switched.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the AV meeting terminal according to the present invention will be described below.

FIG. 1 shows the configuration of an AV meeting terminal according to this embodiment.

As shown in the figure, an AV meeting terminal according to the present embodiment includes a camera 1, an LCD display 2, a dial function key 3, a VSW 4, an image codec 5, a telephone control man-machine interface 6, a multipoint conversation control 7, a multipoint conversation control 7, Media demultiplexing / terminal signal control unit 8, network interface / communication network control unit 9, D /
R10, VDT11, audio codec 12, ASW1
3, hands-free 14, handset 15, G3FAX
Interface 16, V11D / R17, RS422
D / R18, RS232C D / R19, data demultiplexing 20, communication interface matching 21, bus SW22,
It has communication ports 23 to 25, a control unit 26, peripheral device control interfaces 27 and 28, and a non-voltage contact 31.

The external input / output terminals include a video input / output interface 110 and an audio input / output interface 10.
9, microphone input 108, G3 FAX modular jack 107, V11RS422 multi-connector 106, RS
It has a 232C connector 105, a mouse jack 104, a conference operating device connector 103, and a camera control / external device multi-connector 101.

The network interface / communication network controller 9 connects to the digital communication network via the D / R 10 and performs communication control and communication processing with the network such as establishment of a communication channel with a communication partner terminal. The multimedia demultiplexing / inter-terminal signal control unit 8 performs various controls with a communication partner terminal. Further, the multimedia demultiplexing / terminal-to-terminal signal control unit 8 separates the received communication frame into data types such as video data, audio data, data, control data, and transmits various data into the transmission communication frame. Perform multiplexing. The video data is network interface data of the image codec 5, the audio data is interface data of the audio codec 12 and the network, and the data is interface data of the data demultiplexer 20. The control data is transmitted to and received from the control unit 26.

The data demultiplexing unit 20 further separates the data demultiplexed from the received communication frame by the multimedia demultiplexing / terminal signal control unit 8 for each data type in accordance with a protocol determined in advance as a destination terminal. I do.

Specifically, a CCIT is used as a communication frame.
Recommendation T. H. Assuming the frame specified in H.221,
The multimedia demultiplexing / terminal-to-terminal signal control unit 8 transmits and receives the BAS data in the frame to and from the control unit, transmits and receives the audio data to and from the audio codec 12,
TT Recommendation H. Video data such as a frame specified in H.261 is transmitted to and received from the image codec 5, and data is transmitted to and received from the data demultiplexer 20. H. When the MLP data is stored in the frame defined by H.221, the MLP data is transmitted / received between the control unit 26 and the data multiplexing unit 20 according to the control of the control unit 20.

Then, the data demultiplexing unit 20 converts the data into G3 according to a protocol determined in advance as a destination terminal.
The data is separated into FAX data, computer data, various control data, etc., and these are separated into G3 FAX modular jack 1
07 and V11RS422 multi-connector 106, RS2
Send to 32C connector 105. Conversely, G3FAX
The data received from the modular jack 107, the V11RS422 multi-connector 106, and the RS232C connector 105 are multiplexed and sent to the multimedia demultiplexing / terminal signal control unit 8.

The multipoint conversation control 7 performs a control necessary for holding and operating the multipoint video conference when the multipoint video conference is performed. When a multipoint video conference is not to be conducted, only data relay is performed. The VDT 11 is means for detecting the power supply to the station.

The camera 1 captures an image, and the LCD display 2 displays and outputs the image. The VSW 4 is a video switch for switching connections between the camera 1, the LCD display 2, the video input / output interface 110, and the image codec. The video input / output interface 110 includes:
Video input / output of an external video input / output device can be connected.

The image codec encodes the image signal input via the VSW 4 and sends the encoded image signal to the multimedia demultiplexing / terminal signal control unit 8 via the multipoint conversation control 8. Further, the multimedia demultiplexing / terminal signal control unit 8 decodes the video data separated from the received communication frame and outputs the decoded video data via the VSW 4.

The hands-free 14 is a set of a hands-free microphone and a speaker. This is a modular jack that can connect a G3 fax to the G3 fax interface 16. The audio input / output of the external audio input / output device can be connected to the audio input / output interface 109. An external microphone can be connected to the microphone input 108.

The ASW 13 is an audio switch for switching the connection between the handsfree 14, the handset 15, the G3 fax interface 16, the audio input / output interface 109, the microphone input 108, and the audio codec 12.

The audio codec 12 encodes the audio signal input via the ASW 4, and performs a multimedia demultiplexing / inter-terminal signal control unit 8 via the multipoint conversation control 8.
Send to Further, the multimedia demultiplexing / terminal signal control unit 8 decodes the video data separated from the received communication frame and outputs the decoded data via the ASW 13. Further, the audio codec 12 transmits the V11 via the V11 D / R17.
It is connected to the RS422 multi-connector 106.

The dial function key 3 is a key for receiving an instruction from a user. In response to this key input, the telephone control man-machine interface 6
3 to control hands-free 14, handset 15, G3
The FAX interface 16, the voice input / output interface 109, the microphone input 108 and the voice codec 5 are connected. The instruction by the key input is transmitted to the multipoint conversation control 7 via the telephone control man-machine interface 6. The multipoint conversation control 7 controls the multipoint video conference in accordance with this instruction.

The G3FAX interface 16 is a G3F
G which is an analog facsimile connected to the AX
The transmission signal received from the 3FAX is sent to the audio codec 12 via the ASW 13 when the FAX data is handled as audio data. When the FAX data is handled as data, the transmission signal is digitized and encoded, and the data multiplexing unit is used. Send to On the contrary, G3F
When the data received by the AX is received from the voice codec 12, the data is sent to the G3 FAX modular jack as it is, and the data received by the G3 FAX is transmitted to the data demultiplexer 20.
If it is received, it is decoded, converted to an analog signal, and sent to a G3 FAX modular jack.

The RS232C connector is a connector that can connect a computer, a word processor, and an electronic blackboard with an RS232C interface. The RS232C connector is connected to the control unit 26 or the data demultiplexing unit 20 via the bus SW. Communication interface matching 21
Is to match the data rate of the input / output data of the data demultiplexer 20 with the data rate of the input / output data of the RS232C interface. Communication ports 24, 25
Is a communication port for the RS232C interface used by the control unit 26.

V11RS422 multi-connector 106
Is a connector for connecting an external device with a V11 interface and an RS422 interface. In this embodiment, an example of connecting conference units will be described later.

The RS422 interface is connected to the control unit 26 via the bus SW. The communication port 23 is a communication port for the RS422 interface used by the control unit 26. The V11 interface is connected to the data demultiplexer 20.

The peripheral device control interfaces 27 and 28 control the components within the AV meeting terminal, the mouse connected to the mouse jack 104, and the conference operating device connected to the conference operating connector 103 according to the instructions of the control unit. Control and camera control / external device multi-connector 10
1 controls an external device such as an external camera.

The camera control / external device multi-connector 101 transmits an instruction from the control unit to the external device through a non-voltage contact.

The details of the image codec 5 will be described below.

FIG. 2 shows the configuration of the image codec 5.

In the figure, 200 is an A / D converter, 201 is a moving image coder, 201 is a still image coder, 203 is a variable length coder, 204 is a BCH, 205 is a PinP processing unit,
206 is a video decoder, 220 is a D / A converter, 207
Is a still picture decoder, 208 is a variable length decoder, 209 is a BCH, 210, 211, 212, 213, 214, 2
Reference numeral 15 denotes a video switch.

As described above, in the present embodiment, a still image and a moving image are handled.
This is performed by the converter 200. This is because normally, a still image and a moving image are not transmitted at the same time due to the transmission capacity of a communication path using a digital communication network. That is,
In order to quickly send a still image having a large amount of data to a communication partner terminal, transmission of a moving image is stopped during transmission of a still image.

In the present embodiment, the received still image and moving image are multiplexed and displayed on the same screen by the PinP processing unit described later in detail, thereby improving the usability and improving the usability of the still image and moving image. Multiplex on the same screen,
One D / A converter that converts both image data into analog signals by performing the conversion before converting each signal into analog signals is also provided.

Next, the operation of the image codec will be described.

When an image signal is input via the VSW 4, the A / D converter 200 converts the image signal into a digital value. In the present embodiment, an NTSC signal is assumed as an input image signal, but the same applies to a signal conforming to another standard such as PAL or RGB. The digitized image data is sent to the PinP processing 205 as own image data.

Under control of the peripheral device control interface 27, the video switches 210 and 211 convert the digitized image data into the moving image coder 201 or the still image coder 2 depending on whether the input image signal is a still image or a moving image.
02.

The moving image coder 201 converts the received image data into CCITT recommendation H.264. DCT specified in H.261
Encoding is performed according to the following coding rule. In addition, the still image coder 20
2 encodes the received image data according to a predetermined coding rule. Upon receiving the encoded image data from either the moving image coder 201 or the still image coder 202, the variable length coder 203 converts the received image data into H.264. 261 is variable-length coded according to the variable-length coding rule specified in H.261. The BCH 204 receives the variable-length coded image data from the variable-length coder 203,
H data is added to the data and transmitted to the multimedia demultiplexing / terminal signal control unit 8 via the multipoint conversation control 7 as video data.

On the other hand, when the BCH 209 receives video data or still image data from the multimedia demultiplexing / terminal signal control unit 8 via the multipoint conversation control 7, it checks the BCH data and performs error correction. The error-corrected video data or still image data is sent to the variable length decoder 208. Variable length decoder 2
08 receives the image data. Decoding is performed according to the variable length coding rule specified in H.261. Variable length decoder 208
Is transmitted to either the moving picture decoder 206 or the still picture decoder 207 via the video switch 215 depending on whether the data is video data or still picture data. When the video decoder 206 receives the video data decoded by the variable length decoder 208, the video data Decoding is performed according to the coding rule defined in H.261. When the still image decoder 207 receives the video data decoded by the variable length decoder 208,
Decoding is performed according to a predetermined coding rule such as a coding rule following the O standard JPEG algorithm. Image data decoded by the moving image decoder 206 or the still image decoder 207 is Pi as received moving image data or received still image data.
Sent to nP processing section 205.

[0047] The PinP processing unit 205
Using the self-image data transmitted from the A / D converter 200 and the image data decoded by the moving image decoder 206 or the still image decoder 207, a PinP process described later is performed, and the image data subjected to the PinP process is D / A converted. Vessel 2
Send to 20. The D / A converter 220 converts the received image data into an analog signal, and
Sent to

This image signal is supplied to the video switch 4
Is displayed on an LCD display or the like in accordance with the operation of.

Next, the details of the PinP processing section 205 will be described.

FIG. 3 shows the configuration of the PinP processing unit 205.

In the figure, reference numeral 301 denotes a self-picture frame memory;
02 is a still image frame memory, 303 is a decoding frame memory, 305, 306, and 307 are MUX, and 308 is
A parent screen address generator, 309 is a child screen address generator, 310 is a display screen timing controller, and 311 is an MU.
X.

Next, Pi performed by PinP processing section 205
The nP process will be described with reference to FIG.

The PinP process is a process for generating a picture-in-picture image from a plurality of images.
That is, as shown in FIG. 4, the two image data are multiplexed and output so that different images are displayed and output in the main screen area and the child screen area.

In this embodiment, of the three image data of the self image data received from the A / D converter 200, the received still image data received from the still image decoder 207, and the received moving image data received from the moving image decoder 206, Are multiplexed and output so as to be displayed and output in the parent screen area and the child screen area. As described above, two out of the three image data of the self image data, the received still image data, and the received moving image data,
When one image data is selected and the PinP process is performed, the six types of picture-in-picture images that can be generated are shown in FIGS.

The PinP processing operation of the PinP processing unit 205 will be described.

The self-image frame memory 301 stores the transmitted self-image data. Still image frame memory 3
02 stores received still image data. The moving image frame memory stores the received moving image data. The contents of each frame memory are updated each time.

The parent screen address generator 308 generates an address for reading out the image data in the display order from the frame memory storing the image data to be displayed on the parent screen.
While the address generated by the parent screen address generation unit 308 generates an address corresponding to the child screen area, the child screen address generation unit 309 stores image data displayed on the child screen in parallel with the address. An address for reading image data from the frame memory in the display order is generated. The address generation timing of the small screen address generation unit 309 is controlled by the display timing control unit. Also, as shown in FIG. 4, the image displayed in the small screen area must be reduced. Therefore, the sub-screen address generation unit 309
In accordance with the reduction ratio, discrete addresses are generated, and pixels are thinned out from the frame memory to read out image data.

The address generated by the parent screen address generator 308 is given by the MUXs 305, 306 and 307 to a frame memory storing image data to be displayed on the parent screen. Also, the sub-screen address generation unit 3
09 is generated in MUXs 305, 306, 3
07 is given to the frame memory storing the image data to be displayed on the child screen.

The MUX 311 is a parent screen address generation unit 3
While the address 08 generates an address corresponding to the small screen area, the image data read from the frame memory storing the image data to be displayed on the small screen is selected and output. In other cases, the image data read from the frame memory storing the image data to be displayed on the main screen is selected and output. The switching timing is controlled by the display timing control unit.

Each frame memory of the PinP processing unit 205 is shared with a frame memory used by the moving picture coder 201, the still picture coder 202, the moving picture decoder 206, and the still picture decoder 207 for encoding and decoding. Is also good.

Next, the G3 FAX interface 16
Will be described in detail.

FIG. 5 shows the configuration of the G3 FAX interface 16.

In the figure, 501 is a hybrid, 502 is a root SW, 503 is a FAX codec, and 504 is a FA
X incoming / outgoing call control.

FAX call control 504 is performed by the control unit 26 via the peripheral device control interface 27 by the G3F
When the reception of the AX data is notified, the ringer signal is transmitted to the G3F.
AX modular jack (modular jack) 108. The FAX call control 504 is a G3FA
An off-hook or on-hook of the G3 FAX connected to the X modular jack 108 is detected and transmitted to the control unit 26 via the peripheral device control interface 27. If necessary, the contents of the dial ring of the G3 FAX connected to the G3 FAX modular jack 108 are transmitted to the control unit 26 via the peripheral device control interface 27.

The hybrid 501 has a G3 FAX modular jack half-duplex interface and a root SW.
Align with the front double interface on the side. Route S
W502 connects the hybrid 501 and the audio codec when the controller 26 notifies the controller 501 via the peripheral device control interface 27 that the G3 FAX data is handled as audio data. The result voice codec encodes the data transmitted by the connected G3 FAX and sends it as audio data to the multimedia demultiplexing / terminal signal control unit 8 via the multipoint conversation control 7.

On the other hand, when the control unit 26 notifies the control unit 26 via the peripheral device control interface 27 that the G3 FAX data is handled as data, the route SW
The codec 503 for connection and the hybrid 501 are connected.
The FAX codec 503 encodes the data transmitted by the connected G3 FAX according to the μ / A rule, ADPCM, or the like,
The data is sent to the multimedia demultiplexing / inter-terminal signal control unit 8 via the data demultiplexing unit 20 as data.

As described above, according to the present embodiment, the normal G
The 3FAX can be used by connecting to the AV meeting terminal with the interface as it is. Further, by encoding the G3 FAX data using the FAX codec 503 and handling it as data,
A call can be made using the voice codec 12 even during G3 FAX communication.

Next, the camera control / external device multi-connector 101 will be described.

The AV meeting terminal according to the present embodiment comprises:
An external camera, an external monitor, an external microphone external speaker, and the like can be connected by the video input / output interface 110, the audio input / output interface 109, the microphone input 108, and the like.

Camera control / external device multi-connector 10
Reference numeral 1 denotes a connector for controlling an external camera, an external microphone, and external camera illumination among these external input / output devices. Control using the camera control / external device multi-connector 101 is performed by an instruction from the dial function key 3 or an instruction from an operation device connected to the conference operation device connector 103, or multimedia demultiplexing / terminal signal control. The control unit 26 controls the non-voltage contact 31 such as a relay contact according to control data received from a communication partner terminal received via the unit 8. Note that, as described above, the CCITT Recommendation H.264 is used as a communication frame. Assuming the frame defined in H.221, the control unit 26 sends the BAS or MLP from the communication partner terminal.
According to the data, the control data is received and the non-voltage contact 31
Control.

FIG. 6 shows the configuration of the camera control / external device multi-connector 101. As shown, the zoom 61
2, 613, focus 610, 609, illumination 608,
Wiper 607, pan 606, 605, tilt 604,
603, camera microphone switching 602, 601, power supply 6
00 signal.

Based on these signals, the control unit 26 controls the zoom and focus of the external camera, the illumination for the external camera, the wiper, the pan, and the tilt through the camera control / external device multi-connector 101, and switches the camera microphone. By controlling, it is possible to control ON / OFF of a power supply of an arbitrary external device.

Next, the V11RS422 multi-connector 1
06 will be described.

V11RS422 multi-connector 106
Is a connector including a V11 interface and an RS422 interface.

In this embodiment, the V11RS422 multi,
It is assumed that a conference unit to be described later is connected to the connector 106.

The RS422 interface in the V11RS422 multi-connector 106 is connected to the control unit 26 via the communication port 23. The control unit 26 uses RS422
The control data is transmitted / received to / from the conference unit using the interface.

The V11 interface in the V11RS422 multi-connector 106 is connected to the data demultiplexer 20 and the audio codec 12. The data demultiplexing section 20 separates the control data and data received from the multimedia demultiplexing / terminal-to-terminal signal control section 8 based on the control of the control section 26, and separates the separated control data and data into V1.
Send to one interface. The data demultiplexing unit 20
Conversely, it multiplexes control data and data received from the V11 interface with FAX data and the like received from the G3 FAX interface and sends the multiplexed data to the multimedia demultiplexing / terminal-to-terminal signal control unit 8. Note that the above-described H.264 is used as a communication frame. When 221 frames are used, the control data can use MLP data.

The data from the data demultiplexing section 20 to the V11 interface is transmitted as it is as the burst data, which is obtained by separating and extracting data from the communication frame. The data from the V11 interface to the data demultiplexing unit 20 is also burst data having the same transfer rate as the data in the communication frame.

As described above, in this embodiment, the data area and the control data area of the communication frame can be opened to the outside as they are. Accordingly, the V11 interface can freely use a predetermined data area or control data area in the communication frame.

FIG. 7 shows the basic configuration of the V11RS422 multi-connector 106.

In the figure, 700 to 702 are RS422 interfaces, and 703 to 710 are V11 interfaces.

The RS422 interface has transmission data 700, reception data 701, and transfer clock 702. The V11 interface includes transmission data 703,
Transmission burst clock 7 synchronized with transmission burst data
04, transmission frame sync 705, reception data 706,
Receive burst clock 7 synchronized with receive burst data
07, a reception frame sync 708, and two types of basic clocks 709 and 710.

Next, FIG. 8 shows the appearance of the AV meeting terminal according to the present embodiment.

FIG. 8A is a perspective view as viewed obliquely from the front, FIG.
Is a rear view of a part for illustrating the arrangement of connectors.

Next, the configuration of an AV meeting system using the AV meeting terminal according to the present embodiment is shown in FIGS. In the figure, reference numeral 1000 denotes an AV meeting terminal.

FIG. 9 shows an AV meeting system suitable for making a one-on-one personal telephone call.
Is an AV meeting system suitable for small-group video conference, FIG. 11 is a simplified AV meeting system for video conference, and FIG. 12 is an AV meeting system suitable for full-scale video conference.
FIG. 13 shows the structure of an AV meeting system suitable for a more advanced video conference.

As shown, according to the AV meeting terminal of this embodiment, the video input / output interface 11
0, audio input / output interface 109, microphone input 10
8, G3 FAX modular jack 107, V11RS
422 multi connector 106, RS232C connector 1
05, mouse jack 104, conference controller connector 1
03, G3 FAX 900, computer 901 such as personal computer or word processor, camera 9 by camera control / external device multi-connector 101
03, a monitor 904, a microphone 905, a camera pan tilter (head) 906, a conference operation device 907, and the like. Accordingly, an AV meeting system can be flexibly configured according to the purpose of use.

In particular, according to the AV meeting terminal according to the present embodiment, as described above, the external interface using the digital data of the audio codec 12 is connected to the V11RS4.
Since it is provided in the 22 multi-connector 106, as shown in FIG. 12, a high-performance digital echo canceller 1200 can be provided outside if necessary.

As shown in FIG. 13, a G3 FAX 900, a data system device 901 such as an electronic blackboard such as a personal computer or a word processor, a camera 903, a monitor 904, a microphone 905, and a camera pan tilter 906 are provided via a conference unit 1300. , A conference operation device 907 and the like are connected, and the conference unit 1300
A more advanced conference function may be realized.

As shown, the conference unit 1300
Has a video control unit 1301, an audio control unit 1302, a unit control 1303, a video processing 1305, and a power supply unit 1306. The video control unit 1301 connects to the video input / output interface of the AV meeting terminal. The audio controller 1302, the unit controller 1303, and the video processor 1305 are connected to the V11RS422 multi-connector 106 of the AV meeting terminal via an AV meeting terminal data interface (not shown).

The unit control unit 1303 is provided for the conference operation device 9.
07 or the control unit 26 of the AV meeting terminal received via the RS422 interface.
Of the conference unit 1300 according to an instruction from the user or control data received from a communication partner terminal via the V11 interface. Also, the unit control unit 1303 mediates data received from a communication partner terminal via the V11 interface between the data system device 901 such as an electronic blackboard such as a personal computer or a word processor and the V11 interface.

The image control unit 1301 and the still image processing
It controls switching of cameras and monitors connected to the video input / output interface of the meeting terminal. The audio control unit 1302 controls switching of a microphone speaker or the like connected to the audio codec 12 of the AV meeting terminal via the V11 interface. Also, the voice control unit 130
2 also performs an echo cancellation process as needed. An image processing 1305 controls the camera pan / tilt 906.

As described above, according to the present AV meeting system, by using the above-mentioned data area and control data area opened to the outside, communication with the conference unit connected to the communication partner terminal such as direct control is performed. Can fit.

[0094]

As described above, according to the present invention, it is possible to provide an AV meeting terminal capable of simultaneously displaying a still image and a moving image on one screen.

Further, according to the present invention, it is possible to provide an AV meeting terminal capable of simultaneously displaying a still image and a moving image on a single screen and exchanging the display positions.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of an AV meeting terminal according to one embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration of an image codec of the AV meeting terminal according to one embodiment of the present invention.

FIG. 3 is a block diagram showing a configuration of a PinP processing unit of the AV meeting terminal according to one embodiment of the present invention.

FIG. 4 is an explanatory diagram showing a PinP process of the AV meeting terminal according to one embodiment of the present invention.

FIG. 5 is a block diagram showing a configuration of a G3 FAX interface of the AV meeting terminal according to one embodiment of the present invention.

FIG. 6 is an explanatory diagram showing a configuration of a camera control / external device multi-connector of the AV meeting terminal according to one embodiment of the present invention.

FIG. 7 is an explanatory diagram showing a configuration of a V11RS422 multi-connector of the AV meeting terminal according to one embodiment of the present invention.

FIG. 8 is an explanatory diagram showing the appearance of an AV meeting terminal according to one embodiment of the present invention.

FIG. 9 is a block diagram illustrating a configuration example of an AV meeting system according to an embodiment of the present invention.

FIG. 10 is a block diagram illustrating a configuration example of an AV meeting system according to an embodiment of the present invention.

FIG. 11 is a block diagram illustrating a configuration example of an AV meeting system according to an embodiment of the present invention.

FIG. 12 is a block diagram illustrating a configuration example of an AV meeting system according to an embodiment of the present invention.

FIG. 13 is a block diagram illustrating a configuration example of an AV meeting system according to an embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Camera 2 LCD display 3 Dial function key 4 VSW 5 Image codec 6 Telephone control man-machine interface 7 Multipoint conversation control 8 Multimedia demultiplexing / terminal signal control unit 9 Network interface / communication network control unit 10 D / R 11 VDT Reference Signs List 12 Audio codec 13 ASW 14 Hands-free 15 Handset 16 G3 FAX interface 17 V11D / R 18 RS422 D / R 19 RS232C D / R 20 Data demultiplexing 21 Communication interface matching 22 Bus SW 23 Communication port 24 Communication port 25 Communication port 26 Control unit 27 Peripheral device control interface 28 Peripheral device control interface 31 Non-voltage contact 101 Camera control / external device multi-connector 103 Conference operation device connector 104 Mouse jack 105 RS232C connector 106 V11RS422 multi-connector 107 G3 FAX jack 108 microphone input 109 audio output interface 110 video output interface

────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] August 10, 1998

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] Claims

[Correction method] Change

[Correction contents]

[Claims]

Claims (5)

[Claims] 1. A communication terminal having image input means for inputting an image signal and image output means for outputting an image signal, wherein the communication terminal transmits and receives an image signal via a communication line. A first encoding unit that performs a first encoding process on the input image signal and outputs first encoded image data; and a second encoded image that performs a second encoding process on the input image signal. Second encoding means for outputting data, communication control means for transmitting / receiving the first or second encoded image data via the digital communication line, and reception by the communication control means via the digital communication line First decoding means for decoding the encoded first encoded image data to generate first decoded image data, and second encoded image data received by the communication control means via the digital communication line. Decrypts the second Second decoding means for generating encoded image data; and selecting two of the first or second decoded image data output from the first and second decoding means and the input image signal. Performing display control so that a first image signal of the two selected image signals is displayed in a first area of the image output means and a second image signal is displayed in a second area of the image output means. Screen display processing means, comprising an operating device for operating the communication terminal, according to the operation information input from the operating device, the screen display processing means, the first displayed in the first area A communication terminal performing display processing to display the image signal in the second area and display the second image signal displayed in the second area in the first area. 2. The communication terminal according to claim 1, wherein the first encoding process is a still image encoding, and the second encoding process is a moving image encoding. Communication terminal to do. 3. The communication terminal according to claim 1, wherein said screen display processing means comprises: first storage means for storing said first decoded image data; and said second decoded image data. A communication terminal for controlling writing and reading of a second storage means for storing the input image and a third storage means for storing the input image. 4. The communication terminal according to claim 3, wherein said first decoding means and said second decoding means have a frame memory used for decoding processing, and said first and second decoding means ,
A communication terminal using the frame memory as third storage means. 5. A screen display method in a communication terminal for transmitting and receiving an image signal via a digital communication line, comprising: performing a first encoding process on an input image signal to generate first encoded image data; Applying a second encoding process to the image signal to generate second encoded image data, transmitting and receiving the first or second encoded image data via the digital communication line, and via the digital communication line Decoding the received first encoded image data to generate first decoded image data, and decoding the second encoded image data received via the digital communication line to obtain a second decoded image. Generating data, selecting two of the first or second decoded image data and the input image signal, and converting a first image signal of the selected two image signals into a first area on a screen To the second image Display control in the second area on the screen, and when operation information is input from the operating device, the first image signal displayed in the first area is displayed in accordance with the operation information. A screen display method in a communication terminal, characterized in that the screen is displayed in the second area, and the second image signal displayed in the second area is displayed in the first area.