JP2009177592A - Communication terminal device, and image display control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To grasp who the user of a voice terminal is, as much as possible by viewing a terminal image indicating a connection destination terminal, when a video and voice terminal in a television conference system communicates with a voice terminal, capable of transmitting voice only. <P>SOLUTION: Address book data are stored in a television conference terminal. Thumbnail image data, name data, telephone number data, IP address data, or the like, each corresponding to a user for respective terminal device connected for communication can be registered in this address book. When the television conference terminal is connected to the voice terminal, image of the thumbnail image datum, the name indicated by the name data, the telephone number indicated by the telephone number data, and the IP address data indicated by the IP address data, which are registered in the address book corresponding to the voice terminal, are displayed in the terminal image displayed on the television conference terminal side. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to, for example, a communication terminal device capable of transmitting and receiving video and audio, and an image display control method executed by the communication terminal device, as constituting a video conference system.

In the video conference system, a terminal device compatible with the video conference system is provided for each place such as a conference hall separated from each other, and an imaging device and a display device are connected to the terminal device. Then, in one conference hall as one near end, for example, a captured image obtained by imaging a conference participant or the like in the conference hall with an imaging device is connected to another conference hall at the far end via the terminal device. To the terminal device. The far-end terminal device receives the captured image transmitted from the near-end side and displays it on a display connected to itself.
In addition, a microphone and a speaker are also connected to the terminal device, and a near-end speaker's voice signal obtained by collecting sound by the near-end microphone is transmitted to the far-end side via the terminal device. The far-end terminal device outputs the received audio signal from the speaker.
Thereby, depending on the video conference system, it is possible to proceed with the conference by having a conversation while displaying the state of the conference room of the communication partner on the display device.

  Further, terminal devices for video conference are known that can be connected to a terminal device such as a mobile phone or an IP phone via a gateway or the like. When such a terminal device is an audio communication terminal device that does not have a video transmission function, it is impossible to receive and display a captured image as described above, and therefore it can be reproduced and output. Is voice only. In a video conferencing terminal that originally has a display function, the situation in which only audio is reproduced and output in this way makes it difficult to proceed with the conference, for example, it is difficult to know who the speaker is. It is easy to cause.

  Therefore, for example, in Patent Document 1, when a telephone terminal that does not have a TV camera is connected to the video conference apparatus, when the speech voice of the telephone terminal is detected as the maximum sound pressure level, the character relating to the speaker is described. It is described that the information is displayed on the screen.

JP-A-6-284419

  Also in the present invention, in a state where the video conference terminal device is connected to the voice communication terminal device, information related to the voice communication terminal device is to be presented as an image, and moreover, by using a more efficient image. The purpose is to present information.

In view of the above-described problems, the present invention is configured as a communication terminal device as follows.
That is, a communication connection unit that performs communication connection for transmission / reception of video signals and / or audio signals with other communication terminal devices, and an individual address associated with each other communication terminal device that can communicate with the communication connection unit Address book data that stores and manages address book data that can register user information having predetermined information contents related to the user of another associated communication terminal device as individual address data. As a communication terminal image corresponding to the storage management means and another communication terminal device connected in communication, a video signal transmitted from the other communication terminal device received by the communication connection means can be displayed and output as an image. An audio communication terminal capable of transmitting only an audio signal without transmitting a video signal among other communication terminal devices connected for communication Display control for displaying and outputting a communication terminal image in which the content of the predetermined user information registered in the individual address data associated with the voice communication terminal device is displayed in a predetermined manner when there is a device. Means.

  The communication terminal device having the above configuration stores and manages address book data including individual address data corresponding to each other terminal device that is a communication connection destination. If the other terminal device connected for communication is a voice communication terminal device, the contents of the user information registered in the individual address data in association with the voice communication terminal device are displayed as a communication terminal image. I am going to do that.

In this way, in the present invention, the communication terminal image corresponding to the voice communication terminal device can be the content reflecting the data content of the user information registered in the address book data. Thereby, for example, even if the video from the voice communication terminal device cannot be displayed, it is possible to easily understand who the user of the voice communication terminal device is.
In the present invention, user information registered in the address book data is used. This can be said to be an effective use of address book data. In addition, by using the address book data, for example, it is not necessary to input again the contents such as characters and images to be displayed on the communication terminal image of the voice communication terminal device, and for example, the trouble of preparing for the meeting is saved.

As the best mode for carrying out the present invention (hereinafter referred to as an embodiment), the present invention is applied to a terminal device (video conference terminal device) provided in a video conference system (video conference system).
A video conference system installs a video conference terminal device, which is a communication terminal, for each conference hall at different locations. From this video conference terminal device, an image captured by an imaging device and audio collected by a microphone are transmitted to another video conference. The terminal device is configured to transmit the image and the sound transmitted from another video conference terminal device, and to output from the display device and the speaker, respectively. That is, the video conference system includes a video transmission / reception system that transmits / receives images to / from each other and an audio transmission / reception system that transmits / receives audio to / from each other.

FIG. 1 shows a configuration example of a video conference system.
In this case, two places A and B that are separated from each other are used as conference halls, and the video conference terminal apparatuses 1-1 and 1-2 are installed in these places A and B, respectively. These video conference terminal apparatuses 1-1 and 1-2 are connected by a communication line 101 corresponding to a predetermined communication method so that mutual communication is possible.
In place A, an imaging device 2-1, a pan head 3-1, a display device 4-1, a speaker 6-1, and a microphone 7-1 are provided together with the video conference terminal device 1-1.
The imaging device 2-1 includes a zoom mechanism for adjusting the angle of view, and is attached to the pan head 3-1. The camera platform 3-1 includes a pan mechanism and a tilt mechanism, so that the imaging direction (imaging field of view) of the attached imaging device can be changed in the vertical direction and the horizontal direction within a predetermined angle range. .
The remote controller 5-1 is provided for the user to remotely control the operation of the video conference terminal device 1-1.
From the speaker 6-1, as will be described later, for example, an audio signal transmitted from the far-end video conference terminal device 1-2 can be reproduced and output as audio.
The microphone 7-1 collects sound. The audio signal obtained by this sound collection can be transmitted by the video conference terminal device 1-1 to, for example, the far-end video conference terminal device 1-2.
Similarly, in the place B, an imaging device 2-2, a pan head 3-2, a display device 4-2, a speaker 6-2, and a microphone 7-2 are provided together with the video conference terminal device 1-2.

  In the following description, the TV conference terminal device, the imaging device, the pan head, the display device, the remote controller, the speaker, the microphone, etc. The conference terminal device 1, the image pickup device 2, the camera platform 3, the display device 4, the remote controller 5, the speaker 6, the microphone 7, and the like are used.

The basic operation of the video conference system shown in this figure is as follows, for example.
First, a video signal obtained by imaging by the imaging device 2-1 at the location A is input to the video conference terminal device 1-1. The video conference terminal device 1-1 transmits the input video signal to the video conference terminal device 1-2 via the communication line 101. The video conference terminal device 1-2 receives the transmitted video signal, and reproduces and outputs it as an image by the display device 4-1.
Similarly, a video signal obtained by imaging by the imaging device 2-2 in the place B is transmitted to the video conference terminal device 1-1 by the video conference terminal device 1-2. The video conference terminal device 1-1 outputs the received video signal from the display device 4-1. At this time, for example, a moving image is displayed on the display device as a captured image captured by the imaging device 2-2 at the location B on the far end side.

  Also, the audio signal obtained by collecting the sound with the microphone 7-1 at the location A is transmitted from the video conference terminal device 1-1 to the video conference terminal device 1-2 at the location B via the communication line 101. The video conference terminal device 1-2 receives the transmitted audio signal and reproduces and outputs it as audio from the speaker 6-2. Similarly, an audio signal picked up by the microphone 7-2 at the location B and transmitted by the video conference terminal device 1-2 is received by the video conference terminal device 1-1 at the location A, and is voiced from the speaker 6-1. Is reproduced and output.

  As described above, the video transmission / reception system and the audio transmission / reception system of the video conference system perform bidirectional communication of video and audio, respectively. It is possible to visually grasp the state of the conference hall in another place displayed on the display device 4. In addition, for example, a conference participant in a certain place can listen to the voice spoken by the conference participant in a conference hall in another location from the speaker 6. In this way, conference participants in remote locations can communicate with each other, for example, to advance the conference.

  FIG. 2 shows a video conference system provided in one place together with an internal configuration example of the video conference terminal device 1. In correspondence with FIG. 1, the video conference terminal devices 1-1 and 1-2 may be considered as having the configuration shown in FIG. 2 in common.

The imaging apparatus 2 in this case includes an optical system for imaging and a signal processing unit that generates a video signal as an uncompressed moving image using imaging light. A video signal (captured video signal) output from the imaging device 2 is input to the video signal processing / display control unit 11 in the video conference terminal device 1.
Further, corresponding to the optical system of the image pickup apparatus 2, a zoom mechanism unit 2a including a mechanism for changing the angle of view by moving the position of the zoom lens is provided.
The pan head 3 includes a pan mechanism unit 3a that is a mechanism for changing the imaging field of view of the attached imaging device 2 to the left and right, and a tilt mechanism unit 3b that is a mechanism for changing the imaging field of view up and down. It has.

  The video signal processing / display control unit 11 performs predetermined signal processing on the input video signal as necessary, and executes display control for causing the display device 4 to display an image.

  For example, the video signal processing / display control unit 11 performs necessary signal processing on the captured video signal input from the imaging device 2 as necessary, and transfers the processed video signal to the video encoder 12.

  The video encoder 12 performs an image compression encoding process by a predetermined method on the input video signal, and transfers it to the communication unit 14. Under the control of the control unit 18, the communication unit 14 transmits the compressed image data transferred from the video encoder 12 to the connection destination communication terminal device via the communication line 101 according to a predetermined communication method. .

The compressed image data transmitted from other video conference terminal devices is received by the communication unit 14 and transferred to the video decoder 13.
The video decoder 13 executes demodulation (decoding) processing for image compression coding on the input compressed image data to obtain a video signal in a predetermined format. The video signal thus obtained is transferred to the video signal processing / display control unit 11.

The video signal processing / display control unit 11 can execute display control for causing the display device 4 to display an image of the video signal transferred from the video decoder 13 as described above, for example. As a result, images taken in other conference halls are displayed on the display device 4.
In addition, the video signal processing / display control unit 11 may execute display control so that the display device 4 displays the captured video signal obtained based on imaging by the imaging device 2 in a predetermined manner. It is possible.
Further, the video signal processing / display control unit 11 can execute image generation processing and display control processing for displaying various operation images on the display device 4 under the control of the control unit 18.
The video signal processing / display control unit 11 can be configured by a DSP (Digital Signal Processor) for a part or all of the functions thereof.

The collected sound signal obtained by collecting sound by the microphone 7 is converted into a digital sound signal in, for example, PCM (Pulse Code Modulation) format by the A / D converter 23 and input to the sound signal processing unit 21.
The audio signal processing unit 21 is a part that performs necessary audio signal processing by digital signal processing, for example, on the input audio signal. For example, the audio signal processing unit 21 can transfer a digital audio signal input from the A / D converter 23 to the audio encoder 13 after performing predetermined signal processing as necessary. The voice encoder 13 performs voice compression coding on the input PCM format voice signal by a predetermined method and outputs the result to the communication unit 14. The communication unit 14 transmits the compressed audio signal data transferred from the audio encoder 24 to the connection destination communication terminal device via the communication line 101 under the control of the control unit 18. In this way, the near-end speaker voice can be transmitted to the communication terminal apparatus at the connection destination (far-end side).

  The compressed audio signal data transmitted from the connection destination communication terminal apparatus is received by the communication unit 14 and transferred to the audio decoder 25. The audio decoder 25 performs demodulation (decoding) processing for audio compression coding on the input compressed audio signal data, obtains a PCM format audio signal, and transfers it to the audio signal processing unit 21.

The audio signal processing unit 21 can transfer the digital audio signal transferred from the audio decoder 25 to the D / A converter 22 after performing signal processing as necessary.
The D / A converter 22 converts the input digital audio signal into an analog signal and outputs the analog signal. The audio signal output in this way is output to the speaker 6 after being actually amplified, for example. Thereby, the speaker 6 reproduces and outputs the speaker voice transmitted from the communication terminal device of the connection destination.

As can be seen from the above description, the voice transmission / reception system in the video conference end system is called a voice call system, but if such a voice call system is used as it is, echo, howling, etc. It is known to cause a phenomenon. That is, the sound emitted from the speaker 6 to the space reaches the microphone 7 through a spatial propagation path (echo path) as a direct sound and an indirect sound. That is, the voice of the partner speaker transmitted from the connection destination communication terminal apparatus and emitted from the speaker 6 is picked up by the microphone 2 and transmitted again to the connection destination communication terminal apparatus. Also on the connection destination communication terminal device side, the sound emitted from the speaker is further picked up by the microphone and transmitted to this communication terminal device. That is, in the loudspeaker communication system, the sound once released into the space is transmitted and received while circulating between the communication terminal devices. As a result, the sound emitted from the speaker includes a sound in which the voice he / she is currently speaking can be heard with a certain delay time. This is an echo, and howling occurs when the loop gain exceeds 1.
The audio signal processing unit 21 can be configured to execute signal processing for canceling the above-described echo by, for example, adaptive processing.
In addition, part or all of the functions of the audio signal processing unit 21 can be configured by a DSP.

  In addition, the video conference terminal device 1 has a function of variably controlling the imaging field of view of the imaging device 2. Here, the imaging field of view is variable by a combination of pan control, tilt control, and zoom control. Pan control and tilt control are controls that change the imaging direction (imaging field of view) of the imaging device in the horizontal direction and the vertical direction, respectively. Zoom control is a control that changes the angle of view of the imaging device. Correspondingly, the video conference terminal device 1 includes a PTZ (PTZ: Pan (Panning), Tilt (Tilting), Zoom (Zooming)) drive control unit 15.

The PTZ drive control unit 15 includes a pan / tilt drive control unit 16 and a zoom drive control unit 17 as illustrated.
The pan / tilt drive control unit 16 generates a drive signal for driving the pan motor in the pan mechanism unit 3a that is supposed to be provided in the pan head 3 in accordance with the movement amount instruction information in the pan direction from the control unit 18. Output. Similarly, a drive signal for driving the tilt motor in the tilt mechanism unit 3b provided in the pan head 3 is generated and output according to the movement amount instruction information in the tilt direction from the control unit 18. As a result, it is possible to perform control to change the imaging direction in the horizontal direction (pan direction) and the vertical direction (tilt direction) as the imaging field of the imaging device 2.
Further, the zoom drive control unit 17 generates a drive signal for driving the zoom motor in the zoom mechanism unit 2 a provided in the optical system of the imaging device 2 in accordance with the instruction information of the angle of view change from the control unit 19. And output. Thereby, it is possible to control to change the angle of view as the imaging field of view.

  The control part 18 is comprised by the microcomputer etc. which have CPU, ROM, RAM etc., for example, and performs the whole control about the video conference terminal device 1. FIG.

The storage unit 19 is composed of, for example, a non-volatile storage device, and stores various programs and data necessary for the control unit 18.
Corresponding to the present embodiment, the storage unit 19 stores address book data 19a. The address book data will be described later.

  The remote controller 5 includes necessary operators for the user to perform various operations regarding the operation of the video conference terminal device 1, and transmits command signals by infrared rays or radio waves in accordance with operations on these operators. To do. The command signal is received and demodulated by the receiving unit 20 to be converted into an operation information signal and input to the control unit 18. The control unit 18 executes necessary control and processing in response to the input operation information signal.

By the way, as described so far, the video conference terminal device 1 has a video / audio signal transmission / reception function, whereby the video conference terminal device 1 mutually receives the video signal of the captured image and the collected sound. Thus, a so-called video conference can be performed by transmitting and receiving audio signals and reproducing and outputting the received video and audio signals.
However, the video conference terminal device 1 can be connected to an audio terminal device that does not have a video signal transmission function but only an audio signal transmission / reception function via the communication line 101 to construct a video conference system. Has been. In this case, the video conference terminal device 1 performs transmission / reception of, for example, only an audio signal with the audio terminal device, and reproduces and outputs the received audio signal from the speaker 6.

Here, FIG. 3 shows an example of forming a video conference system including one video conference terminal device 1 and a plurality of audio terminal devices.
In this figure, five locations A, B, C, D and E are shown. In the place A, a video conference terminal device 1 similar to that shown in FIGS. 1 and 2 and peripheral devices (imaging device 2, pan head 3, display device 4, remote controller 5, speaker 6, and microphone) are provided. 7) is installed.
In the remaining locations B, C, D, and E, there are audio terminal devices 100-1, 100-2, 100-3, and 100-4 as telephones or mobile phones, respectively.
The video conference terminal device 1 and the audio terminal devices 100-1, 100-2, 100-3, 100-4 are connected to each other via the communication line 101 so as to be able to communicate with each other. .
In practice, there may be a gateway for connecting the voice terminal apparatuses 100-1, 100-2, 100-3, and 100-4 to the communication line 101. Here, however, the illustration and description are simplified. Therefore, the gateway is not shown. Further, hereinafter, the voice terminal devices 100-1, 100-2, 100-3, and 100-4 may be referred to as the voice terminal device 100 when it is not necessary to distinguish them individually.

In the configuration of such a video conference system, each of the audio terminal devices 100 that do not have a video signal transmission / reception function is different from the other communication terminal devices (the video conference terminal device 1 and the other audio terminal devices 100). Transmit the audio signal of the transmitted voice. The other communication terminal apparatus receives the audio signal transmitted in this way, and outputs it from the speaker as audio.
In addition, the video conference terminal device 1 operates so as to transmit only the audio signal without transmitting the video signal to each of the audio terminal devices 100. The audio signal to be transmitted here is, for example, a collected sound obtained by collecting sound by the microphone 7. Each voice terminal device 100 receives the voice signal transmitted in this manner and outputs it from a speaker or the like.
In this manner, in the video conference system shown in FIG. 3, the transmission and reception of the transmitted voice and the collected voice are performed, and the voice of the received voice signal is output. I can let you.

As described above with reference to FIGS. 1 and 2, the video conference terminal device 1 according to the present embodiment receives and displays a video signal such as a captured image transmitted from another video conference terminal device. Is possible. However, since a video signal is not transmitted from the audio terminal device 100 connected as described above, a captured image cannot be displayed corresponding to the audio terminal device 100.
However, if no image corresponding to the voice terminal device 100 is displayed, there is a possibility that it will be mistaken for a failure, and there will be no interest.
Accordingly, even when the video conference terminal device 1 is connected to the audio terminal device 100, it can display some image (communication terminal image) related to the audio terminal device 100 that is assumed to be connected. It is preferable to display. As such a communication terminal image, for example, the mode shown in FIG. 4 can be considered.

  FIG. 4 shows the display screen unit 30 of the display device 4. In this case, the display screen section 30 divides the image display area into four rows and columns, as shown in the figure, and a voice terminal image 31 (31-31) is used as a communication terminal image for each of the divided image display areas. 1, 31-2, 31-3, 31-4) are arranged and displayed. Here, these four voice terminal images 31-1, 31-2, 31-3, and 31-4 are respectively voice terminal devices 100-1, 100-2, 100-3, and 100- shown in FIG. 4 is assumed to be supported.

  Taking the voice terminal image 31-1 as an example, the image content is an arrangement of an icon image 40 showing a microphone image and a character image 41 displaying characters “Voice Only”. ing. By looking at the icon image 40 and the character image 41, the conference participant who is viewing the display screen unit 30 of the display device 4 of the video conference terminal device 1 is currently connected to the voice terminal device 100 for communication. You can grasp and confirm this visually. Then, a communication terminal image (voice terminal image) having such image content is displayed for each voice terminal device that is assumed to be in communication connection. As a result, in FIG. 4, four voice terminal images 31-1, 31-2, 31 having the same image content are provided corresponding to the voice terminal devices 100-1, 100-2, 100-3, and 100-4. -3, 31-4 are displayed.

  For confirmation, it is assumed that there are four communication terminals connected to the video conference terminal device 1, and one of them is the same as or equivalent to the video conference terminal device 1, for example. It is assumed that a terminal device having a video / audio transmission / reception function according to the configuration (hereinafter also referred to as a video / audio terminal device) and the remaining three are audio terminal devices. In this case, for example, in a communication terminal image divided into four as shown in FIG. 4, an image of a video signal (for example, a captured image) transmitted from the video / audio terminal device is displayed on one communication terminal image, The voice terminal image 31 can be displayed by the remaining three communication terminal images.

  If the display shown in FIG. 4 is performed, the conference participant on the side of the video conference terminal device 1 visually grasps that it is currently connected to the voice terminal device as described above. I can. However, in this case, since the contents of the displayed voice terminal images are the same regardless of the voice terminal device, it is possible to accurately determine which conference participant each connected voice terminal device belongs to. It is very difficult to grasp. Of course, it is possible to listen to the voice transmitted from the voice terminal device 100 by being in a communication connection state, but since it depends on only the voice to identify the conference participant, it is difficult to judge. Absent.

Therefore, in the present embodiment, the audio terminal image 31 is displayed as described below.
First, since the address book data 19a stored in the storage unit 19 is used for displaying the voice terminal image 31 of the present embodiment, the contents of the address book data will be described with reference to FIG. FIG. 5 schematically shows an example of the structure of address book data.
As shown in this figure, the address book data 19a can be regarded as being formed by a set of individual address data 19b.
The individual address data 19b is generated by registering information of at least one registration item corresponding to one communication terminal device. The communication terminal device to which the individual address data 19b corresponds may be a video conference terminal device or a voice terminal device.

The individual address data 19b in this case is formed by a set of registration items (registration data) of names, telephone numbers, IP addresses, and thumbnail image data, for example, as shown in the figure.
In the name registration item, data of characters (including numbers and symbols) as names can be stored, and the character information stored here is treated as indicating the name of the user of the corresponding communication terminal device. Is called. The telephone number registration item can store data of characters (including numerals and symbols) indicating the telephone number, and the telephone number stored here is the telephone number of the corresponding communication terminal device. Are treated as The IP address registration item can store data indicating an IP address, and the data stored therein is treated as indicating the IP address set in the corresponding communication terminal device. In the following, information on the registration items of the telephone number and the IP address may be collectively referred to as “connection information”.
The thumbnail image data registration item can store image data in a predetermined image size range. The thumbnail image data stored here is handled as having some image content corresponding to the user of the corresponding communication terminal device. Actually, for example, image data of a photograph taken of a user of the corresponding communication terminal device is stored.

The video conference terminal device 1 can display and output the contents of the individual address data 19b registered as the address book data 19a as a GUI (Graphical User Interface) image. For example, the user can confirm the connection information between the user and the terminal device registered as the connection destination of the video conference system by viewing the GUI image of the address book data. Further, it is possible to select a terminal device desired to be a connection destination by performing an operation on the GUI image of the address book data, and execute a call, a connection request, or the like to the selected terminal device.
In addition, operations for new registration and update registration of the address book data 19a (individual address data 19b) can be performed by operating the GUI image of the address book data.

  FIG. 6 shows a display mode example of the voice terminal image as the present embodiment. Also in this figure, as in FIG. 4, the four audio terminal devices 100-1, 100-2, 100-3, 100 are the communication terminal devices with which the video conference terminal device 1 has established communication connection. -4.

In this figure, according to FIG. 4, the communication terminal images obtained by dividing the display area of the display screen unit 30 into four correspond to the voice terminal devices 100-1, 100-2, 100-3, and 100-4, respectively. The voice terminal images 32-1, 32-2, 32-3, and 32-4 are displayed.
As the voice terminal image 32 in this case, for example, the upper left voice terminal image 32-1 is taken as an example, and a thumbnail area A1, a name area A2, a telephone number area A3, and an IP address area A4 are arranged and formed. Can be seen as being.

  The thumbnail area A1 is an area in which, if the thumbnail image data is stored in the registered item of the thumbnail image data in the individual address data 19b of the corresponding voice communication terminal device, the stored thumbnail image data is displayed. It is. In the individual address data 19b of the voice terminal device 100-1 corresponding to the voice terminal image 32-1, it is assumed that thumbnail image data has been stored. Therefore, in the thumbnail area A1 of the voice terminal image 32-1, It is assumed that the thumbnail image data stored in the individual address data 19b is displayed. Here, an image displayed in the thumbnail area A1 based on the thumbnail image data stored in the individual address data 19b is referred to as a user thumbnail image Pus.

  The name area A2 is an area for displaying the data as the name as characters when data is stored in the name registration item in the individual address data 19b of the corresponding voice terminal device.

  In the telephone number area A3, when data is stored in the telephone number registration item in the individual address data 19b of the corresponding voice terminal device, the data as the telephone number is displayed as characters (including numbers and symbols). It is an area to do.

The IP address area A4 is an area for displaying data as the telephone number as characters when data is stored in the IP address registration item in the individual address data 19b of the corresponding voice terminal device.
As the voice terminal image 32-1, the individual address data 19b of the corresponding voice terminal device 100-1 stores data in any registered items of name, telephone number, and IP address. Accordingly, in the name area A2, the telephone number area A3, and the IP address area A4, characters (numbers and symbols) corresponding to the data stored in the individual address data 19b are displayed. It is.

In this case, the individual address data 19b corresponding to the voice terminal device 100-2 also stores the thumbnail image data and the name, telephone number, and IP address data. Also in the voice terminal image 32-2 corresponding to the voice terminal device 100-2, the user thumbnail image Pus is displayed in the thumbnail area A1, and the name area A2, the telephone number area A3, and the IP address area A4. Are displayed with characters (numbers and symbols) representing names, telephone numbers, and IP addresses in accordance with the data stored in the individual address data 19b.
Similarly, in the individual address data 19b corresponding to the voice terminal device 100-3, it is assumed that the thumbnail image data and the data of name, telephone number, and IP address are stored. Also in the audio terminal image 32-3 corresponding to the device 100-3, the user thumbnail image Pus is displayed in the thumbnail area A1, and the name area A2, the telephone number area A3, and the IP address area A4 are respectively displayed. In accordance with the data stored in the individual address data 19b, characters (numbers, symbols) representing names, telephone numbers, and IP addresses are displayed.

In contrast, in the individual address data 19b corresponding to the voice terminal device 100-4, the name, telephone number, and IP address data are stored, but the thumbnail image data is not stored. . In this case, the user thumbnail image Pus cannot be displayed in the thumbnail area A1 of the audio terminal image 32-4 corresponding to the audio terminal device 100-4. In this case, instead of the user thumbnail image Pus, a line type image Picn representing the line type used by the voice terminal image 100-4 by a symbol image is displayed in the thumbnail area A1.
In the name area A2, the telephone number area A3, and the IP address area A4, characters (numbers and symbols) representing names, telephone numbers, and IP addresses according to the data stored in the individual address data 19b, respectively. Is displayed.

Also, for the sake of confirmation here, for example, the communication terminal device with which the video conference terminal device 1 has established a communication connection is assumed to have three voice terminal devices 100-1, 100-2, 100-3. If the video / audio terminal apparatus transmits a video signal such as a captured image, the divided image area (communication) of the audio terminal image 32-4 in FIG. In the terminal image), an image of the video signal transmitted from the video / audio terminal device is displayed, and in the remaining three divided image areas (communication terminal images), an audio terminal having the same contents as shown in FIG. The images 32-1, 32-2, and 32-3 are displayed.
If the individual address data 19b is not registered for the voice terminal device with which communication connection is established, the voice terminal image 31 (hereinafter also referred to as an unregistered voice terminal image) of the mode shown in FIG. 4 is displayed. Shall be allowed to.

Thus, in the video conference terminal device 1 according to the present embodiment, when there is a voice terminal device at the connection destination, the address book data 19a includes individual address data 19b corresponding to the voice terminal device that is the connection destination. Is registered, the communication terminal image (voice terminal image 32) reflecting the data content registered in the individual address data 19b is displayed.
Thereby, the conference participant using the video conference terminal device 1 can easily recognize and grasp who the user of the voice terminal device is by looking at the voice terminal image 32.
For example, as thumbnail image data registered in the individual address data 19b, a photographic image of the user of the terminal device is generally used, and even if it is not a photographic image, it has some image content associated with the user of the terminal. In many cases. That is, the thumbnail image data of the individual address data 19b is individual to the user of the terminal device, and has image contents that can be recognized or easily recalled as the user. I can say that. Therefore, if the user thumbnail image Pus is displayed, it is possible to visually grasp who the user of the voice terminal device is by viewing this image.
Also, the name displayed in the name area A2 can be used to determine who the user of the voice terminal device is.
Further, if the conference participant of the video conference terminal device 1 remembers the telephone number or IP address of the connection destination terminal device in association with the user, the telephone number displayed in the telephone number area A3 or the IP address area A4 By looking at the IP address, it is possible to know who the user of the connected voice terminal device is.

Of the user thumbnail image Pus, the name displayed in the name area A2, the telephone number displayed in the telephone number area A3, and the IP address displayed in the IP address area A4, the user of the corresponding voice terminal device It can be said that it is the user thumbnail image Pus that easily recognizes who the person is.
The thumbnail image data of the individual address data 19b, which is the basis of the user thumbnail image Pus, is generally a photographic image of the user of the terminal device, and even if it is not a photographic image, it is associated with the user of the terminal. In many cases, it will be of the picture content. In other words, the thumbnail image data of the individual address data 19b is individual to the user of the terminal device and can be handled as having image contents that can recognize or easily recall the user. . Therefore, as long as the user thumbnail image Pus is displayed in the audio terminal image 32, for example, the conference participant who is viewing the display can find out who the user of the corresponding terminal device is, even if the name is unrecognizable. It is possible to accurately grasp whether it is.

  In the present embodiment, the information content to be displayed on the voice terminal image 32 including the user thumbnail image Pus described above uses registration data in the address book data 19a. For example, when displaying the user thumbnail image Pus, name, telephone number, address, etc. on the voice terminal image 32, the work of registering and inputting data again for displaying the voice terminal image 32 is performed. It means that there is no need.

The flowchart of FIG. 7 shows an example of a procedure executed by the video conference terminal device 1 for displaying the communication terminal image as the present embodiment described with reference to FIG.
First, in step S101, the process waits for a communication connection for video / audio transmission / reception with a certain communication terminal apparatus to be established. Then, for example, when it is determined that the negotiation process necessary for video / audio transmission or the like has been completed and the communication connection has been established, the process proceeds to step S102 and subsequent steps.

  In step S102, it is determined whether the type of the terminal device to which the connection is established corresponding to step S101 is the video / audio terminal device or the audio terminal device. This determination may be made, for example, by referring to the information on the type of the connection destination terminal device obtained in the previous negotiation process.

  If it is determined in step S102 that the terminal is a video / audio terminal device, the process proceeds to step S106, and the video conference terminal device 1 receives the connection destination image as a communication terminal image corresponding to the connection destination terminal device. Image processing control for displaying and outputting an image of the video signal transmitted from the terminal device is executed.

On the other hand, if it is determined in step S102 that it is a voice terminal device, the process proceeds to step S103.
In step S103, the address book data 19a stored in the storage unit 19 is referenced to determine whether or not the individual address data 19b corresponding to the connection destination terminal device is registered in the address book data 19a. In this determination, for example, the individual address data 19b in which the telephone number or IP address actually used for connecting to the connection destination terminal device is registered is searched. If the corresponding individual address data 19b is searched, a positive determination result is obtained in step S103, and if it is not searched, a negative determination result is obtained.

  If a negative determination result is obtained in step S103, control is performed to display the unregistered voice terminal image 31 in the mode shown in FIG. 4 as the communication terminal image. If a positive determination result is obtained, the voice terminal image 32 having the mode shown in FIG. 6 is displayed as the communication terminal image in step S104. In the following description, the voice terminal image 32 having the mode shown in FIG. 6 is referred to as an address book-compatible voice terminal image.

FIG. 8 shows an example of a procedure for displaying the address book-corresponding voice terminal image 32 as step S104.
Here, first, in step S201, it is determined whether or not thumbnail image data is registered in the individual address data 19b corresponding to the connection destination voice terminal device. If a positive determination result is obtained here, the process proceeds to step S202 to execute a process of drawing the user thumbnail image Pus in the thumbnail area A1 in the address book-corresponding voice terminal image 32, and then to step S204. move on.
On the other hand, if a negative determination result is obtained in step S201, the process proceeds to step S203, and a line type image Picn indicating the line type used for communication with the connected voice terminal device is displayed. A process of generating and rendering this in the thumbnail area A1 is executed. Note that when executing the procedure of step S203, it is necessary to specify the line type used for communication by the connected voice terminal device. For example, this is also a negotiation process for voice communication. Information indicating the line type notified in the process may be used. After the procedure of step S203, the process proceeds to step S204.

In step S204, it is determined whether or not name data is registered in the individual address data 19b corresponding to the same connection destination voice terminal device.
If an affirmative determination result is obtained as the name data is registered, in step S205, the name data is displayed using the registered name data, and the name data is displayed. The drawing is executed, and the process proceeds to step S206. If a negative determination result is obtained in step S204, step S205 is skipped and the process proceeds to step S206.

In step S206, it is determined whether or not telephone number data is registered in the same individual address data 19b.
If an affirmative determination result is obtained assuming that the telephone number data is registered, the characters indicated by the registered telephone number data are displayed in step S207 so that the drawing in the telephone number area A2 is performed. Is executed, and the process proceeds to step S208. If a negative determination result is obtained in step S206, step S207 is skipped and the process proceeds to step S208.

In step S208, it is determined whether or not IP address data is registered in the same individual address data 19b.
If an affirmative determination result is obtained on the assumption that the IP address data is registered, in step S209, the characters indicated by the registered IP address data are displayed, and the drawing in the IP address area A2 is performed. Is executed to exit this process. On the other hand, if a negative determination result is obtained, step S209 is skipped and the process is exited.

By the way, by displaying the address book-corresponding voice terminal image 32 as described so far, in the present embodiment, the communication terminal corresponding to the voice terminal device is used while the connection destination terminal is a voice terminal device. By looking at the image (that is, the address book-corresponding voice terminal image 32), it is possible to grasp who the user (conference participant) of the voice terminal device is.
However, in the conference, the speaker will change as needed. At this time, if only a video / audio terminal device is connected to a plurality of communication terminal devices, the video / audio terminal of the speaker audio is determined based on the state of the other party's speaker displayed as the communication terminal image. It is easy to know if it is from the device. On the other hand, the communication terminal image of the voice terminal device is an address book-compatible voice terminal image or an unregistered voice terminal image, which is basically displayed as a still image. For this reason, in a case where a plurality of audio terminal devices are connected to the video conference terminal device 1, a situation occurs in which speakers change among conference participants who use the audio terminal devices. It is considered that it may be difficult for a conference participant who is viewing a communication terminal image on the video conference terminal device 1 side to determine which voice terminal device the conference participant is a speaker. .

Therefore, according to the present embodiment, when a conference participant of a voice terminal device is said to be speaking and speaking, a communication terminal image corresponding to the voice terminal device is highlighted and displayed. I decided to make it.
An example of such highlighting will be described again with reference to FIG. Here, it is assumed that the user (conference participant) of the voice terminal device 100-1 among the voice terminal devices 100-1, 100-2, 100-3, and 100-4 is currently speaking. In response to this, an emphasis display frame 33 is arranged and displayed for the upper left audio terminal image 32-1 corresponding to the audio terminal device 100-1.
From this point, for example, when the user of the voice terminal device 100-1 stops speaking and no one speaks, the display of the highlight frame 33 is deleted. Further, if the user of the voice terminal device 100-2 is in a state of speaking from here, for example, the highlight frame 33 is arranged and displayed on the voice terminal image 32-2 corresponding to the voice terminal device 100-2. The

  The flowchart of FIG. 9 shows an example of a procedure that is executed by the video conference terminal device 1 in order to display the highlight frame 33 described above. The procedure shown in this figure is executed when display output of a plurality of communication terminal images corresponding to a plurality of connection destination terminal devices is performed, for example, as shown in FIG.

First, in step S301, it is determined whether or not an utterance voice is detected from a connection destination terminal apparatus that has currently established a video / audio communication connection.
In detecting the speech voice, the level of the received voice signal obtained by receiving the voice signal from the voice decoder 25 input by the voice signal processing unit 21, that is, the voice signal transmitted from the connection destination terminal device, is above a certain level. It can be detected by determining whether or not there is. In actuality, there may be a situation in which utterances from a plurality of connected terminal devices are transmitted at the same time. This detection of utterances is performed for the purpose of displaying one highlight frame 33. Therefore, in the detection of the utterance voice here, if utterance voices from a plurality of connected terminal devices are obtained simultaneously as described above, according to a predetermined rule, By detecting the speech sound for only one connection destination terminal device, the speech sound from other connection destination terminal devices is not detected. There are several possible rules at this time. For example, a speech signal determined to have the highest level may be detected as an uttered speech.
If it is determined in step S301 that an utterance voice is detected and an affirmative determination result is obtained, steps S302 and S303 are executed.

  In step S302, a process for specifying a connection terminal device (here, referred to as a target connection destination terminal device) that transmits the uttered voice detected corresponding to step S301 is executed. There are several possible mechanisms for this. For example, one is a connection in which the control unit 18 sends an audio signal detected by the audio signal processing unit 21 as an uttered voice by making an inquiry to the communication unit 14. It may be configured to recognize the destination terminal device.

  In step S303, drawing processing and display control for arranging and displaying the highlight display frame 33 are executed on the area of the communication terminal image corresponding to the target connection destination terminal device specified in step S302. It is made to go back. In this way, as long as the utterance voice is detected, the procedures of steps S302 and S303 are executed. As a result, the communication terminal image of the connection destination terminal apparatus corresponding to the uttering user is processed. Thus, the highlight frame 33 is displayed.

  On the other hand, when a negative determination result is obtained in step S301 that the utterance voice from the connection destination terminal device is not detected, the highlight display frame 33 is displayed in the image display area of the display screen unit 30 in step S304. The drawing process and the display control are executed in such a manner that is deleted.

Note that the communication terminal image in which the highlight frame 33 can be arranged and displayed includes, for example, only the audio terminal image corresponding to the audio terminal device, and the communication terminal image corresponding to the video audio terminal device. It can be considered not to display. On the contrary, the highlight frame 33 may be arranged and displayed on the communication terminal image corresponding to the video / audio terminal device according to the fact that the user of the video / audio terminal device is speaking. . In the algorithm of the flowchart shown in FIG. 9, the highlight frame 33 is displayed also for the communication terminal image corresponding to the video / audio terminal device.
Further, various display modes other than those illustrated in FIG. 6 are conceivable as the display mode for emphasizing the communication terminal image corresponding to the connection destination terminal device of the user who is assumed to be speaking.

Further, for example, the processing illustrated in FIGS. 7 to 9 is realized by a CPU that forms the control unit 18 of the video conference terminal device 1 executing a program stored in a ROM or a non-volatile memory. Can be seen as something.
Also, as described above, this program is written and stored in a ROM or the like at the time of manufacture, for example, and is stored in a removable storage medium and then installed from this storage medium (including updates). For example, it can be stored in a non-volatile storage area such as the storage unit 19. It is also conceivable that the program can be installed via a data interface under the control of another host device. Further, it may be configured to be stored in a storage device in a server or the like on a network and then downloaded and acquired from the server via a network, for example.

It is a figure which shows the example of a basic composition of a video conference system provided with the video conference terminal device corresponding to embodiment of this invention. It is a figure which shows the internal structural example of the video conference terminal device of this Embodiment with the imaging device, display apparatus, etc. which are connected with this. It is a figure which shows the structural example of the video conference system formed by connecting the video conference terminal device and audio | voice terminal device of embodiment. It is a figure which shows the example of an aspect about the audio | voice terminal image considered as an example. It is a figure which shows the structural example of address book data. It is a figure which shows the example of an aspect about the audio | voice terminal image as embodiment. It is a flowchart which shows the example of a procedure for displaying the audio | voice terminal image as embodiment. It is a flowchart which shows the example of a procedure for displaying the address book corresponding | compatible voice terminal image in embodiment. It is a flowchart which shows the example of a procedure for highlighting the communication terminal image which the meeting participant in speech corresponds.

Explanation of symbols

  1 (1-1, 1-2) video conference terminal device, 2 (2-1, 2-2) imaging device, 2a zoom mechanism unit, 3a pan mechanism unit, 3b tilt mechanism unit, 4 (4-1, 4 -2) Display device, 5 (5-1, 5-2) Remote controller, 11 Video signal processing / display control unit, 12 Encoder, 13 Decoder, 14 Communication unit, 15 PTZ drive control unit, 16 Pan / tilt drive control Unit, 17 zoom drive control unit, 18 control unit, 19 storage unit, 19a standby data, 20 timer, 21 audio signal processing unit, 24 audio encoder, 25 audio decoder, 30 display screen unit, 32 (32-1 to 32-2) 4) Voice terminal image, 33 highlight frame, A1 thumbnail area, A2 name area, A3 telephone number area, A4 IP address area

Claims (4)

Communication connection means for performing communication connection for transmission and reception of video signals and / or audio signals with other communication terminal devices;
It consists of individual address data associated with each other communication terminal apparatus that can be communicably connected by the communication connection means, and the predetermined information content related to the user of the other communication terminal apparatus associated with the individual address data Address book data storage management means for storing and managing address book data that can be registered as user information,
As a communication terminal image corresponding to another communication terminal device connected for communication, a video signal transmitted from the other communication terminal device received by the communication connection means can be displayed and output as an image, and communication connection is established. If there is an audio communication terminal device that cannot transmit a video signal and can transmit only an audio signal among other communication terminal devices that are registered, it is registered in the individual address data associated with the audio communication terminal device. Display control means for displaying and outputting the communication terminal image in which the content of the predetermined user information is indicated in a predetermined manner;
A communication terminal device comprising: Depending on the address book data storage management means, it is possible to register thumbnail image data in the individual address data,
When the thumbnail image data is registered in the individual address data, the display control means displays the image of the registered thumbnail image data in the communication terminal image.
The communication terminal device according to claim 1. Further comprising a specifying means for specifying a communication terminal device that is transmitting speech speech from among the other communication terminal devices that are connected for communication,
The display control means executes control so that display according to a predetermined mode for emphasizing a communication terminal image corresponding to the communication terminal device specified by the specifying means is performed.
The communication terminal device according to claim 2. A communication connection procedure for performing communication connection for transmission and reception of video signals and / or audio signals with other communication terminal devices;
It consists of individual address data associated with each other communication terminal device that can be communicably connected by the communication connection procedure, and the predetermined information content related to the user of the other communication terminal device associated with the individual address data An address book data storage management procedure for storing and managing address book data that can be registered as user information,
As a communication terminal image corresponding to another communication terminal device connected for communication, a video signal transmitted from the other communication terminal device received by the communication connection procedure can be displayed and output as an image, and communication connection can be made. If there is an audio communication terminal device that cannot transmit a video signal and can transmit only an audio signal among other communication terminal devices that are registered, it is registered in the individual address data associated with the audio communication terminal device. A display control procedure for displaying and outputting the communication terminal image in which the content of the predetermined user information is indicated in a predetermined manner;
The image display control method characterized by performing.

Images