JPH08249545A - Communication support system - Google Patents

Abstract

PURPOSE: To easily catch an opportunity for performing much surer communication based on the present state of an opposite party desired to communicate. CONSTITUTION: At each communication terminal of a communication system, a presence state judging part 3 judges presence/absence by processing an image photographed by a camera 2. When the judged result is changed from absence to presence, the presence state judging part 3 immediately transmits presence information to the other communicationn terminal requesting the transmission of presence information. At that other communication terminal where the presence information is received, a presence monitoring part 5 displays the fact of presence on a display/operation part 4 together with a sound and it is reported to a terminal user that the absent opposite party is present. Thus, that terminal user can be supported so as to immediately perform communication such as conversation with the present oppoosite party.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to communication support on a packet network. More specifically, the presence / absence of each terminal such as a video communication system is identified and
When a user of the terminal is absent from the absence of a person who wants the absent information, the person who directly receives the information is notified so that the person who receives the information can immediately communicate with the person who is immediately present. It relates to a system that supports communication so that it can be performed.

[0002]

2. Description of the Related Art For example, when making a call, there is an inconvenience such as making a call when the other party is absent because the presence state of the other party is unknown.

On the other hand, as shown in the conventional configuration example of FIG. 10, the video camera 103 is provided on the telephone 101 side.
The seating determination unit 104 processes the image captured in step S1 to determine the seating state based on the movement, transfers the processing result to the telephone 101 side, and displays it on the seating state display unit 105. There is a communication support system in which the telephone 101 side can confirm the presence and make a call. With this method,
Since the presence information of the other party can be known before the other party is called from the telephone set 101, it is possible to make a call when the other party is present.

[0004]

However, since the above-described communication support methods described above have only the function of displaying presence / absence, when the person trying to make a call is absent, If the other party wants to make a phone call as soon as he returns to his seat, there is the inconvenience of having to keep an eye on the display result changing to being seated.

The present invention has been made in order to solve such a problem, and an object thereof is to provide a communication support system which makes it easier to capture an opportunity for more reliable communication.

[0006]

In order to achieve the above object, the first invention of the present invention comprises a plurality of communication terminals capable of utilizing video or audio or video and audio, and a network connecting the plurality of communication terminals. In the video communication system described above, in each of the plurality of communication terminals, identification means for identifying whether the user is present or absent, and presence of the user when the change from absence to presence is detected by the identification result of the identification means. A means for transmitting the presence information of the user of the communication terminal to another communication terminal that has made a request to transmit the seat information, and a means for transmitting the presence information from the communication terminal to the other communication terminal. And a means for expressing the presence in the form of visual information or auditory information based on the presence information.

According to a second aspect of the present invention, in a video communication system comprising a plurality of communication terminals capable of utilizing video or audio or video and audio and a network connecting the plurality of communication terminals, In each case, the identification means for identifying whether the user is present or absent, and the information indicating whether the user is present or absent by the identification means are received each time a request for sending the information is received from another communication terminal on a regular basis. Means for transmitting, and a means for detecting a change from absent to present based on the information transmitted from another communication terminal every time a transmission request of information on presence or absence from the communication terminal is periodically made , A means for expressing the presence in the form of visual information or auditory information when the change from the absence to the presence is detected.

In the first aspect of the present invention, when a change from absence to presence is detected by the identification result of the identification means, the presence of the user of the communication terminal to another communication terminal that has requested the transmission of presence information. The means for transmitting seat information receives a request for sending the presence information once, and then the identification means periodically identifies whether the user is present or absent, and changes from absence to presence based on the identification result. It is preferable that the presence information is immediately transmitted to the other communication terminal that has made the transmission request of the presence information when the change of the presence information is detected.

In the above invention, the means for identifying whether the user is present or absent is to extract a motion from an image taken by the image pickup device provided in the communication terminal, and the time during which the extracted motion continues is predetermined. Time is exceeded,
It is preferable that when it is determined that the number of seats is exceeded, the seat is identified.

Alternatively, the means for identifying whether the user is present or absent is equipped with an answering machine function in the communication terminal, and the presence or absence of the answering machine setting is identified in the communication terminal to identify whether the user is present or not. It is preferable to be configured to identify whether a seat or an absence.

In the above invention, when a change from absence to presence is detected, means for transmitting presence information of the user of the communication terminal to another communication terminal that has made a request to send presence information. Is preferably configured so as to have a means for setting an access right to information on whether the user is present or absent, and to notify the presence information only to a communication terminal that permits the setting of the access right. is there.

Further, in the above invention, it is preferable that the communication terminal is configured to have a communication means by electronic mail.

[0013]

In the communication support system of the present invention, when the other party with whom communication is desired is absent, the other party or his / her own communication terminal is made to monitor the change in the other party's presence status, and when the other party returns to the seat, By letting you know that you have returned to your seat, it is easier to capture opportunities suitable for communication.

[0014]

Embodiments of the present invention will now be described in detail with reference to the drawings.

As an example of the method for determining the presence status, in the case of a terminal having an answering machine function, it is determined that the terminal is absent when the absence status is set, and the presence status is determined when the absence status is released. There is a way to do it.

Further, as another example of the method of determining the seated state, there is a determination method using image processing. As an example of the determination method by this image processing, there is a method of extracting a motion from an image captured using a camera and determining that a person exists when the continuous motion time is longer than a predetermined time. . In the present embodiment, hereinafter, a system that determines the presence state by image processing will be described.

The structure of a basic communication terminal is shown in FIG. The communication terminal includes a voice input / output unit 1 such as a speaker and a microphone for voice communication, a camera 2, a seated state determination unit 3, a display / operation unit 4 for displaying and operating information, its own terminal or another terminal. The presence monitoring unit 5 that monitors the presence state of the user and the communication control unit 6 that communicates with other terminals.

In the above, the presence status determination unit 3 determines the presence status as follows. That is, assuming the use in an environment in which video communication is widespread, the presence determination is performed by image processing based on the video from the camera 2 provided in each communication terminal (workstation or the like). Since the presence determination process is performed in real time in the background on the platform computer, it is desirable that the processing load be small. Therefore, a method using a frame difference that is easy to process [Jin Tsuchikawa et al .: Judgment of presence status using frame difference, 45th National Convention of the Information Society of Japan, 6J3, 1
992] is used. A flowchart of the algorithm based on this is shown in FIG. This algorithm consists of motion detection and motion continuity detection.

The motion is detected based on the difference in luminance between frames. However, the difference in brightness caused by noise causes an erroneous detection even in a static image. Therefore, noise and motion are distinguished by providing an appropriate threshold value D for the brightness difference. With this, it is possible to almost distinguish the noise and the obtained motion. However, in order to further improve the detection accuracy, the threshold P is provided for the number of pixels having the luminance difference equal to or more than the threshold for detection.

Further, in detecting the continuity of movement, when the presence determination is performed only from the movement, the movement of the target person is small when the person is present, and when the person is absent, another person may pass through. It is useful for preventing erroneous judgments that are the cause. Since the movement of the target person is small or other people pass within a certain period of time, the threshold value is set for each observation time (the number of frames) (when the previous determination result is “Available”, N1 and “Absent”). N2) is provided to reduce the influence of the above causes.

FIG. 3 shows an example of the configuration of the communication system of this embodiment. In this embodiment, it is assumed that a workstation is used as the communication terminal. Individual workstation 7
Includes a camera 2, a microphone, and a speaker 11, respectively,
They are connected by a computer network 8.

The individual terminals are functionally equivalent. Each terminal determines the presence state of its own user at appropriate intervals and updates the result. The result is held for each terminal until the next determination is made. Each terminal is
Inquire about the presence status of the user of the other terminal to the other terminal to obtain information.

Two examples will be given as methods for obtaining the presence information. The first example is a method of periodically giving and receiving presence information. For example, when the own terminal sends a signal of a presence information acquisition request from the presence monitoring unit 5 to the partner terminal, the partner terminal returns the presence determination result from the presence state determination unit 3 each time the acquisition request is received. If the presence determination is performed periodically independently of the acquisition request signal, the previous determination result is returned to the acquisition request signal. If the presence determination is not performed regularly, the presence determination is performed at the time when the acquisition request is received, and the result is returned.

The second example is a method of exchanging presence information only when the presence state changes. For example, when the own terminal sends a signal of a presence information acquisition request from the presence monitoring unit 5 to the partner terminal, the partner terminal receiving the acquisition request signal first returns the presence determination result at that time. After that, the presence determination unit 3 periodically makes a presence determination, and the presence monitoring unit 5 sends a presence information acquisition request signal with the determination result only when it detects that the presence condition has changed. Return to the terminal.

An access right can be set to the presence information, and if the access right is set, the presence information cannot be obtained from a terminal without permission. For example, the communication control unit 6 sets the access right.

As an example of a basic display method of presence information in the present embodiment, two examples of a constant display type and a telephone directory type will be shown.

FIG. 4 shows an example of the basic screen of the constant display type.
In this example, this screen is always displayed on the terminal display (display 71 in the example of FIG. 3) for use. Whether or not the face icon 711 is present is determined by the user of each terminal (name “aaa”).
“A” to “hhhh”) represent the presence / absence of seats, and if the face icon 711 is displayed in front of the name, it indicates that the user is determined to be seated.

The presence / absence information is displayed on the display / operation unit 4. Two examples will be given as methods of updating the display of presence information. In the first example, the own terminal periodically sends a signal of a presence information acquisition request to the other terminal. Each time the partner terminal receives the acquisition request, the partner terminal returns the presence determination result, and the self terminal updates the display each time the determination result is obtained. In the second example, when the presence information acquisition request signal is sent to the partner terminal, the terminal receiving the acquisition request signal first returns the presence determination result at that time, and the self terminal displays according to the information. I do. After that, the partner terminal periodically makes a seating determination, and returns the determination result only when the seating state changes. The own terminal updates the display only when the judgment information is obtained.

On the above-mentioned presence information display screen, the name is a button, and when the name is clicked, a menu for selecting the communication means is displayed. An example of the menu is shown in FIG. In the illustrated example, in order to communicate with "aaa", "aaa"
This shows a state in which the menu is displayed by clicking "aa".

As communication means, for example, voice and electronic mail are provided. In the menu, "phone" represents voice communication and "e-mail" represents e-mail, and the communication means suitable for the situation is selected in consideration of the state of the communication partner and his / her own requirements. For example, if the other party is present, voice communication is performed, but if the person is absent and there is no urgent requirement, the requirement may be communicated by email. In addition, "chime" is used when the absentee returns to their seat and wants to contact them (details will be described later).

The constant display type described above is used, for example, with a partner who has a relatively high frequency of contact.

FIG. 6 shows a configuration example of a phonebook type screen which is another example of the method of displaying the presence information. In this example, the display reflects the hierarchical structure of the organization, and the upper structure to the lower structure of the organization are displayed from left to right. The corresponding organization chart is shown in FIG. With such a display, a person can be searched for by tracing the hierarchical structure.

Only when the person's name is displayed, the presence information acquisition request signal is sent to the terminal of each user, and each terminal returns the presence information only once. Therefore, the display is not updated.

The face icon corresponds to presence / absence. The name is a button, and when you click the name, a menu for selecting the communication method is displayed. As an example, FIG. 8 shows a state in which "aaa" is clicked to display a menu in order to communicate with "aaa".

Such a telephone directory type is used, for example, for contacting a person with whom the frequency of contact is relatively low.

When the user of the other terminal is absent, the presence monitoring section 5 of the terminal is made to monitor the presence state of the other party, and when the other party always returns, a notification is given by a message or sound, whereby the voice Communication can be initiated.

The operation will be described step by step. To set the monitoring of the other person's presence status, select "chim" from the menu.
Select "e". For example, if "cccc" is absent, "c"
For "ccc", select "chime" from the menu of Fig. 8. Then, as shown in Fig. 9, a chime icon 712 is displayed at the right end of "cccc" and "cccc".
It is shown that the presence status of is being monitored. Figure 9
Is an example of a screen when the monitoring of the presence status of "cccc" is set.

Two examples will be given as methods for monitoring the presence status. The first example is a method of monitoring by the presence monitoring unit 5 of the own terminal. In this case, when the user sets monitoring of the other person's presence status from the display / operation unit 4, the presence monitoring unit 5 of the own terminal
Periodically sends an attendance information acquisition request signal to the partner terminal. The seating state determination unit 3 of the partner terminal returns the seating determination result every time the acquisition request signal is received. When the obtained result changes from being absent to being present, the presence monitoring unit 5 of the own terminal notifies the user of the own terminal that the other party is present. The notification is, for example, a message "cccc" as shown in FIG.
Has returned to your seat "by displaying the window with the time and the sound.

The second example is a method of monitoring by the presence monitoring section 5 of the partner terminal. In this case, when the user sets monitoring of the seated state of the other party, the seating monitoring unit 5 of the own terminal transmits a signal of a monitoring request to the partner terminal only once. Upon receiving the monitoring request signal, the presence monitoring unit 5 of the partner terminal starts monitoring the presence state of the user of the own terminal. When the determination result changes from being absent to being present, the presence notification is transmitted to the terminal that has transmitted the monitoring request signal. The display / operation unit 4 of the terminal, which has received the presence notification, displays a window displaying a message or the like as shown in FIG. 10 with a sound to notify the user that the other party has returned to the seat.

The presence state of the other party is displayed so that the state of the other party can be seen from this window as well. The display is updated at appropriate intervals. Also, a button for displaying a menu for selecting a communication means is prepared so that communication can be started from this window.

[0041]

As described above, in the communication support system of the present invention, when the other party is absent, the other party or one's own communication terminal is made to monitor the presence state of the other party, and when the other party returns to the seat. Since it is possible to notify the terminal with and start communication, there is an effect that it is easy to capture an opportunity for reliable communication.

Further, in the case where the other terminal monitors the presence status, a request for sending out the presence information from one's own communication terminal is made only once, and the other communication terminal detects a change from absence to presence. In addition, when the presence information is transmitted immediately, there is an advantage that the number of times of communication transmission / reception is small.

Further, the motion is extracted from the image taken by the image pickup device provided in the communication terminal, it is judged whether or not the continuous time of the extracted motion exceeds a predetermined time, and when it is judged that the time is exceeded, When the seat is identified, particularly high determination accuracy can be obtained.

Alternatively, the communication terminal is provided with an answering machine,
When the presence / absence is identified depending on whether the answering machine setting is canceled or the answering machine is set in the communication terminal, there is an advantage that the presence / absence can be easily identified.

In the case where the access right of the user's presence or absence information is set and only the communication terminal permitted to set the access right is notified of the presence information,
In particular, privacy for outsiders and the like is maintained.

Further, when the communication terminal is provided with a communication means by e-mail, it becomes possible to select the optimum communication means particularly depending on the presence / absence of the communication partner.

[Brief description of drawings]

FIG. 1 is a diagram showing a configuration example of a communication terminal used in an embodiment of the present invention.

FIG. 2 is a diagram showing an example of processing for determining a seated state in the communication terminal.

FIG. 3 is a diagram showing a configuration example of a communication system according to the above embodiment, showing a network connection example.

FIG. 4 is a diagram showing an example of a constant display type interface in the above embodiment.

FIG. 5 is a diagram showing an example of a menu for selecting a communication means in the above embodiment.

FIG. 6 is a diagram showing an example of a telephone directory type interface in the above embodiment.

FIG. 7 is a diagram showing an example of an organization chart in the example of the telephone directory type interface.

FIG. 8 is a diagram showing an example of a menu for selecting a communication means in the above embodiment.

FIG. 9 is a diagram showing an example in which a notification is given when the user “cccc” returns to the seat in the above embodiment.

FIG. 10 is a diagram showing an example of a notification indicating that the user has returned to the seat in the above embodiment.

FIG. 11 is a diagram showing a configuration example of a conventional communication support system that determines and displays the presence status of the other party.

[Explanation of symbols]

 1 ... Voice input / output unit 2 ... Camera 3 ... Occupancy status determination unit 4 ... Display / operation unit 5 ... Occupancy monitoring unit 6 ... Communication control unit 7 ... Workstation 8 ... Network 11 ... Microphone, speaker

Claims (7)

[Claims] 1. A video communication system comprising a video or audio or a plurality of communication terminals capable of using video and audio and a network connecting the plurality of communication terminals, wherein each of the plurality of communication terminals is occupied by a user. Identification means for identifying absence and presence of the user of the communication terminal to another communication terminal that has made a request for sending out presence information when a change from absence to presence is detected by the identification result of the identification means. Means for transmitting seat information, and means for expressing the presence in the form of visual information or auditory information based on the presence information transmitted from another communication terminal by requesting transmission of the presence information from the communication terminal. A communication support system comprising: 2. A video communication system comprising a video or audio or a plurality of communication terminals capable of using video and audio and a network connecting the plurality of communication terminals, wherein each of the plurality of communication terminals is occupied by a user. Identification means for identifying absence, means for transmitting information on presence or absence identified by the identification means each time a request for sending the information is received from another communication terminal on a regular basis, and from the communication terminal Means for detecting a change from absent to present based on the information transmitted from another communication terminal every time a request to send out the presence or absence information is periodically made, and the change from absent to present And a means for expressing the presence in the form of visual information or auditory information when the presence is detected, and a communication support system. 3. When the change from absence to presence is detected by the identification result of the identification means, the presence information of the user of the communication terminal is transmitted to another communication terminal that has made a request to send the presence information. The means, after receiving the request for sending the presence information once, periodically identifies whether the user is present or absent by the identification means, and detects a change from absent to a presence based on the identification result. The communication support system according to claim 1, wherein in this case, the presence information is immediately transmitted to the other communication terminal that has made the transmission request for the presence information. 4. The means for identifying whether the user is present or absent is to extract a motion from an image captured by an imaging device provided in the communication terminal, and the time during which the extracted motion continues is set to a predetermined time. The communication support system according to claim 1, wherein the communication support system is configured to determine whether or not to exceed, and to identify the presence when the determination is made to exceed. 5. The means for identifying whether a user is present or absent is equipped with an answering machine function in a communication terminal, and identifies whether the answering machine setting is canceled or the answering machine is set in the communication terminal. The communication support system according to claim 1, 2 or 3, wherein the communication support system identifies whether the user is seated or absent. 6. When a change from absence to presence is detected,
The means for transmitting the presence information of the user of the communication terminal to another communication terminal that has made a request to send the presence information has means for setting the access right to the information regarding whether the user is present or absent. The communication support system according to claim 1, wherein the presence information is notified only to a communication terminal that permits the setting of the access right. 7. The communication support system according to claim 1, wherein the communication terminal has a communication means by electronic mail, claim 2, claim 3, claim 4, claim 5, or claim 6.