WO2009090926A1 - Communication support system, method, and program - Google Patents

Abstract

It is possible to provide a system which activates communication between communication terminals. When a media transmission/reception is started between media processing devices concerning talking between communication terminals, a call analysis conversion unit of a gateway device analyzes call control information concerning a start of a media transmission/reception received from a media processing device, identifies an object talking from the call information registered in a call management table, converts the object talking into call control information concerning media addition for the talking, transmits the converted information to a gateway device of a partner, analyzes call control information concerning media addition received from the gateway device, identifies a media processing device as an object from the media processing devices registered in the media processing device management table, makes a conversion into call control information concerning the media transmission/reception for the identified media processing device, and transmits the converted information to a corresponding media processing device under control.

Description

Communication support system, method, and program

[Description of related applications]
The present invention is based on the priority claim of Japanese patent application: Japanese Patent Application No. 2008-009508 (filed on Jan. 18, 2008), the entire description of which is incorporated herein by reference. Shall.
The present invention relates to a communication support system, method, and program for supporting activation of communication between communication terminals using a media processing device, and in particular, data such as voice calls, video streams, and image data in a gateway device. The present invention relates to a communication support system, method, and program for managing transmission and reception as one session.

2. Description of the Related Art Conventionally, a communication support system that can perform data transfer using an information processing apparatus between users who are making a call using a communication terminal is known.

For example, in the communication support system (multimedia transfer system) described in Patent Document 1, first, a user calls a call partner using his / her communication terminal. Thus, the calling side private branch exchange accommodating the calling side communication terminal registers the terminal numbers of the calling side communication terminal and the called side communication terminal in the database (DB) in its own exchange. The called private branch exchange accommodating the called communication terminal registers the terminal numbers of the calling communication terminal and the called communication terminal in the DB in the local exchange in association with each other.

Thereafter, the user of the calling communication terminal or the called communication terminal (for example, the user of the calling communication terminal) activates the multimedia application program on his / her information processing apparatus, and the calling communication terminal Enter the terminal number of. As a result, the information processing apparatus transmits its own IP address and the terminal number of the calling communication terminal to the calling private branch exchange.

The calling private branch exchange registers the IP address of the information processing device used by the caller in association with the terminal numbers of the calling communication terminal and the called communication terminal already registered in the DB. In response to this, the calling private branch exchange inquires of the called private exchange whether the information processing apparatus is associated with the called communication terminal.

In response to this inquiry, the called private branch exchange refers to the DB in its own exchange and returns a response indicating whether the information processing apparatus is associated with the called communication terminal. At this time, if the IP address of the information processing apparatus is registered in association with the terminal number of the called communication terminal, a response indicating that there is an associated information processing apparatus is returned.

When a response is returned from the called private branch exchange, the calling private branch exchange transmits it to the information processing apparatus used by the caller. As a result, the information processing apparatus can start multimedia communication with the information processing apparatus of the other party from the response content.

According to the technique described in Patent Document 1, since the IP address of the local information processing apparatus and the terminal number of the local communication terminal are transmitted when the multimedia application program is started and registered in the DB in the exchange, the call starts. Sometimes, by using these pieces of information, the calling side information processing apparatus and the called side information processing apparatus can know each other's IP address, and multimedia communication can be started.

JP 2005-12380 A

It is assumed that the disclosure of Patent Document 1 described above is incorporated herein by reference. The following analysis is given by the present invention.
However, in the technique described in Patent Document 1, there is only one IP address of the information processing apparatus associated with the terminal number of the communication terminal due to the system configuration, and in order to use another information processing apparatus, It was necessary to terminate the multimedia application program on the information processing apparatus that was used first, and start the multimedia application program again on the information processing apparatus that was desired to be used again.

In addition, since multimedia communication between information processing apparatuses is managed separately from communication between communication terminals, an operation for terminating multimedia communication by a multimedia application program is required at the end of the call.

The main problem of the present invention is to provide a communication support system, method, program, etc. that can activate communication between communication terminals.

In the first aspect of the present invention, a plurality of gateway devices are connected directly or indirectly so as to be communicable, and each gateway device is communicably connected to one or a plurality of communication terminals and one or a plurality of gateway devices. A communication support system communicably connected to a media processing device, wherein the gateway device analyzes call control information received from any one of the managed communication terminal, the media processing device, and the other gateway device. And a call analysis conversion unit for converting the call control information into a predetermined format, a call management unit for registering call information including the own telephone number and the other party telephone number in a call management table in the apparatus, and A media processing device management unit for registering information on the media processing device in a media processing device management table in the device. The call analysis conversion unit analyzes call control information related to the call start received from the managed communication terminal or the other gateway device when a call is started between the communication terminals, and the call management unit When a call is started between the communication terminals, call information included in the analysis result of the call analysis conversion unit is registered in the call management table, and the call analysis conversion unit is used for a call between the communication terminals. When media transmission / reception is started between the media processing devices, call control information relating to the start of media transmission / reception received from the managed media processing device is analyzed, and the call registered in the call management table is analyzed. After identifying the target call from the information, the call is converted into call control information related to media addition for the call, and transmitted to the gateway device of the other party. When the media transmission / reception is started between the media processing devices in connection with a call between the communication terminals, the conversion unit analyzes call control information relating to media addition received from the other gateway device, and the media processing device The target media processing device is identified from the media processing devices registered in the management table, and converted to call control information related to media transmission / reception for the identified media processing device, and the corresponding managed media It transmits to a processing apparatus, It is characterized by the above-mentioned.

According to a second aspect of the present invention, there is provided a gateway device that is communicably connected to one or a plurality of communication terminals and is communicably connected to one or a plurality of media processing devices, wherein the communication under management A call analysis conversion unit that analyzes call control information received from any one of the terminal, the media processing device, and the other gateway device, and converts the call control information into a predetermined format; A call management unit for registering call information including a media management device in a call management table in the device, and a media processing device management unit for registering information on the managed media processing device in the media processing device management table in the device. The call analysis conversion unit receives from the communication terminal under management or the gateway device of the other party when a call is started between the communication terminals. The call management unit registers call information included in the analysis result of the call analysis conversion unit in the call management table when a call is started between the communication terminals. The call analysis / conversion unit, when media transmission / reception is started between the media processing devices in connection with a call between the communication terminals, call control information related to the start of media transmission / reception received from the media processing device under management , And after identifying the target call from the call information registered in the call management table, it is converted into call control information related to media addition for the call, and transmitted to the gateway device of the other party, The call analysis / conversion unit, when media transmission / reception is started between the media processing devices in connection with a call between the communication terminals, Analyzing the call control information relating to media addition received from the media processing device, identifying the target media processing device from the media processing devices registered in the media processing device management table, and then specifying the media for the identified media processing device It is converted into call control information related to transmission / reception and transmitted to the corresponding media processing apparatus under management.

In a third aspect of the present invention, the media processing device is communicatively connected to the gateway device, and generates call control information related to the start of media transmission / reception including information for specifying an existing voice call. And a call generation analysis unit for analyzing call control information related to the start of media transmission / reception received from the gateway device.

In the fourth aspect of the present invention, a plurality of gateway devices are connected directly or indirectly so that they can communicate, and each gateway device is connected so as to be communicable with one or a plurality of communication terminals and one or a plurality of gateway devices. A communication support method for supporting communication using a system communicably connected to a media processing device, wherein when a call is started between the communication terminals, the gateway device manages the communication terminal, Or analyzing the call control information related to the start of a call received from the gateway device of the other party, registering the call information including the own telephone number and the other party telephone number included in the analysis result in the call management table, and between the communication terminals When media transmission / reception is started between the media processing devices in connection with a call, in the gateway device, Analyzing call control information related to the start of media transmission / reception received from the media processing apparatus under management, specifying the target call from the call information registered in the call management table, and adding media to the call In the case where media transmission / reception is started between the media processing devices in connection with the communication between the communication terminals and the step of converting the call control information to the other gateway device, and the communication between the communication terminals, Analyzing call control information related to media addition received from the gateway device of the other party, identifying the target media processing device from the media processing device registered in the media processing device management table, and then specifying the specified media Converted into call control information related to media transmission / reception for processing devices, Characterized in that it comprises a, and transmitting to the media processing device.

According to a fifth aspect of the present invention, there is provided a program executed by a gateway device that is communicably connected to one or a plurality of communication terminals and is communicably connected to one or a plurality of media processing devices. When a call is started between the communication terminals, the gateway device analyzes call control information related to the call start received from the managed communication terminal or the other gateway device, and is included in the analysis result Registering call information including its own telephone number and the other party telephone number in the call management table, and when media transmission / reception is started between the media processing devices in connection with a call between the communication terminals, the gateway device Analyzing call control information regarding the start of media transmission / reception received from the managed media processing device and registering it in the call management table Identifying a target call from the call information, converting the call to call control information related to media addition to the call, and transmitting the call control information to the gateway device of the other party, and relating to the call between the communication terminals Then, when media transmission / reception is started between the media processing devices, the gateway device analyzes the call control information related to the media addition received from the other gateway device, and is registered in the media processing device management table. Identifying a target media processing device from the media processing device, converting the media processing device into call control information related to media transmission / reception for the identified media processing device, and transmitting the call control information to the corresponding managed media processing device Are executed.

According to the present invention, it is not necessary to register the IP address of the local information processing apparatus and the terminal number of the local communication terminal in a one-to-one relationship as in the prior art, and multimedia communication is necessary. At this stage, it is possible to select and use an appropriate one from a plurality of media processing devices managed under the gateway device. The reason is that the call control information indicating the media addition received from the other gateway device is analyzed, the target media processing device is identified from the media processing devices stored in the media processing device management table, and the media This is because it is converted into call control information for media transmission / reception for the processing device.

Further, according to the present invention, multimedia communication such as video stream and image data transmission / reception between media processing devices associated at the time of termination of a voice call can be terminated at the same time. Become. The reason is that an existing voice call is associated with a video stream or image data transmission / reception generated and processed using a media processing device under the gateway device. This is because image data transmission / reception can be managed as one session.

In addition, according to the present invention, it is possible to associate an existing voice call with a video stream generated or processed using a media processing device under the gateway device, image data transmission / reception, and the like. And image data transmission / reception can be operated as one session.

Furthermore, according to the present invention, in a case where voice communication is not hindered like a fixed phone or a mobile phone, but the capacity is insufficient or the usability is poor when performing other multimedia communication. In combination with other media processing devices managed below, video streams and image data that are generated and processed using media processing devices are associated with existing calls between users, Communication can be activated.

It is the block diagram which showed typically the structure of the communication assistance system which concerns on Example 1 of this invention. It is the block diagram which showed typically the detailed structure of the gateway apparatus and media processing apparatus in the communication assistance system which concerns on Example 1 of this invention. It is the schematic diagram which showed the call management table in the communication assistance system which concerns on Example 1 of this invention. It is the schematic diagram which showed the media processing apparatus management table in the communication assistance system which concerns on Example 1 of this invention. It is the sequence diagram which showed typically the registration operation | movement of the communication assistance system which concerns on Example 1 of this invention. It is the sequence diagram which showed typically the deletion operation | movement of the communication assistance system which concerns on Example 1 of this invention. It is the sequence diagram which showed typically the telephone call start operation | movement of the communication assistance system which concerns on Example 1 of this invention. It is the sequence diagram which showed typically the telephone call end operation | movement of the communication assistance system which concerns on Example 1 of this invention. It is the sequence diagram which showed typically the media start operation | movement of the communication assistance system which concerns on Example 1 of this invention. It is the sequence diagram which showed typically the media completion | finish operation | movement of the communication assistance system which concerns on Example 1 of this invention. It is the schematic diagram which showed the modification of the media processing apparatus management table in the communication assistance system which concerns on Example 1 of this invention. It is the block diagram which showed typically the structure of the communication assistance system which concerns on Example 2 of this invention. It is the sequence diagram which showed typically the media start operation | movement of the communication assistance system which concerns on Example 2 of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Call control apparatus 20, 30 Gateway apparatus 40, 50, 51 Communication terminal 60, 70, 71 Media processing apparatus 201 External call transmission / reception part 202 Call analysis conversion part 203 Internal call transmission / reception part 211 External voice transmission / reception part 212 Voice conversion part 213 inside Audio transmission / reception unit 221 External media transmission / reception unit 222 Media conversion unit 223 Internal media transmission / reception unit 231 Call management table 232 Call management unit 241 Media processing device management table 242 Media processing device management unit 243 Media processing device information transmission / reception unit 251 Menu voice synthesis unit 252 DTMF analysis unit 601 Call transmission / reception unit 602 Call generation analysis unit 621 Media transmission / reception unit 622 Media processing unit 641 Media processing device information transmission / reception unit

In the communication support system according to the first embodiment of the present invention, a plurality of gateway devices (20, 30 in FIG. 1) are connected directly or indirectly so as to be communicable, and each gateway device (20, 30 in FIG. 1) is connected. Communication connected to one or a plurality of communication terminals (40, 50, 51 in FIG. 1) and communicably connected to one or a plurality of media processing devices (60, 70, 71 in FIG. 1). In the support system, the gateway device (for example, 20 in FIG. 2) is connected to the managed communication terminal (for example, 40 in FIG. 2) and the media processing device (for example, 60 in FIG. 2), A call analysis conversion unit that analyzes call control information received from any one of the gateway devices (for example, 30 in FIG. 2) and converts the call control information into a predetermined format. For example, 202 in FIG. 2) and a call management unit (for example, FIG. 2) for registering call information including the own telephone number and the other party telephone number in the call management table (for example, 231 in FIG. 2; FIG. 3). 232), and a media processing device management unit that registers information related to the managed media processing device (for example, 60 in FIG. 2) in a media processing device management table (for example, 241 in FIG. 2; FIG. 4) in the device. (For example, 242 in FIG. 2), and the call analysis conversion unit (for example, 202 in FIG. 2) starts a call between the communication terminals (for example, 40 and 50 in FIG. 1), Call control information related to the start of a call received from the managed communication terminal (for example, 40 in FIG. 2) or the gateway device (for example, 30 in FIG. 2) of the other party is analyzed, and the call management unit (for example, FIG. 2 of 232) When a call is started between communication terminals (for example, 40 and 50 in FIG. 2), call information included in the analysis result of the call analysis conversion unit (for example, 202 in FIG. 2) is converted into the call management table (for example, 2), the call analysis / conversion unit (for example, 202 in FIG. 2) is connected to the media processing device (for example, in FIG. 2) in connection with a call between the communication terminals (for example, 40 and 50 in FIG. 1). 1, when media transmission / reception is started between the media processing devices under management (for example, 60 in FIG. 1), call control information relating to the start of media transmission / reception is analyzed, and the call After identifying the target call from the call information registered in the management table (for example, 231 in FIG. 2), the call is converted into call control information related to media addition for the call, and the other gateway device ( For example, the call processing / conversion unit (for example, 202 in FIG. 2) transmits the media processing device in connection with a call between the communication terminals (for example, 40 and 50 in FIG. 1). When media transmission / reception is started between (for example, 60 and 70 in FIG. 1), call control information regarding media addition received from the other gateway device (for example, 30 in FIG. 2) is analyzed, and the media processing device The target media processing device is identified from the media processing devices registered in the management table (for example, 241 in FIG. 2), and converted to call control information related to media transmission / reception for the identified media processing device. Then, the data is transmitted to the corresponding managed media processing apparatus (for example, 60 in FIG. 2) (mode 1).
Furthermore, the following forms are also possible.
In the call analysis conversion, when a target media processing device is specified from the media processing devices registered in the media processing device management table, a search process is repeatedly performed until a media processing device capable of transmitting and receiving media comes out. It is preferable to carry out (Form 1-1).
When the gateway device specifies a target media processing device from the media processing devices registered in the media processing device management table, the gateway device selects one medium from the media processing devices specified by the call analysis conversion. A menu voice synthesizer that synthesizes a guidance voice for selecting a processing device, and analyzes the acquired voice data, reads a DTMF signal from the voice data, and determines which media processing device has been selected The communication terminal preferably transmits voice data including a DTMF signal related to a number selected based on the guidance voice received from the gateway device to the gateway device (Mode 1- 2).
The media processing device generates call control information related to the start of media transmission / reception including information for specifying an existing voice call, and also generates call control information related to the start of media transmission / reception received from the gateway device It is preferable to include an analysis unit (Mode 1-3).
It is preferable to include a call control device that is communicably connected to the gateway device and performs call control between the gateway devices (mode 1-4).

In the communication support method according to the second embodiment of the present invention, a plurality of gateway devices (20 and 30 in FIG. 1) are connected directly or indirectly so as to be communicable, and each gateway device (20 and 30 in FIG. 1) is connected. Are connected to one or a plurality of communication terminals (40, 50, 51 in FIG. 1) in a communicable manner, and are connected to be able to communicate with one or a plurality of media processing devices (60, 70, 71 in FIG. 1). In the communication support method for supporting communication using the communication terminal (for example, 40, 50 in FIG. 7), when a call is started between the communication terminals (for example, 20 in FIG. 7), Call control information relating to the start of a call received from the managed communication terminal (for example, 40 in FIG. 1) or the gateway device (for example, 30 in FIG. 1) of the other party Analyzing and registering call information including the own telephone number and the other party telephone number included in the analysis result in the call management table (step C7 or C9 in FIG. 7), and the communication terminal (for example, 40, 50 in FIG. 7). ), When media transmission / reception is started between the media processing devices (for example, 60 and 70 in FIG. 9), the gateway device (for example, 20 in FIG. 9) Call control information relating to the start of media transmission / reception received from a media processing device (for example, 20 in FIG. 9) is analyzed, and the call information registered in the call management table (for example, 231 in FIG. 2, FIG. 3) is analyzed. A process of identifying a target call, converting it to call control information related to media addition for the call, and transmitting the call control information to the other gateway device (for example, 30 in FIG. 9) (FIG. 9) When media transmission / reception is started between the media processing devices (for example, 60 and 70 in FIG. 9) in connection with a call between the communication terminals (for example, 40 and 50 in FIG. 7) and the communication terminals (for example, 40 and 50 in FIG. 7). The gateway device (for example, 30 in FIG. 9) analyzes the call control information related to the media addition received from the other gateway device (for example, 20 in FIG. 9), and the media processing device management table (for example, The target media processing device is identified from the media processing devices registered in 241) of FIG. 2, and then converted into call control information related to media transmission / reception for the identified media processing device, and the corresponding management processing is performed. (Step E5 to E10 in FIG. 9) for transmitting to the media processing device (for example, 70 in FIG. 9) (mode 2).
Furthermore, the following forms are also possible.
When the target media processing device is specified from the media processing devices registered in the media processing device management table, the gateway device repeatedly performs search processing until a media processing device capable of media transmission / reception appears. Preferably it is carried out (Form 2-1).
When the target media processing device is specified from the media processing devices registered in the media processing device management table, one of the media processing devices specified by the call analysis conversion is selected by the gateway device. A step of synthesizing a guidance voice for selecting a media processing device and transmitting the guidance voice to the corresponding communication terminal, and the communication terminal is selected based on the guidance voice received from the gateway device. Transmitting voice data including a DTMF signal related to the number to the gateway device, and analyzing the voice data acquired from the communication terminal in the gateway device, and reading a DTMF signal from the voice data; Determining which media processing device has been selected. It is preferable to identify the media processing apparatus of interest, based on the (Embodiment 2-3).

The program according to the third embodiment of the present invention is communicably connected to one or more communication terminals (for example, 40 in FIG. 1), and one or more media processing devices (for example, 60 in FIG. 1). When a call is started between the communication terminals (for example, 40 and 50 in FIG. 7) that is executed by the gateway apparatus (20 in FIG. 1) connected so as to be communicable, the gateway apparatus ( For example, in 20) of FIG. 7, call control information relating to the start of a call received from the managed communication terminal (for example, 40 of FIG. 7) or the gateway device of the other party (for example, 30 of FIG. 7) is analyzed. Registering the call information including the own telephone number and the other party telephone number included in the analysis result in the call management table (for example, 231 in FIG. 2, FIG. 3) (step C9 or C7 in FIG. 7); When media transmission / reception is started between the media processing devices (for example, 60 and 70 in FIG. 9) in connection with a call between terminals (for example, 40 and 50 in FIG. 7), the gateway device (for example, FIG. 9). 20), the call control information relating to the start of media transmission / reception received from the managed media processing device (for example, 60 in FIG. 9) is analyzed, and the object is determined from the call information registered in the call management table. A call (steps E2 and E3 in FIG. 9) that is converted into call control information relating to media addition to the call and transmitted to the other gateway device (for example, 30 in FIG. 9) In response to a call between the communication terminals (for example, 40 and 50 in FIG. 7), media transmission / reception is started between the media processing devices (for example, 60 and 70 in FIG. 9). In this case, the gateway device (for example, 30 in FIG. 9) analyzes the call control information regarding the media addition received from the other gateway device (for example, 20 in FIG. 9), and the media processing device management table (for example, 2, after identifying the target media processing device from the media processing devices registered in 241 and FIG. 4), convert it into call control information related to media transmission / reception for the identified media processing device, A step (steps E5 to E10 in FIG. 9) of transmitting to the corresponding managed media processing apparatus (for example, 70 in FIG. 9) is executed (mode 3).
Furthermore, the following forms are also possible.
When the target media processing device is specified from the media processing devices registered in the media processing device management table, the gateway device repeatedly performs search processing until a media processing device capable of media transmission / reception appears. It is preferable to execute the steps to be performed (Mode 3-1).
When the target media processing device is specified from the media processing devices registered in the media processing device management table, one of the media processing devices specified by the call analysis conversion is selected by the gateway device. Synthesizing a guidance voice for selecting a media processing device and transmitting the guidance voice to the corresponding communication terminal; and analyzing the voice data acquired from the communication terminal at the gateway device; It is preferable to execute a step of reading out a DTMF signal from the data and determining which media processing device has been selected (mode 3-2).

Example 1 of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram schematically showing the configuration of the communication support system according to the first embodiment of the present invention.

The communication support system according to the first embodiment is a system that supports the activation of communication between the communication terminals 40, 50, 51 using the media processing devices 60, 70, 71. The communication support system includes a call control device 10, gateway devices 20 and 30, communication terminals 40, 50 and 51, and media processing devices 60, 70 and 71.

The call control device 10 is a device that performs call control between the gateway devices 20 and 30. The call control device 10 is communicably connected to the gateway devices 20 and 30 via a network, and controls the exchange of call information and call control information between the gateway devices 20 and 30. Here, the call control information is information related to call control such as a command related to call start, call end, media addition, and media deletion, and a result of the command. In the case of a call start command, the call control information includes call information such as the own telephone number and the other party telephone number.

The gateway devices 20 and 30 are connected to a computer network http://en.wikipedia.org/wiki/%E3%82%B3%E3%83%B3%E3%83%94%E3%83%A5%E3%83% BC% E3% 82% BF% E3% 83% BB% E3% 83% 8D% E3% 83% 83% E3% 83% 88% E3% 83% AF% E3% 83% BC% E3% 82% AF A computer for enabling communication between networks using different media and communication protocols. The gateway devices 20 and 30 are communicably connected to the call control device 10 via a network. The gateway devices 20 and 30 are communicably connected to each other via a network without using the call control device 10. The call control information between the gateway devices 20 and 30 mediates the call control device 10 as necessary, but audio, other video streams, image data, and the like are directly transmitted and received between the gateway devices 20 and 30 via the network. It will be. The gateway devices 20 and 30 perform communication using an HTTP address.

The communication terminals 40, 50 and 51 are communicable terminals such as fixed telephones and mobile phones. The communication terminal 40 is communicably connected to the gateway device 20 via a network by wire or wireless. The communication terminals 50 and 51 are communicably connected to the gateway device 30 via a network by wire or wireless.

The media processing devices 60, 70, 71 are computers that perform information processing related to media. The media processing device 60 is communicably connected to the gateway device 20 via a network. The media processing devices 70 and 71 are communicably connected to the gateway device 30 via a network.

In FIG. 1, for convenience, there are one or two communication terminals 40, 50, 51 and media processing devices 60, 70, 71 existing under the gateway devices 20, 30, but this is not limitative. However, three or more communication terminals and media processing devices can be arranged under the gateway device. The network between the call control device 10 and the gateway devices 20 and 30 and the network between the gateway devices 20 and 30 and the communication terminals 40, 50 and 51, and the media processing devices 60, 70 and 71 may be different networks. . Further, hereinafter, the network between the call control device 10 and the gateway devices 20 and 30 is referred to as an external network, and between the gateway device 20 (30), the communication terminals 40 (50 and 51), and the media processing device 60 (70 and 71). This network is called an internal network, but the external network and the internal network may be the same network.

Next, a detailed configuration of the gateway device in the communication support system according to the first embodiment of the present invention will be described with reference to the drawings. FIG. 2 is a block diagram schematically illustrating detailed configurations of the gateway device and the media processing device in the communication support system according to the first embodiment of the present invention.

The gateway devices 20 and 30 execute a program on hardware resources in a computer, so that an external call transmission / reception unit 201, a call analysis conversion unit 202, an internal call transmission / reception unit 203, an external voice transmission / reception unit 211, a voice conversion unit 212, An internal audio transmission / reception unit 213, an external media transmission / reception unit 221, a media conversion unit 222, an internal media transmission / reception unit 223, a call management unit 232, a media processing device management unit 242, and a media processing device information transmission / reception unit 243 are realized. The gateway devices 20 and 30 store a call management table 231 and a media processing device management table 241 on hardware resources in the computer. The program can be stored in any storage medium.

The gateway device 20 includes an external call transmission / reception unit 201, can transmit call control information to the call control device 10, and can receive call control information from the call control device 10. Further, the gateway device 20 includes an internal call transmission / reception unit 203, can transmit call control information to the communication terminal 40 and the media processing device 60, and call control from the communication terminal 40 and the media processing device 60. Information can be received.

Similarly to the gateway device 20, the gateway device 30 includes an external call transmission / reception unit (corresponding to 201), can transmit call control information to the call control device 10, and can receive calls from the call control device 10. Control information can be received. Similarly to the gateway device 20, the gateway device 30 includes an internal call transmission / reception unit (corresponding to 203), and is used for communication terminals (50 and 51 in FIG. 1) and media processing devices (70 and 71 in FIG. 1). Call control information can be transmitted, and call control information from communication terminals (50 and 51 in FIG. 1) and media processing devices (70 and 71 in FIG. 1) can be received.

The gateway device 20 includes a call analysis conversion unit 202, analyzes the call control information received from the communication terminal 40, passes the analysis result to the call management unit 232, and includes the own telephone number and the other party telephone number included in the analysis result. Call information can be registered in the call management table 231 (see FIG. 3). Further, the call analysis conversion unit 202 analyzes the call control information received from the call control device 10, passes the analysis result to the call management unit 232, and receives call information such as the own telephone number and the other party telephone number included in the analysis result. It can be registered in the call management table 231 (see FIG. 3). Further, the call analysis conversion unit 202 analyzes the call control information for media transmission / reception received from the media processing device 60, and based on the analysis result, the call management table 231 (see FIG. 3) via the call management unit 232. The target call is specified from the call information stored in (), and the call can be converted into call control information that means the addition of media to the call. Further, the call analysis conversion unit 202 analyzes call control information that means the addition of media from the other gateway device 30 received via the call control device 10, and based on the analysis result, the media processing device management unit The target media processing device is identified from the information stored in the media processing device management table 241 (see FIG. 4) via 242 and the call control information for media transmission / reception is specified for the identified media processing device. The conversion can be repeated until a media processing device capable of converting and transmitting / receiving the media is searched.

Similarly to the gateway device 20, the gateway device 30 includes a call analysis conversion unit (corresponding to 202), analyzes call control information received from a communication terminal (50 and 51 in FIG. 1), and manages the analysis result as a call management. Call information such as the own telephone number and the other party telephone number included in the analysis result can be registered in the call management table (corresponding to 231; see FIG. 3). Further, the call analysis conversion unit (corresponding to 202) analyzes the call control information received from the call control device 10, passes the analysis result to the call management unit 232, and the own telephone number and the other party telephone number included in the analysis result Can be registered in the call management table (corresponding to 231; see FIG. 3). Further, the call analysis conversion unit (corresponding to 202) analyzes the call control information for media transmission / reception received from the media processing device (70, 71 in FIG. 1), and determines the call management unit 232 based on the analysis result. It is possible to identify the target call from the call information stored in the call management table (corresponding to 231; see FIG. 3) and convert it to call control information that means the addition of media to the call. it can. Further, the call analysis conversion unit (corresponding to 202) analyzes call control information that means addition of media from the other gateway device 20 received via the call control device 10, and based on the analysis result, the media The target media processing device is identified from the information stored in the media processing device management table (corresponding to 241; see FIG. 4) via the processing device management unit 242, and media transmission / reception is performed for the identified media processing device. Can be repeatedly processed until a media processing apparatus capable of transmitting and receiving media is searched.

The gateway device 20 includes an external voice transmission / reception unit 211, can transmit voice data to the gateway device 30 in which the other party's communication terminal (50, 51 in FIG. 1) is managed, and the other party's communication. Voice data can be received from the gateway device 30 in which the terminals (50 and 51 in FIG. 1) are managed. The gateway device 20 includes an internal voice transmission / reception unit 213, can transmit voice data to the communication terminal 40, and can receive voice data from the communication terminal 40.

Similarly to the gateway device 20, the gateway device 30 includes an external voice transmission / reception unit (corresponding to 211), and can transmit voice data to the gateway device 20 in which the communication terminal 40 of the other party is managed. The voice data from the gateway device 20 in which the communication terminal 40 of the other party is managed can be received. Further, the gateway device 30 includes an internal voice transmission / reception unit (corresponding to 213), and can transmit voice data to the communication terminal (50 and 51 in FIG. 1). , 51) can be received.

The gateway device 20 includes an audio conversion unit 212, converts audio data received by the external audio transmission / reception unit 211 as necessary (conversion to audio data corresponding to the communication terminal 40), and passes through the internal audio transmission / reception unit 213. To the communication terminal 40. Further, the gateway device 20 converts the voice data received by the internal voice transmitting / receiving unit 213 as necessary (converted into voice data corresponding to the communication terminal of the other party (50 and 51 in FIG. 1)), and the external voice transmitting / receiving unit. It is possible to transmit to the gateway device 30 in which the communication terminal of the other party (50 and 51 in FIG. 1) is managed via 211.

Similarly to the gateway device 20, the gateway device 30 includes a voice conversion unit (corresponding to 212), and converts voice data received by the external voice transmission / reception unit (corresponding to 211) as necessary (communication terminal (of FIG. 1)). 50 and 51), and can be transmitted to the communication terminal (50 and 51 in FIG. 1) via the internal audio transmission / reception unit (corresponding to 213). Further, the gateway device 30 converts the voice data received by the internal voice transmission / reception unit (corresponding to 213) (converts it into voice data corresponding to the communication terminal 40 of the other party) as necessary, and sends it to the external voice transmission / reception unit (211). To the gateway device 20 in which the communication terminal 50 of the other party is managed.

The gateway device 20 includes an external media transmission / reception unit 221 and transmits media data such as a video stream and image data to the gateway device 30 that manages the other party's media processing device (70 and 71 in FIG. 1). In addition, it is possible to receive media data such as a video stream and image data from the gateway device 30 in which the communication terminal (50, 51 in FIG. 1) of the other party is managed. In addition, the gateway device 20 includes an internal media transmission / reception unit 223, can transmit media data such as a video stream and image data to the media processing device 60, and a video stream and an image from the media processing device 60. Media data such as data can be received.

As with the gateway device 20, the gateway device 30 includes an external media transmission / reception unit (corresponding to 221), and media data such as a video stream and image data is transmitted to the gateway device 20 that manages the partner media processing device 60. Can be transmitted, and media data such as a video stream and image data from the gateway apparatus 20 in which the communication terminal 40 of the other party is managed can be received. Further, the gateway device 30 includes an internal media transmission / reception unit (corresponding to 223), and can transmit media data such as a video stream and image data to the media processing device (70 and 71 in FIG. 1). Media data such as a video stream and image data from the media processing device (70 and 71 in FIG. 1) can be received.

The gateway device 20 includes an external media conversion unit 222 and converts media data such as a video stream and image data received by the external media transmission / reception unit 221 as necessary (conversion to media data corresponding to the media processing device 60). The data can be transmitted to the media processing device 60 via the internal media transmission / reception unit 223. Further, the gateway device 20 converts media data such as a video stream and image data received by the internal media transmission / reception unit 223 as necessary (to media data corresponding to the counterpart media processing device (70, 71 in FIG. 1)). And the other media processing device (70, 71 in FIG. 1) can be transmitted to the gateway device 30 managed via the external media transmitting / receiving unit 221.

As with the gateway device 20, the gateway device 30 includes an external media conversion unit (corresponding to 222), and media data such as a video stream and image data received by the external media transmission / reception unit (corresponding to 221) as necessary. Conversion (converted into media data corresponding to the media processing device (70, 71 in FIG. 1)) and the media processing device (70, 71 in FIG. 1) via the internal media transmission / reception unit (corresponding to 223) Can be sent. Further, the gateway device 30 converts media data such as a video stream and image data received by the internal media transmission / reception unit (corresponding to 223) as necessary (converts it into media data corresponding to the partner media processing device 60). Then, it can be transmitted to the gateway device 20 in which the other party's media processing device 60 is managed via an external media transmission / reception unit (corresponding to 221).

The gateway apparatus 20 includes a call management unit 232, and when a call is started between the communication terminals 40 under the gateway apparatus 20, call information such as the own telephone number and the other party telephone number is stored in the call management table 231 (see FIG. 3). You can register. Further, the call management unit 232 can search for information stored in the call management table 231 (see FIG. 3) and provide the searched information to the call analysis conversion unit 202. Further, the gateway device 20 includes a call management table 231 (see FIG. 3), and can store call information in which a call is started.

Similarly to the gateway device 20, the gateway device 30 includes a call management unit (corresponding to 232), and when a call is started between communication terminals (50 and 51 in FIG. 1) under the gateway device 30, Call information such as the other party telephone number can be registered in the call management table (corresponding to 231; see FIG. 3). Further, the call management unit (corresponding to 232) searches the information stored in the call management table (corresponding to 231; see FIG. 3) and provides the retrieved information to the call analysis conversion unit (corresponding to 202). can do. Further, the gateway device 30 includes a call management table (corresponding to 231; see FIG. 3), and can store call information where a call is started.

The gateway device 20 includes a media processing device information transmission / reception unit 243. The gateway device 20 can receive registration information from the media processing device 60 and transmit a result indicating whether or not the registration is successful to the media processing device 60. Further, the gateway device 20 includes a media processing device management unit 242 and can register information related to the media processing device 60 under the gateway device 20 in the media processing device management table 241 (see FIG. 4). In addition, the media processing device management unit 242 can search information stored in the media processing device management table 241 (see FIG. 4) and provide the searched information to the call analysis conversion unit 202. Further, the gateway device 20 includes a media processing device management table 241 (see FIG. 4), and can store information relating to the media processing device 60 that exists under the gateway device 20 and can be used.

As with the gateway device 20, the gateway device 30 includes a media processing device information transmission / reception unit (corresponding to 243), receives registration information from the media processing device (70, 71 in FIG. 1), and has registered successfully? The result of NO can be sent to the media processing device (70, 71 in FIG. 1). Further, the gateway device 30 includes a media processing device management unit (corresponding to 242), and information related to the media processing devices (70 and 71 in FIG. 1) under the gateway device 30 is associated with the media processing device management table (241; (See FIG. 4). Also, the media processing device management unit (corresponding to 242) searches for information stored in the media processing device management table (corresponding to 241; see FIG. 4), and the retrieved information is stored in the call analysis conversion unit (202). Response). Further, the gateway device 30 includes a media processing device management table (corresponding to 241; see FIG. 4), and is present under the gateway device 30 and stores information related to usable media processing devices (70 and 71 in FIG. 1). Can be stored.

Next, a call management table in the communication support system according to the first embodiment of the present invention will be described with reference to the drawings. FIG. 3 is a schematic diagram illustrating a call management table in the communication support system according to the first embodiment of the present invention.

A record is added to the call management table (231 in FIG. 2) when it is determined that a call is started based on an analysis result in the call analysis conversion unit (202 in FIG. 2). At that time, the own phone number and the other party's phone number are set, and the state is either “busy” or “on hold”, and “busy” immediately after the call starts. When there is another incoming call during a call and the previous call is put on hold, the call is put on hold, and the newly added call information is called “busy”. The media usage status is “communication terminal”, “media processing device”, or “none”, and “communication terminal” when a call using an additional medium such as a videophone is performed immediately after the call starts. Otherwise, it is “None”. Further, when transmission / reception of a video stream or image data using a media processing device is added, the media processing device is selected, and an ID for identifying the media processing device is stored as the media processing device ID. In the call ID, an ID for identifying the call is stored, but this ID may be used so as to be unique by the call management unit (232 in FIG. 2), When SIP (Session Initiation Protocol) is used as call control, a Call-ID for identifying a call may be used.

Next, a media processing device management table in the communication support system according to the first embodiment of the present invention will be described with reference to the drawings. FIG. 4 is a schematic diagram illustrating a media processing device management table in the communication support system according to the first embodiment of the present invention.

A record is added to the media processing device management table (241 in FIG. 2) when the media processing device information transmitting / receiving unit (243 in FIG. 2) receives information on the media processing device (60 in FIG. 2). At that time, the status is either “available” or “in use”, and “available” immediately after registration. When the media processing device (60 in FIG. 2) is used as an additional media processing device for an existing voice call, it is “in use”. The media processing device ID stores an ID for identifying the media processing device (60 in FIG. 2). This ID is used as a control unit of the media processing device (60 in FIG. 2) as a SIP (Session Initiation Protocol). ) Is used, the SIP address previously assigned to the media processing device is used, and when using DLNA (Digital Living Network Alliance), UPnP (Universal Plug and Play), etc., the HTTP address is used. For the media processing device name, for example, when using SIP (Session Initiation Protocol) as a control unit of the media processing device (60 in FIG. 2), the display name in SIP is used, and DLNA (Digital Living Network Alliance) or When UPnP (Universal Plug and Play) is used, the device name acquired from each media processing device is used.

Next, a detailed configuration of the media processing device in the communication support system according to the first embodiment of the present invention will be described with reference to the drawings.

Referring to FIG. 2, the media processing device 60 (70 and 71 in FIG. 1) executes a program on hardware resources in a computer, thereby causing a call transmission / reception unit 601, a call generation analysis unit 602, a media transmission / reception unit 621, A media processing unit 622 and a media processing device information transmission / reception unit 641 are realized.

The media processing device 60 includes a call transmission / reception unit 601, can transmit call control information for media transmission / reception to the gateway device 20, and can receive call control information for media transmission / reception from the gateway device 20. Can be received. The call control information for media transmission / reception here refers to a media processing device for associating media data such as a video stream and image data transmission / reception generated and processed with an existing voice call using a media processing device. Is call control information transmitted from or to a media processing device, for example, using SIP (Session Initiation Protocol), DLNA (Digital Living Network Alliance), UPnP (Universal Plug and Play), etc. Can do. Further, the media processing device 60 includes a call generation analysis unit 602, can generate call control information for media transmission / reception, and analyzes the call control information for media transmission / reception received from the gateway device 20. be able to.

Like the media processing device 60, the media processing device (70, 71 in FIG. 1) includes a call transmission / reception unit (corresponding to 601) and transmits call control information for media transmission / reception to the gateway device 30. In addition, call control information for media transmission / reception from the gateway device 30 can be received. The call control information for media transmission / reception here refers to a media processing device for associating media data such as a video stream and image data transmission / reception generated and processed with an existing voice call using a media processing device. Is call control information transmitted from or to a media processing device, for example, using SIP (Session Initiation Protocol), DLNA (Digital Living Network Alliance), UPnP (Universal Plug and Play), etc. Can do. Further, the media processing device (70, 71 in FIG. 1) includes a call generation analysis unit (corresponding to 602), can generate call control information for media transmission / reception, and is received from the gateway device 30. Call control information for media transmission / reception can be analyzed.

The media processing device 60 includes a media transmission / reception unit 621 and can transmit media data such as a video stream and image data to the gateway device 20, and media such as a video stream and image data from the gateway device 20. Data can be received. When the external network and the internal network are the same network, media data such as a video stream and image data does not necessarily have to pass through the gateway device 20, and the media processing device 60 (see FIG. 1) 70, 71) may be transmitted directly. Further, the media processing device 60 includes a media processing unit 622, and can encode media data such as a video stream and image data input from the outside (not shown) into a transmittable state. The decoded data can be decoded and output to a display device or the like.

Similar to the media processing device 60, the media processing device (70, 71 in FIG. 1) includes a media transmission / reception unit (corresponding to 621), and transmits media data such as a video stream and image data to the gateway device 30. In addition, media data such as a video stream and image data from the gateway device 30 can be received. When the external network and the internal network are the same network, media data such as a video stream and image data does not necessarily have to pass through the gateway device 30, and media from the media processing device (70, 71 in FIG. 1) can be used. You may transmit directly to the processing apparatus 60. FIG. Further, the media processing device (70 and 71 in FIG. 1) includes a media processing unit (corresponding to 622) and is in a state in which media data such as a video stream and image data input from the outside (not shown) can be transmitted. The data can be encoded, and the encoded data can be combined and output to a display device or the like.

The media processing device 60 includes a media processing device information transmission / reception unit 641, and transmits information related to the media processing device 60 (information related to the state) to the gateway device 20 when the power of the media processing device 60 is turned on. The result of whether or not the registration is successful can be received from the gateway device 20. In addition, the media processing device information transmission / reception unit 641 transmits information related to the media processing device (information related to the state) to the gateway device 20 immediately before the power of the media processing device 60 is turned off, and succeeds in deleting the registration. Whether or not the result can be received from the gateway device 20.

As with the media processing device 60, the media processing device (70, 71 in FIG. 1) includes a media processing device information transmission / reception unit (corresponding to 641), and the media processing device (70, 71 in FIG. 1) is turned on. When this is done, information (information related to the state) relating to the media processing device (70, 71 in FIG. 1) is transmitted to the gateway device 30, and a result indicating whether or not the registration is successful is received from the gateway device 30. can do. Also, the media processing device information transmission / reception unit (corresponding to 641) provides information (related to the state) related to the media processing device to the gateway device 30 immediately before the media processing device (70, 71 in FIG. 1) is turned off. Information) and information on whether or not the registration deletion was successful can be received from the gateway device 30.

Next, the operation of the communication support system according to the first embodiment of the present invention will be described with reference to the drawings. 5 to 10 are sequence diagrams schematically showing the operation of the communication support system according to the first embodiment of the present invention.

(Registration operation)
The operation (registration operation) until the media processing device 60 is registered in the gateway device 20 will be described with reference to FIG.

First, when the power of the media processing device 60 is turned on, the media processing device information transmission / reception unit (641 in FIG. 2) of the media processing device 60 sends the media processing device 60 to the gateway device 20 (GW device). Call control information requesting registration of such information is transmitted (step A1; see FIG. 5). For example, when SIP (Session Initiation Protocol) is used as the control unit of the media processing device 60, the media processing device information transmitting / receiving unit (641 in FIG. 2) of the media processing device 60 sends a SIP REGISTER command to the gateway device 20. And request registration.

Next, the media processing device information transmission / reception unit (243 in FIG. 2) of the gateway device 20 receives the call control information for requesting the registration deletion from the media processing device 60, so that the information related to the media processing device 60 is transferred to the media. The information is registered in the processing device management table (241 in FIG. 2; see FIG. 4), and the result of registration is transmitted to the media processing device 60 (step A2; see FIG. 5).

Through the above operation, information related to the media processing device 60 is registered in the media processing device management table (241 in FIG. 2) of the gateway device 20, and the media processing device 60 receives the registration result to receive the media processing device 60. It is recognized that 60 is registered in the gateway device 20.

(Call start operation)
An operation (call start operation) from when a call start request is issued from the communication terminal 40 until a call is started between the communication terminals 40 and 50 will be described with reference to FIG.

First, when the communication terminal 40 starts a call to the communication terminal 50, the communication terminal 40 transmits call control information for requesting the communication terminal 50 to start a call to the internal call transmission / reception unit (203 in FIG. 2) of the gateway device 20. (Step C1; see FIG. 7). For example, when the communication terminal 40 is a SIP (Session Initiation Protocol) terminal, the communication terminal 40 can request the communication terminal 50 to start a call by transmitting a SIP INVITE command to the gateway device 20. .

Next, the internal call transmission / reception unit (203 in FIG. 2) of the gateway device 20 receives the call control information requesting the start of the call from the communication terminal 40, thereby receiving the call analysis conversion unit (202 in FIG. 2). The call control information (voice call) for requesting the call control device 10 to start a call is requested. Thereafter, the call analysis conversion unit (202 in FIG. 2) converts the call control information (voice call) for requesting the start of the call into a format that can be interpreted by the call control device 10 as necessary, and the external call transmission / reception unit (FIG. 2). 201) to the call control device 10 (step C2; see FIG. 7). For example, when the communication terminal 40 is a SIP (Session Initiation Protocol) terminal, call control by SIP is performed between the gateway device 20 and the call control device 10, but if there is a difference between them, protocol conversion between SIPs is performed. Will be done.

Next, the call control device 10 starts a call to the gateway device 30 that manages the communication terminal 50 that is the call destination that has received the call control information (voice call) requesting the start of the call from the gateway device 20. Call control information (voice call) requesting is transferred (step C3; see FIG. 7).

Next, the external call transmission / reception unit (corresponding to 201 in FIG. 2) of the gateway device 30 receives the call control information (voice call) requesting the start of the call from the call control device 10, and thereby the call analysis conversion unit ( 2 is requested to transfer call control information (voice call) for requesting the communication terminal 50 to start a call. Thereafter, the call analysis conversion unit (corresponding to 202 in FIG. 2) converts the call control information (voice call) requesting the start of the call into a format that can be interpreted by the communication terminal 50 as necessary, and the internal call transmission / reception unit (FIG. 2). 2 (corresponding to 203 in FIG. 2) is transferred to the communication terminal 50 (step C4; see FIG. 7). For example, when the communication terminal 40 is a SIP (Session Initiation Protocol) terminal, call control is performed by SIP between the gateway apparatus 30 and the call control apparatus 10, but if there is a difference between the SIP, Protocol conversion will be performed.

Next, the communication terminal 50 determines whether or not to start the call by receiving call control information (voice call) requesting the start of the call from the gateway device 30, and sends the result to the gateway device 30. Transmit (step C5; see FIG. 7).

When starting a call, the communication terminal 50 starts transmission of voice data to the communication terminal 40 (step C6; see FIG. 7). When the external network and the internal network are different networks, the voice data from the communication terminal 50 is once received by the internal voice transmission / reception unit (corresponding to 213 in FIG. 2) of the gateway device 30, and as necessary. It is converted (converted into voice data corresponding to the communication terminal 40) by the voice converter (corresponding to 212 in FIG. 2), and transmitted from the external voice transmitter / receiver (corresponding to 211 in FIG. 2) to the gateway device 20 of the other party. . The audio data received by the external audio transmission / reception unit (211 in FIG. 2) of the counterpart gateway device 20 is converted by the audio conversion unit 212 (converted into audio data corresponding to the communication terminal 40) as necessary, It is transmitted to the communication terminal 40 from the voice transmission / reception unit (213 in FIG. 2) and reproduced by the communication terminal 40. On the other hand, when the external network and the internal network are the same network, the audio data does not necessarily have to pass through the gateway devices 20 and 30 and is directly transmitted from the communication terminal 50 to the communication terminal 40.

Next, the internal call transmission / reception unit (corresponding to 203 in FIG. 2) of the gateway device 30 receives the result of whether or not to start a call from the communication terminal 50, thereby to the call analysis conversion unit 202. Request analysis of results and transfer of results. Thereafter, the call analysis / conversion unit (corresponding to 202 in FIG. 2) of the gateway device 30 analyzes the result of whether or not to start the call received from the communication terminal 50, and if the call is started, calls the result. Call information corresponding to the call management table (corresponding to 231 in FIG. 2) is transferred to the management unit (corresponding to 232 in FIG. 2), and call information such as call ID, own telephone number, partner telephone number, video usage status “none”, and status “busy” ; See FIG. 3). Thereafter, the call analysis conversion unit (corresponding to 202 in FIG. 2) converts the result of whether or not to start a call into a format that can be interpreted by the call control device 10 as necessary, and the external call transmission / reception unit (in FIG. 2). (Corresponding to 201) to the call control device 10 (step C7; see FIG. 7). For example, when call control by SIP (Session Initiation Protocol) is performed between the gateway device 30 and the call control device 10, a result such as 200 OK is transferred.

Next, the call control device 10 receives the result of whether or not to start a call from the gateway device 30, and gives the result to the gateway device 20 that manages the communication terminal 40 that is the call source. Transfer (step C8; see FIG. 7).

Next, the external call transmission / reception unit (201 in FIG. 2) of the gateway device 20 receives the result of whether or not to start a call from the call control device 10, thereby receiving a call analysis conversion unit (202 in FIG. 2). To request analysis of results and transfer of results. Thereafter, the call analysis conversion unit (202 in FIG. 2) of the gateway device 20 analyzes the result of whether or not to start the call received from the call control device 10, and if the call is started, calls the result. The call information is transferred to the management unit (232 in FIG. 2), and call information such as the call ID, the own telephone number, the other party telephone number, the video usage status “none”, and the state “busy” is stored in the call management table (231 in FIG. 2; see FIG. 3). ). Thereafter, the call analysis conversion unit (202 in FIG. 2) converts the result of whether or not to start a call as necessary into a format that can be interpreted by the communication terminal 40, and from the internal call transmission / reception unit (203 in FIG. 2). Transfer to the communication terminal 40 (step C9; see FIG. 7). For example, when the communication terminal 40 is a SIP (Session Initiation Protocol) terminal, a result such as 200 OK is transferred.

Next, the communication terminal 40 confirms the result by receiving the result of whether or not to start the call from the gateway device 20, and when starting the call, the communication terminal 50 transmits the voice data to the communication terminal 50. Start sending. When the external network and the internal network are different networks, the voice data from the communication terminal 40 is once received by the internal voice transmission / reception unit (213 in FIG. 2) of the gateway device 20, and converted as necessary. 2 (212 in FIG. 2) (converted into audio data corresponding to the communication terminal 50), and transmitted from the external audio transmitting / receiving unit (211 in FIG. 2) to the other gateway device 30. Audio data received by the external audio transmission / reception unit (corresponding to 211 in FIG. 2) of the counterpart gateway device 30 is converted (corresponding to the communication terminal 50) by the audio conversion unit (corresponding to 212 in FIG. 2) as necessary. And is transmitted to the communication terminal 50 from the internal voice transmission / reception unit (corresponding to 213 in FIG. 2) and reproduced by the communication terminal 50. The procedure until the audio data from the communication terminal 50 is reproduced by the communication terminal 40 is the same. On the other hand, when the external network and the internal network are the same network, the voice data does not necessarily have to pass through the gateway devices 20 and 30 and is directly transmitted from the communication terminal 40 to the communication terminal 50.

Through the above operation, a call is started between the communication terminals 40 and 50, call information between the communication terminals 40 and 50 is stored in the call management table (231 in FIG. 2), and existing call control information (voice) is stored. It can be used to add transmission / reception of media data such as video stream and image data to (call).

(Media start operation)
Media data such as video streams and image data is transmitted and received by the media processing devices 60 and 70 under the gateway devices 20 and 40 in association with existing voice calls under the gateway devices 20 and 40 (call control information for requesting the start of a call). The operation until the start (media start operation) will be described with reference to FIG.

First, the call generation / analysis unit (602 in FIG. 2) of the media processing device 60 generates call control information for media transmission / reception, and the call control information to the gateway device 20 from the call transmission / reception unit (601 in FIG. 2). To start the media transmission / reception (step E1; see FIG. 9). The call control information generated here is call control information indicating the start of media transmission / reception between the media processing device 60 and the communication terminal 40. For example, when SIP (Session Initiation Protocol) is used as the control unit of the media processing device 60, the SIP-URI of the communication terminal 40 is included in the REQUEST-URI and TO of the INVITE command, and the SIP of the media processing device 60 is included in the FROM. -By including the URI, call control information means the start of media transmission / reception between the media processing device 60 and the communication terminal (40 in FIG. 1). As described above, the call control information requires information for identifying the communication terminal (40 in FIG. 1). However, these pieces of information may be input on the media processing device 60 or the communication terminal (FIG. 1). No. 40) may be obtained using a communication means such as infrared communication, or information may be obtained by holding a non-contact IC card mounted on a mobile phone.

Next, the internal call transmission / reception unit (203 in FIG. 2) of the gateway device 20 receives the call control information indicating the start of media transmission / reception from the media processing device 60, thereby receiving a call analysis conversion unit (202 in FIG. 2). ) Is requested to analyze call control information. The call analysis conversion unit (202 in FIG. 2) is sent from the media processing device registered in the media processing device management table (241 in FIG. 2; see FIG. 4) via the media processing device management unit (242 in FIG. 2). Is determined to be a request to start media transmission / reception, and the corresponding information is selected from the information registered in the call management table (231 in FIG. 2; see FIG. 3) via the call management unit (232 in FIG. 2). Identify the call. Here, when specifying a call, a communication terminal (40 in FIG. 1) as a call partner in the call control information transmitted from the media processing device 60 is registered as its own telephone number, and a call that is not on hold is selected. Select (step E2; see FIG. 9).

After the communication terminal 40 is registered as its own telephone number and specifies a call that is not on hold, the call analysis / conversion unit (202 in FIG. 2) of the gateway device 20 performs call control that means the start of media transmission / reception. The information is converted into a format that can be interpreted by the call control device 10 as well as a media addition request for an existing voice call (call control information for requesting the start of a call), and the call control information that represents the converted media addition request It transmits to the call control apparatus 10 from an external call transmission / reception part (201 of FIG. 2) (step E3; refer FIG. 9). For example, when call control by SIP (Session Initiation Protocol) is performed between the gateway device 20 and the call control device 10, an INVITE command for session update in which m = row for additional media is added is transmitted. Is done.

Next, the call control device 10 receives the call control information indicating the media addition request for the existing voice call (call control information for requesting the start of the call) from the gateway device 20, thereby receiving the communication terminal as the request destination. Call control information indicating a media addition request for an existing voice call (call control information for requesting the start of a call) is transferred to the gateway device 30 that manages (50 in FIG. 1) (step E4; FIG. 9). reference).

Next, the external call transmission / reception unit (corresponding to 201 in FIG. 2) of the gateway device 30 is a call control that means a media addition request for an existing voice call (call control information for requesting the start of a call) from the call control device 10. By receiving the information, the call analysis conversion unit (corresponding to 202 in FIG. 2) is requested to analyze the call control information indicating the media addition request. The call analysis / conversion unit (corresponding to 202 in FIG. 2) determines that the call control information means a media addition request for an existing voice call (call control information for requesting the start of a call), and the media processing device management unit ( 2) to identify a device whose status of the media processing device registered in the media processing device management table (corresponding to 241 in FIG. 2; see FIG. 4) is “available”. (Step E5; see FIG. 9).

After identifying some available media processing devices, the call analysis conversion unit (corresponding to 202 in FIG. 2) of the gateway device 30 means the start of media transmission / reception with respect to the media processing device 70 which is one of them. Call control information is generated and transmitted to the media processing device 70 from the internal call transmitting / receiving unit (corresponding to 203 in FIG. 2) (step E6; see FIG. 9). The call control information generated here is call control information indicating the start of media transmission / reception between the communication terminal 50 and the media processing device 70. For example, when SIP (Session Initiation Protocol) is used as the control unit of the media processing device 70, the SIP-URI of the media processing device 70 is included in the REQUEST-URI and TO of the INVITE command, and the SIP of the communication terminal 50 is included in the FROM. -By including the URI, call control information indicating the start of media transmission / reception between the communication terminal 50 and the media processing device 70 is obtained.

Next, the call transmission / reception unit (corresponding to 601 in FIG. 2) of the media processing device 70 means the start of media transmission / reception between the communication terminal (50 in FIG. 1) from the gateway device 30 and the media processing device 70. By receiving the call control information, the call generation analysis unit (corresponding to 602 in FIG. 2) is requested to analyze the call control information. The call generation analysis unit (corresponding to 602 in FIG. 2) requests the user to determine whether or not to perform additional media transmission / reception on the media processing device 70 using a screen display or the like. The result is returned to the gateway device 30 (step E7; see FIG. 9).

In addition, when the additional media transmission / reception starts (when the result is OK), the media processing device 70 starts transmission / reception of media data to / from the media processing device 60 (step E8; see FIG. 9). When the external network and the internal network are different networks, media data such as a video stream and image data from the media processing device 70 is sent to the internal media transmission / reception unit of the gateway device 30 (corresponding to 223 in FIG. 2). And is converted by the media conversion unit 222 (converted to media data corresponding to the media processing device 60) as necessary, and transferred from the external media transmission / reception unit (corresponding to 221 in FIG. 2) to the gateway device 20 of the other party. Sent. Media data such as a video stream and image data received by the external media transmission / reception unit (221 in FIG. 2) of the counterpart gateway device 20 is converted by the media conversion unit (222 in FIG. 2) as necessary (media processing). Converted into media data corresponding to the device 60, transmitted to the media processing device 60 from the internal media transmission / reception unit (223 in FIG. 2), and displayed on the media processing device 60. On the other hand, when the external network and the internal network are the same network, media data such as video streams and image data does not necessarily have to pass through the gateway devices 20 and 30, and the media processing device 70 to the media processing device 60. Sent directly. In addition, media data such as a video stream and image data may be transmitted only from the media processing device 60 in the direction of the media processing device 70. In such a case, transmission / reception of media data to the media processing device 60 is started. The step of performing (step E8) is omitted.

Next, the internal call transmission / reception unit (corresponding to 203 in FIG. 2) of the gateway device 30 receives the result of whether or not to start the media transmission / reception from the media processing device 70, and thereby the call analysis conversion unit (FIG. 2). To the analysis of the result. The call analysis / conversion unit (corresponding to 202 in FIG. 2) of the gateway device 30 analyzes the result of whether to start the media transmission / reception received from the media processing device 70, and when the media transmission / reception is rejected (result is NG) In this case, the status of the media processing device registered in the media processing device management table (corresponding to 241 in FIG. 2; see FIG. 4) via the media processing device management unit (corresponding to 242 in FIG. 2) is displayed. The next device (for example, media processing device 71) that is “available” is searched (step E9; see FIG. 9). Thereafter, the gateway device 30 specifies a media processing device by the search (step E5), and transmits call control information for a media addition request to the specified media processing device (step E6). In addition, when the communication terminal (50 in FIG. 1) can start additional media transmission / reception as in the TV phone usage mode, for example, the communication terminal (50 in FIG. 1) Call control which means media addition to the communication terminal instead of call control information which means the start of media transmission / reception between the communication terminal and the media processing device with respect to the communication terminal 50. By transmitting information (for example, when call control by SIP is performed between the gateway device and the call control device, m = INVITE command for session update with additional media added), Similar functions can be realized.

Next, the call analysis / conversion unit (corresponding to 202 in FIG. 2) of the gateway device 30 analyzes the result of whether or not to start media transmission / reception received from the media processing device 70. The result is passed to the call management unit (corresponding to 232 in FIG. 2), and the media processing device 70 is registered in the media usage status in the corresponding existing call information in the call management table (corresponding to 231 in FIG. 2; see FIG. 3). To do. Further, the call analysis conversion unit (corresponding to 202 in FIG. 2) converts the result of whether to start media transmission / reception into a format indicating the result of whether to add media transmission / reception that can be interpreted by the call control device 10. Then, the call is transferred from the external call transmission / reception unit (corresponding to 201 in FIG. 2) to the call control device 10 (step E10; see FIG. 9). For example, when call control by SIP (Session Initiation Protocol) is performed between the gateway device 30 and the call control device 10, a result such as 200 OK is transferred.

Next, the call control device 10 receives the result of whether or not to add media transmission / reception from the gateway device 30 and transfers the result to the gateway device 20 as the request source (step E11; FIG. 9). reference).

Next, the external call transmission / reception unit (201 in FIG. 2) of the gateway device 20 receives the result of whether or not to add media transmission / reception from the call control device 10 to the call analysis conversion unit 202. Request analysis of results. The call analysis conversion unit (202 in FIG. 2) of the gateway device 20 analyzes the result of whether or not to add media transmission / reception received from the call control device 10, and when adding media transmission / reception, the call management unit (232 in FIG. 2), and the media processing device 60 is registered in the media usage status in the corresponding existing call information in the call management table (231 in FIG. 2; see FIG. 3). Further, the call analysis conversion unit (202 in FIG. 2) converts the result of whether or not to add media transmission / reception into a format indicating the result of whether or not to start media transmission / reception that can be interpreted by the media processing device 60. The call transmission / reception unit (201 in FIG. 2) transfers to the media processing device 60 (step E12; see FIG. 9). For example, when call control by SIP (Session Initiation Protocol) is performed between the gateway apparatus 20 and the media processing apparatus 60, a result such as 200 OK is transferred.

Next, the media processing device 60 receives the result of whether or not to start media transmission / reception from the gateway device 20, confirms the result, and starts additional media transmission / reception (when the result is OK). ) Starts transmission of media data to the media processing device 70 (step E13). When the external network and the internal network are different networks, media data such as a video stream and image data from the media processing device 60 is temporarily received by the internal media transmission / reception unit (223 in FIG. 2) of the gateway device 20. If necessary, it is converted by the media conversion unit (222 in FIG. 2) (converted to media data corresponding to the media processing device 70) and transmitted from the external media transmission / reception unit (221 in FIG. 2) to the other gateway device 30. Is done. Media data such as a video stream and image data received by the external media transmission / reception unit (corresponding to 221 in FIG. 2) of the counterpart gateway device 30 is converted by the media conversion unit 222 as necessary (to the media processing device 70). Converted into corresponding media data), transmitted from the internal media transmission / reception unit (corresponding to 223 in FIG. 2) to the media processing device 70, and displayed on the media processing device 70. On the other hand, when the external network and the internal network are the same network, media data such as a video stream and image data does not necessarily have to pass through the gateway devices 20 and 30, and the media processing device 60 to the media processing device 70. Sent directly.

Through the above operation, video streams and images by the media processing devices 60, 70, 71 under the gateway devices 20, 30 are associated with the existing voice calls under the gateway devices 20, 30 (call control information for requesting the start of a call). Transmission / reception of media data such as data is started.

(Media end operation)
Video stream, image data, etc. by the media processing devices 60, 70, 71 under the gateway devices 20, 30 implemented in association with the existing voice calls under the gateway devices 20, 30 (call control information for requesting the start of a call), etc. The operation until the end of the transmission / reception of the media data (media end operation) will be described with reference to FIG.

First, the call generation analysis unit (602 in FIG. 2) of the media processing device 60 generates call control information for ending the media transmission / reception, and the call transmission / reception unit (601 in FIG. 2) calls the gateway device 20 with a call. Control information is transmitted (step F1; see FIG. 10). The call control information generated here is call control information that means the end of media transmission / reception between the media processing device 60 and the communication terminal (40 in FIG. 1). For example, when SIP (Session Initiation Protocol) is used as the control unit of the media processing device 60, the REQUEST-URI and TO of the BYE command include the SIP-URI of the communication terminal (40 in FIG. 1) and the media in the FROM By including the SIP-URI of the processing device 60, the call control information signifies the end of media transmission / reception between the media processing device 60 and the communication terminal (40 in FIG. 1).

Also, the media processing device 60 ends transmission of media data such as a video stream and image data to the media processing device 70 (step F2; see FIG. 10). In the description here, an example in which a media transmission / reception end notification is issued from the media processing device 60 that has issued a media transmission / reception start request is shown. There is no restriction, and the same thing can be realized.

Next, the internal call transmission / reception unit (203 in FIG. 2) of the gateway device 20 receives the call control information for ending the media transmission / reception from the media processing device 60, whereby the call analysis conversion unit (202 in FIG. 2). ) Is requested to analyze call control information. The call analysis conversion unit (202 in FIG. 2) is sent from the media processing device registered in the media processing device management table (241 in FIG. 2; see FIG. 4) via the media processing device management unit (242 in FIG. 2). It is determined that it is a notification of the end of media transmission / reception, and it corresponds from the information registered in the call management table (231 in FIG. 2; see FIG. 3) via the call management unit (232 in FIG. 2). Identify the call. Here, when a call is specified, the communication terminal (40 in FIG. 1) as a call partner in the call control information transmitted from the media processing device 60 is registered as its own telephone number, and the media processing status indicates the media processing. A call for which the device 60 is set is specified (step F3; see FIG. 10).

After identifying a call in which the communication terminal (40 in FIG. 1) is registered as its own telephone number and the media processing device 60 is set in the media usage status, the call analysis conversion unit (FIG. 2) of the gateway device 20 is identified. 202) converts the call control information for ending the transmission / reception of the media into a format which means that the media for the existing voice call (call control information for requesting the start of a call) is deleted and which can be interpreted by the call control device 10. Then, the external call transmitting / receiving unit (201 in FIG. 2) transmits the call to the call control device 10 (step F4; see FIG. 10). For example, when call control is performed between the gateway device 20 and the call control device 10 using SIP (Session Initiation Protocol), an INVITE command for session update in which m = row for additional media is deleted is transmitted. Is done.

Next, the call control device 10 receives the call control information indicating media deletion for the existing voice call (call control information for requesting the start of a call) from the gateway device 20, thereby receiving a communication terminal ( Call control information indicating media deletion for an existing voice call (call control information requesting start of call) is transferred to the gateway device 30 in which 50) of FIG. 1 is managed (step F5; see FIG. 10). .

Next, the external call transmission / reception unit (corresponding to 201 in FIG. 2) of the gateway device 30 calls the call control information that means media deletion for the existing voice call (call control information for requesting the start of the call) from the call control device 10. Is received, the call analysis conversion unit (corresponding to 202 in FIG. 2) is requested to analyze the call control information meaning media deletion. The call analysis / conversion unit (corresponding to 202 in FIG. 2) determines that the media is deleted from the existing voice call (call control information requesting the start of a call), and passes through the call management unit (corresponding to 232 in FIG. 2). The corresponding call is specified from the information registered in the call management table (corresponding to 231 in FIG. 2; see FIG. 3). The call analysis conversion unit (corresponding to 202 in FIG. 2) determines that the notification destination is the media processing device 70 according to the media usage status of the specified call, and calls control that means the end of media transmission / reception with respect to the media processing device 70 Information is generated and transmitted from the internal call transmission / reception unit (corresponding to 203 in FIG. 2) to the media processing device 70 (step F6; see FIG. 10). The call control information generated here is call control information that means the end of media transmission / reception between the media processing device 70 and the communication terminal (50 in FIG. 1). For example, when using SIP (Session Initiation Protocol) as the control unit of the media processing device 70, the REQUEST-URI and TO of the BYE command include the SIP-URI of the media processing device 70 in the FROM, and the communication terminal (FIG. 1). 50) of the SIP-URI, the call control information means the end of media transmission / reception between the media processing device 70 and the communication terminal (50 in FIG. 1).

Next, the call transmission / reception unit (corresponding to 601 in FIG. 2) of the media processing device 70 means the end of media transmission / reception between the communication terminal (50 in FIG. 1) from the gateway device 30 and the media processing device 70. By receiving the call control information, the call generation analysis unit 602 analyzes the call control information, finishes the transmission of the media data such as the video stream and the image data to the media processing device 60, and the result is the gateway device. 30 (step F7; see FIG. 10).

Next, the internal call transmission / reception unit (corresponding to 203 in FIG. 2) of the gateway device 30 receives the result of deletion of the media transmission / reception from the media processing device 70, thereby responding to the call analysis / conversion unit (corresponding to 202 in FIG. 2). ) Is requested to analyze the results. The call analysis conversion unit (corresponding to 202 in FIG. 2) of the gateway device 30 analyzes the result of the media transmission / reception deletion received from the media processing device 70, and when deleting the media transmission / reception, the call management unit (FIG. 2). 232), the media processing device 70 is deleted from the media usage status in the corresponding existing call information in the call management table (corresponding to 231 in FIG. 2; see FIG. 3), and returned to “none”. The call analysis conversion unit (corresponding to 202 in FIG. 2) converts the media transmission / reception into a format indicating the result of deleting the media transmission / reception so that the call control apparatus 10 can interpret the end of the media transmission / reception. The call is transferred to the call control device 10 (step F8). For example, when call control by SIP (Session Initiation Protocol) is performed between the gateway device 30 and the call control device 10, a result such as 200 OK is transferred.

Next, the call control device 10 receives the result of deleting the media transmission / reception from the gateway device 30 and transfers the result to the gateway device 20 as the request source (step F9; see FIG. 10).

Next, the external call transmission / reception unit (201 in FIG. 2) of the gateway device 20 receives the result of deleting the media transmission / reception from the call control device 10 to the call analysis / conversion unit (202 in FIG. 2). Request analysis of the results. The call analysis / conversion unit (202 in FIG. 2) of the gateway device 20 transmits the media in the corresponding existing call information in the call management table (231 in FIG. 2; see FIG. 3) via the call management unit (232 in FIG. 2). The media processing device 60 is deleted from the usage status and returned to “none”. Further, the call analysis conversion unit (202 in FIG. 2) converts the result of deleting the media transmission / reception into a format indicating the result of the completion of the media transmission / reception so that the call control apparatus 10 can interpret the result, and the external call transmission / reception unit (FIG. 2). 2 201) to the media processing device 60 (step F10; see FIG. 10). For example, when call control by SIP (Session Initiation Protocol) is performed between the gateway apparatus 20 and the media processing apparatus 60, a result such as 200 OK is transferred.

By the above operation, the video by the media processing devices 60, 70, 71 under the gateway devices 20, 30 that is implemented in association with the existing voice call under the gateway devices 20, 30 (call control information for requesting the start of a call). Transmission / reception of media data such as a stream and image data ends.

(End call operation)
An operation (call end operation) from when a call end notification is issued from the communication terminal 40 to when the call between the communication terminals 40 and 50 is ended will be described with reference to FIG.

First, when the communication terminal 40 ends a call to the communication terminal 50, the communication terminal 40 notifies the communication terminal 50 of a call end notification (requests to end the call) to the internal call transmission / reception unit (203 in FIG. 2) of the gateway device 20. Call control information) (step D1; see FIG. 8). For example, when the communication terminal 40 is a SIP (Session Initiation Protocol) terminal, a SIP BYE command can be transmitted to the gateway device 20 to notify the communication terminal 50 of the end of the call.

Further, the communication terminal 40 ends the transmission of audio data to the communication terminal 50 (step D2; see FIG. 8). Here, an example is shown in which a call end notification is issued from the communication terminal 40 that is a terminal that has issued a call start request, but there is no operational restriction even when a call end notification is issued from the communication terminal 50 of the other party. The same thing can be realized.

Next, the internal call transmission / reception unit (203 in FIG. 2) of the gateway device 20 receives the call end notification (call control information for requesting the end of the call) from the communication terminal 40, so that the call analysis conversion unit (FIG. 2). 202) is requested to analyze the notification and transfer the notification. The call analysis / conversion unit (202 in FIG. 2) of the gateway device 20 analyzes the call end notification (call control information for requesting call end) received from the communication terminal 40, and passes through the call management unit (232 in FIG. 2). The corresponding call is specified from the information registered in the call management table (231 in FIG. 2; see FIG. 3). The call analysis / conversion unit (202 in FIG. 2) of the gateway device 20 performs transmission / reception of media data such as a video stream and image data between media processing devices according to the media usage status of the specified call. Call control information indicating the end of media transmission / reception with respect to the media processing device 60 is generated and transmitted to the media processing device 60 from the internal call transmission / reception unit (203 in FIG. 2) (step D3; see FIG. 8). The call control information generated here is call control information that means the end of media transmission / reception between the media processing device 60 and the communication terminal 40. For example, when using SIP (Session Initiation Protocol) as the control unit of the media processing device 60, the SIP-URI of the communication terminal 40 is included in the REQUEST-URI and TO of the BYE command, and the SIP of the media processing device 60 is included in the FROM. -By including the URI, call control information indicating the end of media transmission / reception between the media processing device 60 and the communication terminal 40 is obtained.

Next, the call transmission / reception unit (601 in FIG. 2) of the media processing device 60 receives call control information indicating the end of media transmission / reception between the communication terminal 40 and the media processing device 60 from the gateway device 20. Thus, the call generation analysis unit (602 in FIG. 2) analyzes the call control information, and the transmission of the media data such as the video stream and the image data to the media processing device 60 is finished (step D4; see FIG. 8). .

Next, the call analysis conversion unit (202 in FIG. 2) of the gateway device 20 passes through the call management unit (232 in FIG. 2) based on the analysis information of the call end notification (call control information for requesting call end). Corresponding call information (record) in the call management table (231 in FIG. 2; see FIG. 3) is deleted. Further, the call analysis conversion unit (202 in FIG. 2) converts the call end notification (call control information for requesting call end) into a format that can be interpreted by the call control device 10 as necessary, and converts the external call transmission / reception unit (see FIG. 2). 2 to the call control apparatus 10 (step D5; see FIG. 8). For example, when the communication terminal 40 is a SIP (Session Initiation Protocol) terminal and the call control by SIP is performed between the gateway device 20 and the call control device 20, if there is a difference between them, the SIP Protocol conversion between them is performed.

Next, the call control device 10 receives the call end notification (call control information for requesting the call end) from the gateway device 20, thereby the gateway device 30 that manages the communication terminal 50 that is the notification destination. Then, a call end notification (call control information for requesting call end) is transferred (step D6; see FIG. 8).

Next, the external call transmission / reception unit (corresponding to 201 in FIG. 2) of the gateway device 30 receives the call end notification (call control information requesting the end of the call) from the call control device 10, whereby the call analysis conversion unit (Corresponding to 202 in FIG. 2) is requested to analyze the notification and transfer the notification. The call analysis / conversion unit (corresponding to 202 in FIG. 2) of the gateway device 30 analyzes the call end notification (call control information for requesting call end) received from the call control device 10 and analyzes the call management unit (232 in FIG. 2). The corresponding call is specified from the information registered in the call management table (corresponding to 231 in FIG. 2; see FIG. 3). The call analysis / conversion unit (corresponding to 202 in FIG. 2) of the gateway device 30 transmits and receives media data such as video streams and image data between the media processing devices 60 and 70 according to the media usage status of the specified call. In this case, call control information indicating the end of media transmission / reception with respect to the media processing device 70 is generated and transmitted to the media processing device 70 from the internal call transmission / reception unit (corresponding to 203 in FIG. 2) (step D7; FIG. 8). The call control information generated here is call control information indicating the end of media transmission / reception between the media processing device 70 and the communication terminal 50. For example, when using SIP (Session Initiation Protocol) as the control unit of the media processing device 70, the SIP command URI of the BYE command includes the SIP-URI of the media processing device 70 in the REQUEST-URI and TO of the BYE command, and the SIP of the communication terminal 50 in the FROM. -By including the URI, call control information indicating the end of media transmission / reception between the media processing device 70 and the communication terminal 50 is obtained.

Next, the call transmission / reception unit (corresponding to 601 in FIG. 2) of the media processing device 70 receives call control information indicating the end of media transmission / reception between the communication terminal 50 and the media processing device 70 from the gateway device 30. By receiving the call, the call generation / analysis unit 602 analyzes the call control information, and ends transmission of media data such as a video stream and image data to the media processing device 70 (step D8; see FIG. 8).

Next, the call analysis / conversion unit (corresponding to 202 in FIG. 2) of the gateway apparatus 30 passes through the call management unit (corresponding to 232 in FIG. 2) based on the analysis information of the call control information (FIG. 2). Corresponding voice call information (record) in FIG. 3) is deleted. Further, the call analysis conversion unit (corresponding to 202 in FIG. 2) converts the call end notification (call control information for requesting call end) into a format that can be interpreted by the communication terminal 50 as necessary, and the external call transmitting / receiving unit ( (Corresponding to 201 in FIG. 2) is transferred to the communication terminal 50 (step D9; see FIG. 8). For example, the communication terminal 50 is a SIP (Session Initiation Protocol) terminal, and the call control by SIP is performed between the gateway device 30 and the call control device 10, but if there is a difference between them, the SIP Protocol conversion between them is performed.

Next, the communication terminal 50 receives the call end notification (call control information for requesting call end) from the gateway device 30 and ends the call (sending of voice data) to the communication terminal 40 (step D10; (See FIG. 8).

Through the above operation, information relating to the call between the communication terminals 40 and 50 is deleted from the call management table (231 in FIG. 2; see FIG. 3) in the gateway devices 20 and 30, and the video stream is terminated when the existing call ends. And transmission / reception of media data such as image data can be terminated simultaneously.

(Delete operation)
The operation (deletion operation) until the media processing device 60 is registered and deleted from the gateway device 20 will be described with reference to FIG.

First, immediately before the power of the media processing device 60 is turned off, the media processing device information transmission / reception unit (641 in FIG. 2) of the media processing device 60 deletes registration of information related to the media processing device 60 from the gateway device 20. The requested call control information is transmitted (step B1; see FIG. 6). For example, the media processing device information transmitting / receiving unit (641 in FIG. 2) of the media processing device 60 transmits the EXPIRES value of the REGISTER command of SIP (Session Initiation Protocol) to 0 to the gateway device 20 to delete the registration information. Can be requested.

Next, the media processing device information transmission / reception unit (243 in FIG. 2) of the gateway 20 receives the call control information for requesting the registration deletion from the media processing device 60, thereby processing the information related to the media processing device 60 with the media processing. The information is deleted from the device management table (241 in FIG. 2; see FIG. 4), and the result related to the registration deletion is transmitted to the media processing device 60 (step B2; see FIG. 6).

Through the above operation, information related to the media processing device 60 is deleted from the media processing device management table (241 in FIG. 2; see FIG. 4) in the gateway device 20.

According to the first embodiment, it is not necessary to register the IP address of the local information processing apparatus and the terminal number of the local communication terminal in a one-to-one relationship as in the prior art, and multimedia communication is necessary. At this stage, an appropriate one can be selected and used from a plurality of media processing devices managed under the gateway device (see FIG. 9). The reason for this is that call control information that means the addition of media transmission / reception received from the other gateway device is analyzed, the target media processing device is identified from the media processing devices stored in the media processing device management table, and This is because it is provided with a call analysis conversion unit that converts it into call control information for media transmission / reception for the media processing device and repeatedly performs processing until a media processing device capable of media transmission / reception is searched.

Also, multimedia communication of media data such as video stream and image data transmission / reception between the media processing devices associated at the time of termination of the voice call can be terminated at the same time, and an operation of ending separately is not necessary (see FIG. 8). The reason is that transmission / reception of media data such as a video stream and image data generated and processed using a media processing device under the gateway device is associated with an existing voice call. This is because transmission / reception of media data such as a video stream and image data is managed as one session.

Example 2 of the present invention will be described with reference to the drawings. FIG. 12 is a block diagram schematically illustrating the configuration of the communication support system according to the second embodiment of the present invention.

The communication support system according to the second embodiment is obtained by improving the operations of steps E5 to E10 (see FIG. 9) in the media start operation of the first embodiment.

In the first embodiment, in step E5 of FIG. 9, the call analysis / conversion unit (corresponding to 202 in FIG. 2) of the gateway device 30 determines that the media transmission / reception is added to the existing voice call, and the media processing device management unit Identify the device whose status is “available” from the media processing devices registered in the media processing device management table (corresponding to 241 in FIG. 2; see FIG. 4) via (corresponding to 242 in FIG. 2) The operation of doing. Here, in order to select a media processing device to be actually used from among a plurality of “available” media processing devices, media transmission / reception between the communication terminal and the media processing device is sequentially performed with respect to each media processing device. The call control information that means the start of is transmitted and the result is analyzed. That is, in the first embodiment, there are many “available” media processing devices, and in order to select a media processing device to be actually used, a request for starting transmission / reception of media to another media processing device is rejected. Do several times.

As a method for efficiently performing such work, the media processing device management table of FIG. 4 is expanded as shown in FIG. 11, and a record is added when the power of the media processing device is turned on as in the first embodiment. However, instead of deleting the record immediately before the power is turned off, in addition to the media processing device ID and the media processing device name, a record having information such as its own telephone number, media type, and priority is added in advance. It can also be managed to change the state to “available” when the processing apparatus is turned on, and to change the state to “power off” immediately before the power is turned off. By using the extended media processing device management table as shown in FIG. 12, candidates for media processing devices to be actually used are narrowed down from a plurality of “available” media processing devices, or media transmission / reception is performed in order of priority. It is possible to send a start request, which improves usability.

However, when the extended media processing device management table 241 as shown in FIG. 12 is used, necessary information must be registered in advance.

Therefore, in the second embodiment, the media processing device to be actually used can be easily selected from a plurality of “available” media processing devices without registering information in advance. Hereinafter, a communication support system according to the second embodiment will be described.

Referring to FIG. 12, the communication support system according to the second embodiment newly includes a menu voice synthesis unit 251 and a DTMF analysis unit 252 in the gateway devices 20 and 30 of the communication support system according to the first embodiment.

The menu voice synthesizer 251 can synthesize a guidance voice for selecting one media processing device from “available” media processing devices.

The DTMF analysis unit 252 analyzes the audio data acquired from the audio conversion unit 212, reads out a DTMF (Dual-Tone Multi-Frequency) signal from the audio data, and what number is selected, that is, which media processing It can be determined whether the device has been selected.

Next, the operation of the communication support system according to the second embodiment of the present invention will be described with reference to the drawings. FIG. 13 is a sequence diagram schematically showing the media start operation of the communication support system according to the second embodiment of the present invention. FIG. 13 shows the operation from step E4 to step E10 in the sequence diagram of FIG. 9 according to the first embodiment.

After the call control information indicating the media addition request is transferred from the call control device 10 (step E4), the external call transmission / reception unit (corresponding to 201 in FIG. 12) of the gateway device 30 Meaning a media addition request to the call analysis conversion unit (corresponding to 202 in FIG. 12) by receiving call control information that represents a media addition request for a voice call (call control information requesting the start of a call) Requests analysis of call control information. The call analysis / conversion unit (corresponding to 202 in FIG. 12) determines that media transmission / reception is added to the existing voice call, and the media processing device management table (corresponding to 242 in FIG. 12) is passed through the media processing device management unit (corresponding to 242 in FIG. 12). 2 corresponds to 241 in FIG. 2 (see FIG. 4), and identifies a device whose status is “available” from the registered media processing devices, and uses a menu speech synthesizer (corresponding to 251 in FIG. 12). And synthesizing a guidance voice for selecting one media processing device from among the specified media processing devices. Further, the gateway device 30 mixes the guidance voice for selecting the synthesized media processing device in the voice conversion unit (corresponding to 212 in FIG. 12) (step G1; see FIG. 13). For example, a guidance voice saying “There is a request for additional media transmission / reception. Select 1 for transmission / reception via STB (Set Top Box) and 2 for transmission / reception via STB 2”. The guidance voice for selecting the mixed media processing device is reproduced by the communication terminal 50 via the internal voice transmission / reception unit (corresponding to 213 in FIG. 12) and can be heard by the user.

Next, the communication terminal 50 mixes and reproduces the guidance sound for selecting the media processing device, and the user who hears the guidance pushes the number of the media processing device that the user wants to use for media transmission / reception according to the content. The DTMF signal of the pushed number is transmitted (step G2; see FIG. 13).

Next, the gateway device 30 receives the audio data including the DTMF signal from the communication terminal 50 through the internal audio transmission / reception unit (corresponding to 213 in FIG. 12), and thereby from the audio converting unit (corresponding to 212 in FIG. 12). The DTMF analyzer (corresponding to 252 in FIG. 12) is passed, and the DTMF analyzer (corresponding to 252 in FIG. 12) detects the DTMF signal. Further, the gateway device 30 collates the detected DTMF signal number with the information used when synthesizing the guidance voice in the call analysis conversion unit (corresponding to 202 in FIG. 12), and which media processing device Determine whether is selected. Here, it is assumed that the media processing device 70 is selected. Further, the gateway device 30 passes the determination result to the call management unit (corresponding to 232 in FIG. 12), and in the corresponding existing voice call information in the call management table (corresponding to 231 in FIG. 12; see FIG. 3). The media processing device 70 is registered in the media usage status. Further, the call analysis conversion unit (corresponding to 202 in FIG. 12) has a format indicating the result of whether or not to add media transmission / reception so that the call control device 10 can interpret the result of whether or not to start media transmission / reception. The data is converted and transferred from the external call transmission / reception unit (corresponding to 201 in FIG. 12) to the call control device 10 (step G3; see FIG. 13). For example, when call control by SIP (Session Initiation Protocol) is performed between the gateway device 30 and the call control device 20, a result such as 200 OK is transferred.

Here, the call analysis / conversion unit (202 in FIG. 12 is mixed with the voice conversion unit (corresponding to 212 in FIG. 12) the guidance voice for selecting the synthesized media processing device, and the internal voice transmission / reception unit (see FIG. 12). It may take time until the DTMF signal is detected by the DTMF analysis unit (corresponding to 252 in FIG. 12) after being reproduced by the communication terminal 50 via In order to cope with such a case, the call analysis conversion unit (corresponding to 202 in FIG. 12) times out the maximum time from when the guidance voice is transmitted to the communication terminal 50 until the detection of the DTMF signal is performed. If the DTMF signal is not detected within that time, it is converted into a format that can be interpreted by the call control device 10 that additional media transmission / reception is not possible, and external call transmission Shin portion (corresponding to 201 in FIG. 12) than to the call control unit 10 transfers.

Next, the call analysis conversion unit (corresponding to 202 in FIG. 12) of the gateway device 30 generates call control information indicating the start of media transmission / reception with respect to the media processing device 70, and corresponds to the internal call transmission / reception unit (corresponding to 203 in FIG. 12). ) To the media processing device 70 (step G4; see FIG. 13). The call control information generated here is call control information indicating the start of media transmission / reception between the communication terminal 50 and the media processing device 70. For example, when SIP (Session Initiation Protocol) is used as the control unit of the media processing device 70, the SIP-URI of the media processing device 70 is included in the REQUEST-URI and TO of the INVITE command, and the SIP of the communication terminal 50 is included in the FROM. -By including the URI, call control information indicating the start of media transmission / reception between the communication terminal 50 and the media processing device 70 is obtained.

Next, the call transmission / reception unit (corresponding to 601 in FIG. 12) of the media processing device 70 receives call control information indicating the start of media transmission / reception between the communication terminal 50 and the media processing device 70 from the gateway device 30. Upon reception, the call generation analysis unit (corresponding to 602 in FIG. 12) analyzes the call control information and starts transmission / reception of media data to the media processing device 60 (step G5; see FIG. 13). When the external network and the internal network are different networks, media data such as a video stream and image data from the media processing device 70 is temporarily received by the internal media transmission / reception unit 223 of the gateway device 30 and is used as necessary. Then, the data is converted by the media conversion unit (corresponding to 222 in FIG. 12), and transmitted from the external media transmitting / receiving unit (corresponding to 221 in FIG. 12) to the other gateway device 20. Media data such as a video stream and image data received by the external media transmission / reception unit (221 in FIG. 12) of the counterpart gateway device 20 is converted by the media conversion unit (222 in FIG. 12) as necessary. It is transmitted to the media processing device 60 from the media transmission / reception unit (223 in FIG. 12) and displayed on the media processing device 60. On the other hand, when the external network and the internal network are the same network, media data such as a video stream and image data does not necessarily have to pass through the gateway devices 20 and 30, but directly from the media processing device 70 to the media processing device 60. Sent. In addition, media data such as a video stream and image data may be transmitted only from the media processing device 60 in the direction of the media processing device 70. In such a case, transmission / reception of media data to the media processing device 60 is started. The step of performing (Step G5) is omitted.

With the above operation, it is possible to easily select a media processing device to be actually used from a plurality of “available” media processing devices without registering information in advance, and associate it with an existing voice call under the gateway device. The transmission and reception of media data such as a video stream and image data by the media processing device under the gateway device can be started.

The operations other than the call start operation of the communication support system according to the second embodiment are the same as those in the first embodiment.

According to the second embodiment, it is not necessary to register the IP address of the own information processing apparatus and the terminal number of the own communication terminal in a one-to-one relationship as in the prior art, and the first embodiment (media start operation) As shown in FIG. 9), it is not necessary to repeat the processing until a media processing device capable of transmitting and receiving media is searched, and a plurality of devices managed under the gateway device when multimedia communication is required. It is possible to select and use an appropriate one from among the media processing apparatuses. The reason is that the menu voice synthesizer 251 that synthesizes a guidance voice for selecting one media processing apparatus from “available” media processing apparatuses, and the acquired voice data are analyzed and the voice data is analyzed. This is because the DTMF analyzer 252 that can read the DTMF signal and determine what number is selected, that is, which media processing device is selected is provided.

In the present invention, media data such as a video stream and image data generated and processed by a media processing device between users who are making a call using a communication terminal such as a fixed telephone or a mobile phone is used between users. The technology that can be associated with existing calls is based on an analog fixed telephone under an ADSL (Asymmetric Digital Subscriber Line) modem that functions as a router, or in the home of NGN (Next Generation Network) Media processing under each gateway device during a call with a SIP (Session Initiation Protocol) phone under the home gateway device, which is the terminal, and further with a mobile phone under a femtocell (ultra-compact mobile base station) Media data such as video streams and image data that are generated and processed using devices It can be applied as a technology associated with a call. For example, during a call using a mobile phone under a femtocell, the phone number information of the mobile phone and the image data stored in the mobile phone are transmitted to the media processing device under the gateway device by infrared communication, Image data can be displayed and shared on the other media processing device. Also, for example, during a call on a SIP telephone under a home gateway device that is a home terminal of an NGN (next generation network), a video stream shot as a home video is input to the video processing device, and the other party's media processing device is input. Video streams can be displayed and shared.

Although the present invention has been described based on the above-described embodiment, it is needless to say that the present invention is not limited to the above-described embodiment and includes various changes, modifications, improvements and the like within the scope of the present invention. Further, various combinations, substitutions or selections of the disclosed elements are possible within the scope of the present invention.

Further problems / objects and development forms of the present invention will be made clear from the entire disclosure of the present invention including the claims.

Claims (15)

1. A plurality of gateway devices are connected directly or indirectly so as to be communicable, and each gateway device is communicably connected to one or a plurality of communication terminals and is communicably connected to one or a plurality of media processing devices. A communication support system,
   The gateway device is
   Analyzing the call control information received from any one of the communication terminal and the media processing device under management, or the gateway device of the other party, and converting the call control information into a predetermined format;
   A call management unit for registering call information including the own telephone number and the other party telephone number in a call management table in the apparatus;
   A media processing device management unit for registering information on the media processing device under management in a media processing device management table in the device;
   With
   The call analysis conversion unit, when a call is started between the communication terminals, analyzes the call control information regarding the call start received from the managed communication terminal or the gateway device of the other party,
   When a call is started between the communication terminals, the call management unit registers the call information included in the analysis result of the call analysis conversion unit in the call management table,
   The call analysis conversion unit, when media transmission / reception is started between the media processing devices in relation to a call between the communication terminals, call control information regarding the start of media transmission / reception received from the managed media processing device. Analyzing and identifying the target call from the call information registered in the call management table, and then converting it to call control information related to media addition for the call, and sending it to the other gateway device,
   The call analysis conversion unit, when media transmission / reception is started between the media processing devices in connection with a call between the communication terminals, analyzes call control information regarding media addition received from the gateway device of the other party, After identifying the target media processing device from the media processing devices registered in the media processing device management table, the target media processing device is converted into call control information related to media transmission / reception for the identified media processing device, and the corresponding managed A communication support system comprising: transmitting to the media processing device.
2. In the call analysis conversion, when a target media processing device is specified from the media processing devices registered in the media processing device management table, a search process is repeatedly performed until a media processing device capable of transmitting and receiving media comes out. The communication support system according to claim 1, wherein the communication support system is performed.
3. The gateway device is
   When specifying a target media processing device from the media processing devices registered in the media processing device management table, one media processing device is selected from the media processing devices specified by the call analysis conversion. A menu voice synthesizer for synthesizing a guidance voice for
   A DTMF analyzer that analyzes the acquired audio data, reads a DTMF signal from the audio data, and determines which media processing device is selected;
   With
   The communication support system according to claim 1, wherein the communication terminal transmits voice data including a DTMF signal related to a number selected based on the guidance voice received from the gateway device to the gateway device.
4. The media processing device generates call control information related to the start of media transmission / reception including information for specifying an existing voice call, and also generates call control information related to the start of media transmission / reception received from the gateway device The communication support system according to any one of claims 1 to 3, further comprising an analysis unit.
5. 5. The communication support system according to claim 1, further comprising a call control device that is communicably connected to the gateway device and performs call control between the gateway devices.
6. A gateway device that is communicably connected to one or more communication terminals and is communicably connected to one or more media processing devices,
   Analyzing the call control information received from any one of the communication terminal and the media processing device under management, or the gateway device of the other party, and converting the call control information into a predetermined format;
   A call management unit for registering call information including the own telephone number and the other party telephone number in a call management table in the apparatus;
   A media processing device management unit for registering information on the media processing device under management in a media processing device management table in the device;
   With
   The call analysis conversion unit, when a call is started between the communication terminals, analyzes the call control information regarding the call start received from the managed communication terminal or the gateway device of the other party,
   When a call is started between the communication terminals, the call management unit registers the call information included in the analysis result of the call analysis conversion unit in the call management table,
   The call analysis conversion unit, when media transmission / reception is started between the media processing devices in relation to a call between the communication terminals, call control information regarding the start of media transmission / reception received from the managed media processing device. Analyzing and identifying the target call from the call information registered in the call management table, and then converting it to call control information related to media addition for the call, and sending it to the other gateway device,
   The call analysis conversion unit, when media transmission / reception is started between the media processing devices in connection with a call between the communication terminals, analyzes call control information regarding media addition received from the gateway device of the other party, After identifying the target media processing device from the media processing devices registered in the media processing device management table, the target media processing device is converted into call control information related to media transmission / reception for the identified media processing device, and the corresponding managed The gateway apparatus characterized by transmitting to the media processing apparatus.
7. In the call analysis conversion, when a target media processing device is specified from the media processing devices registered in the media processing device management table, a search process is repeatedly performed until a media processing device capable of transmitting and receiving media comes out. The gateway device according to claim 6, wherein the gateway device is performed.
8. When specifying a target media processing device from the media processing devices registered in the media processing device management table, one media processing device is selected from the media processing devices specified by the call analysis conversion. A menu voice synthesizer for synthesizing a guidance voice for
   A DTMF analyzer that analyzes the acquired audio data, reads a DTMF signal from the audio data, and determines which media processing device is selected;
   The gateway device according to claim 6, further comprising:
9. A media processing device communicably connected to the gateway device,
   A call generation and analysis unit for generating call control information related to the start of media transmission / reception including information for specifying an existing voice call, and analyzing call control information related to the start of media transmission / reception received from the gateway device; A media processing device.
10. A plurality of gateway devices are connected directly or indirectly so as to be communicable, and each gateway device is communicably connected to one or a plurality of communication terminals and is communicably connected to one or a plurality of media processing devices. A communication support method for supporting communication using a system,
    When a call is started between the communication terminals, the gateway device analyzes call control information related to the call start received from the communication terminal under management or the gateway device of the other party, and is included in the analysis result. Registering call information including the telephone number and the other party telephone number in the call management table;
    When media transmission / reception is started between the media processing devices in connection with a call between the communication terminals, the gateway device analyzes call control information regarding the start of media transmission / reception received from the managed media processing device. And, after identifying the target call from the call information registered in the call management table, converting it to call control information related to media addition for the call, and transmitting to the gateway device of the other party,
    When media transmission / reception is started between the media processing devices in connection with a call between the communication terminals, the gateway device analyzes call control information relating to media addition received from the other gateway device, and the media The target media processing device is identified from the media processing devices registered in the processing device management table, and converted into call control information related to media transmission / reception for the identified media processing device, and the corresponding managed Transmitting to the media processing device;
    A communication support method characterized by including:
11. When the target media processing device is specified from the media processing devices registered in the media processing device management table, the gateway device repeatedly performs search processing until a media processing device capable of media transmission / reception appears. The communication support method according to claim 10, wherein the communication support method is performed.
12. When identifying a target media processing device from the media processing devices registered in the media processing device management table,
    The gateway device synthesizes a guidance voice for selecting one media processing device from the media processing devices specified by the call analysis conversion, and transmits the guidance voice to the corresponding communication terminal. When,
    Transmitting the voice data including the DTMF signal related to the number selected based on the guidance voice received from the gateway device to the gateway device at the communication terminal;
    Analyzing the audio data acquired from the communication terminal in the gateway device, reading a DTMF signal from the audio data, and determining which media processing device is selected;
    Including
    The communication support method according to claim 10, wherein a target media processing device is specified based on the determination result.
13. A program that is connected to one or a plurality of communication terminals and that is executed by a gateway device that is connected to be communicable with one or a plurality of media processing devices,
    When a call is started between the communication terminals, the gateway device analyzes call control information related to the call start received from the communication terminal under management or the gateway device of the other party, and is included in the analysis result. Registering call information including the telephone number and the other party telephone number in the call management table;
    When media transmission / reception is started between the media processing devices in connection with a call between the communication terminals, the gateway device analyzes call control information regarding the start of media transmission / reception received from the managed media processing device. And, after identifying the target call from the call information registered in the call management table, converting to call control information related to media addition for the call, and transmitting to the gateway device of the other party,
    When media transmission / reception is started between the media processing devices in connection with a call between the communication terminals, the gateway device analyzes call control information relating to media addition received from the other gateway device, and the media The target media processing device is identified from the media processing devices registered in the processing device management table, and converted into call control information related to media transmission / reception for the identified media processing device, and the corresponding managed Transmitting to the media processing device;
    A program characterized by having executed.
14. When the target media processing device is specified from the media processing devices registered in the media processing device management table, the gateway device repeatedly performs search processing until a media processing device capable of media transmission / reception appears. The program according to claim 13, wherein the step of performing is executed.
15. When identifying a target media processing device from the media processing devices registered in the media processing device management table,
    The gateway device synthesizes a guidance voice for selecting one media processing device from among the media processing devices specified by the call analysis conversion, and transmits the guidance voice to the corresponding communication terminal. When,
    Analyzing voice data acquired from the communication terminal in the gateway device, reading a DTMF signal from the voice data, and determining which media processing device is selected;
    14. The program according to claim 13, wherein the program is executed.

Images