JP4017567B2 - Communication relay device and information communication device - Google Patents

Description

のような中継リクエストの場合は、"audio"、"video"、それぞれのメディアごとにメディア情報のネゴシエーション和を作成することができ、それらを指定したマルチメディアの接続要求を接続先"av1.com"に対して行うことができる。そして、その接続要求に対する応答から、メディアごとに接続先を選択決定して、それぞれに接続要求することができる。
【０１６３】
図１８は通信中継のためのセッション確立を示すシーケンス図であり、図１９はその各メッセージである。
【０１６４】
通信中継装置４００は、オーディオ装置１８０１とともに、３つのオーディオ装置（１８０２，１８０３，１８０４）を指定して通信中継を依頼するメッセージを受け取る。通信中継装置は３つのオーディオ装置（１８０２，１８０３，１８０４）のネゴシエーション情報を保持しているので、それから作成したネゴシエーション情報和171(図１７参照)をもとに18-1のINVITEメッセージを送信する。メディアが、ネゴシエーション情報和171に基づき、0(PCMU)、3(GSM)、4(G.723)の３つのコーデックを指定している。18-2は18-1のINVITEメッセージに対する応答であり、0(PCMU)での通信セッションを確立すると応答になっている。通信中継装置400は18-2の応答を受けて、オーディオ装置1801とはPCMUで通信できる状態になったので、PCMUをサポートするオーディオ装置1804を選択してPCMUを指定した18-3のINVITEメッセージを送信する。18-4は18-3のINVITEに対してPCMUでの音声データの通信のセッションを確立する応答メッセージである。
【０１６５】
この実施の形態によって、中継装置によってあらかじめ装置を指定するのではなく、確立した通信セッションをもとに、通信可能な装置を候補のなかから選択して通信させることができる。
【０１６６】
第４の実施の形態をベースに、第２、第３の実施の形態のように、情報通信装置候補群の装置に対して、セッションの予約を行なったり、仮セッションを確立して後で修正するといったことも可能である。
【０１６７】
以上、本発明における４つの基本的な実施の形態を説明した。主に、オーディオデータの配信を例に説明したが、複数の装置を組み合わせる例として、ＴＶ電話サービスの例を示す。基本的な第１実施の形態での接続例であるが、第２から第４の実施の形態においても同様に適用することができる。
【０１６８】
図２０は、テレビ電話サービスにおけるセッション確立のためのシーケンス図であり、図２１はその際のメッセージ例を示すものである。
【０１６９】
ＩＰ電話機１３１よりＴＶ電話１２０への発呼リクエスト(20-1)を通信中継装置１００が受けると、通信中継装置100内ではＩＰ電話１３１と組み合わせてＴＶ電話利用可能な装置ＴＶ１３２とｗｅｂカメラ133が選別され、ＴＶ１２０とＩＰ電話１３１、ＴＶ１３２、ｗｅｂカメラ133とにセッションを張って、通信中継するリクエストＴＶ電話通信中継リクエスト2001が生成される。
【０１７０】
なお、音声データのセッション確立要求はＩＰ電話１３１からのＴＶ電話発呼のリクエスト(20-1)内に含まれている。通信中継装置は、ＩＰ電話１３１、ＴＶ１３２、ｗｅｂカメラ133のネゴシエーション情報に基づいて、ＴＶ電話１２０にGSM、またがG.723の音声とmotion-jpeg(図中はmjpegと略記)、またはmpeg2の動画のメディア送受信を行なうＴＶ電話セッションの確立を要求する(20-2)。ＴＶ電話１２０からはG.723の音声とmotion-jpegの映像でのＴＶ電話セッションの確立を受け入れる応答が返される(20-3)。通信中継装置は、(20-3)のセッション確立結果に基づいて、ＴＶ１３２にはmotion-jpegを指定した映像送信セッションを、ｗｅｂカメラ133にはmotion-jpegを指定した映像受信セッションのセッション確立要求を行う(20-4a, 20-4b)。それぞれからセッション確立ＯＫの応答があり(20-5a, 20-5b)、もともとの接続要求元であったＩＰ電話１３１に対してG.723の音声セッション確立の応答とあわせたＴＶ電話セッション確立の応答(20-6)を返す。
【０１７１】
以上説明した実施の形態１〜４は、オーディオ配信やＴＶ電話でのコーデックをあわせたセッション確立を例に説明したが、本発明はコーデックに限定されるものではなく、あらかじめ通信するデータの種類をネゴシエーションするパラメータ全般に適応可能である。たとえば、あらかじめ、通信する画像データの表示サイズについてネゴシエーションしたうえで通信するような場合には表示サイズをネゴシエーション情報に用いて、装置が表示不能な画像データを通信することを防ぐこともできる。
【０１７２】
図２２、図２３および図２４に、本発明を実施する通信中継装置を適用した装置の例を示す。図では、ＴＶ電話サービスを例に説明しているが、このサービスに限定されるものではない。
【０１７３】
図２２は、ホームネットワーク上の複数の機器の機能を組み合わせてインターネット上のサービスを利用できるようにするホームゲートウェイ装置２２０２において本発明を適用した実施の形態である。この例では、ホームネットワーク上のＩＰ電話機２２０５、ＴＶ２２０３、ｗｅｂカメラ２２０４の機能をホームゲートウェイ装置２２０２上で組み合わせてインターネット上のＴＶ電話サービスを利用している。ＩＰ電話機２２０５からＴＶ電話端末２２０１に対して発呼する際にホームゲートウェイ装置２２０２で本発明を利用することができる。
【０１７４】
図２３は、自身が持たない映像入出力機能についてのデータを他の機器に中継することでＴＶ電話サービスを利用できるようにするＩＰ電話機２３０２である。
【０１７５】
ＩＰ電話機２３０２はＴＶ電話端末2301に対してＴＶ電話の発呼を行なう場合、インターネットを介してＴＶ電話端末2301にＴＶ電話のセッションを張るとともに、自身で入出力する機能を持たない映像データを入出力するためにＴＶ２３０３とｗｅｂカメラ２３０４とにセッションを張って、映像データはＴＶ２３０３とｗｅｂカメラ２３０４とに中継してＴＶ電話サービスを利用できるようにする。このときのＩＰ電話機２３０２に本発明の技術を利用することができる。
【０１７６】
図２４は、インターネット上のＴＶ電話サービスプロキシのサービスにおいて、実施する例である。
【０１７７】
ＴＶ電話サービスプロキシ２４０２は、複数の機器の組み合わせを指定することで複数の装置を組み合わせてＴＶ電話サービスを利用できるようにするサービスを提供するものである。この例では、宅内にあるＩＰ電話機２４０６からインターネットに接続するホームルータ2403を介してＴＶ電話サービスプロキシにＴＶ電話端末２４０１への発呼のリクエストを行なう。その際に、ＩＰ電話機２４０６自身が持たない機能について、ＴＶ電話の映像入出力用の機器としてＴＶ２４０４とｗｅｂカメラ２４０５を指定して発呼のリクエストを行なうと、ＴＶ電話サービスプロキシ２４０２は映像入出力用のセッションは指定の装置（ＴＶ２４０４とｗｅｂカメラ２４０５）に対して張り、ＴＶ電話端末との映像データの通信はそちらと中継することで、ＴＶ電話サービスを利用できるようにする。このＴＶ電話サービスプロキシ２４０２においても本発明を利用することができる。
【０１７８】
今回開示された実施の形態はすべての点で例示であって制限的なものではないと考えられるべきである。本発明の範囲は上記した説明ではなくて特許請求の範囲によって示され、特許請求の範囲と均等の意味および範囲内でのすべての変更が含まれることが意図される。
【０１７９】
【発明の効果】
以上説明したとおり、本発明によれば、機器間のメディア送受信を中継する際に、コーデックなどのメディアに関する情報が未知の機器と既知の機器の間で、特別にセッション間でメディアの整合をとる規定を加えなくても、メディアの不整合を起こさないようにセッションを張って、メディアの中継を実施することができる。
【０１８０】
あるいは、発呼側の機器とのセッション確立に、中継装置から発呼先の機器とのセッションの結果を利用する場合、発呼側がセッション確立不能であるにもかかわらず、発呼先のセッションを確立することを防ぐことができる。
【０１８１】
あるいは、発呼側で使用する複数の機器のなかからメディアの中継によって、発呼先の機器が望む能力を持った機器を自動的に選択することで、機器利用者に最適のパフォーマンスを提供することができる。
【図面の簡単な説明】
【図１】 第１の実施の形態を表す通信中継装置１００の機能ブロック図である。
【図２】 第１の実施の形態における中継開始要求受付から中継開始までのフローチャート図である。
【図３】 第１の実施の形態における中継に必要なセッション確立のシーケンス図である。
【図４】 図３のシーケンス図におけるセッション確立のためのシグナリングメッセージである。
【図５】 図３において確立した２つのセッションのセッション情報である。
【図６】 本実施の形態において中継装置に保持する各情報通信装置のネゴシエーション情報の例である。
【図７】 第２の実施の形態である通信中継装置２００の機能ブロック図である。
【図８】 第２の実施の形態における中継開始要求受付から中継開始までのフローチャート図である。
【図９】 第２の実施の形態における中継に必要なセッション確立のシーケンス図である。
【図１０】 図９のシーケンス図におけるセッション確立のためのシグナリングメッセージである。
【図１１】 第３の実施の形態の通信中継装置３００の機能ブロック図である。
【図１２】 第３の実施の形態における中継開始要求受付から中継開始までのフローチャート図である。
【図１３】 第３の実施の形態における中継に必要なセッション確立のシーケンス図である。
【図１４】 図１３のシーケンス図におけるセッション確立のためのシグナリングメッセージである。
【図１５】 第４の実施の形態における通信中継装置４００の機能ブロック図である。
【図１６】 第４の実施の形態における中継開始要求受付から中継開始までのフローチャート図である。
【図１７】 中継する候補機器から作成する「ネゴシエーション情報和」を説明するための図である。
【図１８】 第４の実施の形態における中継に必要なセッション確立のシーケンス図である。
【図１９】 図１８のシーケンス図におけるセッション確立のためのシグナリングメッセージである。
【図２０】 本発明の通信中継装置を用いて、複数の装置を組み合わせてＴＶ電話する例を説明するためのシーケンス図である。
【図２１】 図２０のシーケンス図における中継のためのセッション確立のシグナリングメッセージである。
【図２２】 本発明をホームゲートウェイ装置に組み込んでＴＶ電話を利用する例を示す図である。
【図２３】 本発明をＩＰ電話機に実装して、ＴＶ電話を実施する例を示す図である。
【図２４】 本発明をＴＶ電話サービスのサーバで実施して、ＴＶ電話を行なう例を示す図である。
【図２５】 本発明実施の形態のハードウェア構成の１例である。
【図２６】 セッション予約機能を持つ情報通信装置の機能構成を示す図である。
【図２７】 図２６の構成を持つ装置において、セッション予約、確立などのシグナリングメッセージの処理について説明するフローチャート図である。
【符号の説明】
１００，２００，３００，４００ 通信中継装置、１０１ 第１中継セッション確立部、１０２ ネゴシエーション情報蓄積部、１０３ セッション中継部、１０４ 外部通信部、１０５ 内部通信部、１０６ 入出力部、１０７ ネゴシエーション情報収集部、１１１ 中継開始要求受付部、１１２ 第１セッション確立部、１１３ 第２セッション確立部、１２０ ＴＶ電話機、１３０ ＩＰ電話機、１３１ ＴＶ、１３２ ｗｅｂカメラ、７０１ 第２中継セッション確立部、７１１ 中継開始要求受付部、７１２ 第１セッション確立部、７１３ 予約セッション確立部、７１４ セッション予約部、１５０１ 第４中継セッション確立部、１５１１ 中継開始要求受付部、１５１２ 第１セッション確立部、１５１３ 情報通信装置決定部、１５１４ 第２セッション確立部、１５１５ ネゴシエーション情報和作成部、１５３０ 情報通信装置候補群。[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a communication relay device that performs relay processing for communication between two devices connected via a network via a communication relay device.
[0002]
[Prior art]
As a technique for establishing a media communication session on the Internet, there is SIP (Session Initiation Protocol) as an application layer signaling control protocol used for establishing, maintaining, and terminating a session. In SIP, a SIP invitation is performed on what is requested by a person who requests establishment of a session, and information regarding media exchanged in the session is exchanged at that time. A request for establishing a session sends a description of the media that the user wants to use in the session, and the session request destination that receives it sends back a description of the media that he or she wants to use. In this way, media data is transmitted and received in a session established by mutual agreement. By using SIP, it is possible to determine a medium to be communicated on a one-to-one basis and establish a session.
[0003]
Even when a relay device is used, a connection source device, a relay device, and a relay are configured by performing negotiation for specifying a session establishment request by SIP by specifying information on media that can be used from the session request source device to the session connection destination device. Communication is possible using the same media in the session between the device and the connected device.
[0004]
As a technique for determining the contents of media to communicate by knowing the capability of the counterpart device, there is a technology of an Internet facsimile communication method (see, for example, Patent Document 1) that enables optimal image data transmission according to the capability of the apparatus. is there. This is because in Internet fax, which sends image data using e-mail, it is determined whether it is connected directly to the device on the receiving side, and if it is connected directly, it exchanges e-mails to know each other's capabilities. To send the image data based on the capability information.
[0005]
As a technique for achieving matching in both communications across a relay device, there is a system related to a fax using the Internet (see, for example, Patent Document 2). This compares the maximum transmission speed between the transmission side facsimile and the transmission speed determined by the reception side facsimile, and when the transmission side maximum transmission speed is faster, the transmission side speed is set to the reception side speed. Is set to
[0006]
[Patent Document 1]
JP 2002-300343 A
[0007]
[Patent Document 2]
JP 2001-35884 A
[0008]
[Problems to be solved by the invention]
Based on a signaling control protocol for establishing a session such as SIP, it is possible to negotiate media to communicate between devices, establish a session, and send and receive media. In a communication relay device that establishes a session with a device and relays media communication, if a session establishment request is made independently from the communication relay device, media mismatch may occur between the two sessions There is.
[0009]
For example, if one device 1 supports two codecs A and B, and the other device 2 supports two codecs A and C, a communication session is sent from the relay device to each. In order to make a request, it is necessary to specify a codec that matches both codecs. In the case of a relay device such as a home gateway, one is connected to a home LAN, and it is easy to collect information on the devices present there, but on the other hand, any device information on the Internet is preliminarily stored. It is difficult to collect. In such a situation, a device that does not have a function of providing media information to be supported for negotiation by negotiating a session with a device with unknown media information using one known media information. Even if there is no new regulation regarding media negotiation, media information inconsistency can be prevented, and media transmission / reception can be relayed between sessions without codec mismatch.
[0010]
However, when solving the problem due to media inconsistency such as a codec in this way, when establishing a session later, it is possible that the session cannot be established because the device cannot be used. As mentioned earlier, assuming that the first device to establish a session is a device on the Internet, it is not desirable to have a media communication session on the outside but not on the inside. There is. For example, in the case of a telephone service in which a call is made from a home device to a device outside the home, there may be a problem that although the call is received by the other party, the session with the caller device is not connected and the conversation cannot be made.
[0011]
The present invention has been made to solve the above-described problems, and its purpose is to establish a session with both devices between two devices while solving media inconsistencies such as codecs. Thus, a communication relay apparatus capable of relaying media communication is provided.
[0012]
[Means for Solving the Problems]
In other words, in the present invention, before making a request for establishing a session with a device with unknown media information using one known media information, a session is temporarily established with a device with known media information. Or request a session establishment after having reserved a session, and use the result to validate the reserved session or change the media used in the temporary session By doing so, the above problem can be solved.
[0013]
Alternatively, it is possible to acquire unregistered negotiation information by acquiring negotiation information at the time of session reservation, or to establish a session using the latest negotiation information.
[0014]
In addition, when the relay device accepts relaying of media transmission / reception between two devices in advance as described above, there are other devices that are more preferable for connecting to one device with unknown media information. It is desirable to be able to select again later. In general, even if a plurality of devices with known media information are designated as candidates for the relay device, it is not possible to select an optimal device at that time for communicating with a device with unknown media information. In the present invention, when a relay apparatus makes a session establishment request to a device whose media information is unknown, it makes a session establishment request to the device whose media information is unknown with a combination of the media information of all the devices whose media information is known. The above problem can be solved by selecting a device to be a relay partner using the result, and requesting session establishment using media information determined to be used for the selected device.
[0015]
Therefore, according to one aspect of the present invention, a communication relay device that establishes a session in each of the first information communication device and the second information communication device and relays communication, the first information communication device For establishing a relayable session with both the designated first information communication device and the designated second information communication device, the accepting means for accepting the communication relay start request designating the second information communication device and the designated second information communication device Session establishing means.
[0016]
According to another aspect of the present invention, a communication relay device that establishes a session with each of the first information communication device and the second information communication device and relays communication, When the negotiation information storage means for storing the negotiation information used for establishing the session and the communication relay start request designating the first information communication apparatus and the second information communication apparatus are received, the first information stored in the negotiation information storage means A session establishment request is made to the second information communication apparatus using the negotiation information related to the information communication apparatus, and a session establishment request is sent to the first information communication apparatus to communicate using the result of the session establishment request from the second information communication apparatus. Relay session establishment means for performing
[0017]
Preferably, the negotiation information stored by the negotiation information storage unit includes information on a codec supported by the information communication device, and the relay session establishment unit selects a codec used in a session established with the second information communication device. Specify and make a session establishment request to the first information communication apparatus.
[0018]
Preferably, the communication relay start request designates a plurality of information communication devices as the first information communication device, and the relay session establishment means sends each of the information communication devices designated by the communication relay start request from the second information communication device. A session establishment request is made using the result of the session establishment request.
[0019]
According to still another aspect of the present invention, a communication relay device that establishes a session with each of a first information communication device and a second information communication device to relay communication, the first information communication device When the negotiation information storage means for storing the negotiation information used for establishing the session and the communication relay start request specifying the first information communication apparatus and the second information communication apparatus are received, the first specified by the communication relay start request is received. After making a reservation for session establishment for the information communication apparatus, the second information communication apparatus is requested to establish a session using the negotiation information related to the first information communication apparatus stored in the negotiation information storage means, and the second information communication apparatus Using the result for the session establishment request from the information communication apparatus, the first information communication apparatus establishes the reserved session. And a joint session establishing means.
[0020]
Preferably, the negotiation information stored by the negotiation information storage unit includes information on a codec supported by the information communication device, and the relay session establishing unit selects a codec used in a session established with the second information communication device. A specified session is established for the first information communication apparatus.
[0021]
Preferably, the communication relay start request designates a plurality of information communication devices as the first information communication device, and the relay session establishment means reserves a session for each of the designated information communication devices, and from the second information communication device Each reserved session is established using the result of the session establishment request.
[0022]
Preferably, the relay session establishing unit obtains negotiation information at the time of reservation for session establishment with the first information communication device, and stores the negotiation information in the negotiation information storing unit.
[0023]
According to still another aspect of the present invention, an information communication apparatus that establishes a session with another apparatus and performs communication, session reservation means for receiving a communication session reservation request, and session establishment for receiving a communication session establishment request Means for rejecting the establishment of a session or a request for a reservation which makes it impossible to establish the accepted reservation session.
[0024]
According to still another aspect of the present invention, a communication relay device that establishes a session with each of the first information communication device and the second information communication device and relays communication, When the negotiation information storage means for storing the negotiation information used for establishing the session and the communication relay start request designating the first information communication apparatus and the second information communication apparatus are received, the first information stored in the negotiation information storage means Using the negotiation information related to the information communication device, a request for establishing a session is made to the first information communication device and the second information communication device specified by the communication relay start request, and the session establishment request from the second information communication device is Relay session establishing means for changing a session established with the first information communication device using the result.
[0025]
Preferably, the negotiation information stored by the negotiation information storage unit includes information on a codec supported by the information communication device, and the relay session establishment unit has a codec used in a session established with the second information communication device. If it is different from the codec used in the session established with the first information communication apparatus, the codec is changed to the codec used in the session established with the second information communication apparatus.
[0026]
Preferably, the communication relay start request designates a plurality of information communication devices as the first information communication device, the relay session establishing means makes a session establishment request to each of the information communication devices designated by the communication relay start request, and the second Each session is changed using the result of the session establishment request from the information communication apparatus.
[0027]
Preferably, a communication relay device that establishes a session in each of the first information communication device and the second information communication device and relays communication, and negotiation information used for establishing a session in the first information communication device When receiving a communication relay start request designating a negotiation information storage means for storing a plurality of candidate devices for communication as the second information communication device and the first information communication device, the negotiation information of each candidate device is received. In addition, a request for establishing a session is sent to the second information communication device, and the first information communication device is selected from among the candidate devices of the first information communication device using the result of the session establishment request from the second information communication device. And a relay session establishing means for establishing a session for relaying communication to the selected device.
[0028]
Preferably, the negotiation information stored by the negotiation information storage unit includes information on a codec supported by the information communication device,
The relay session establishment means makes a session establishment request to the second information communication apparatus using information on all codecs supported by the candidate apparatus, and selects the first information communication apparatus that can use the codec used in the established session. Select and make a session establishment request designating the codec.
[0029]
Preferably, the communication relay start request can designate a set of a plurality of devices as candidate devices of the first information communication device, and the relay session establishment means receives the session establishment request from the second information communication device. When the first information communication device selected from the candidate devices using the result of the above is a set of a plurality of devices, a session is established for each device.
[0030]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below with reference to the drawings.
[0031]
However, in order to explain a specific configuration of the present invention, an outline of “session” will be described first as a premise. A “session” is a logical data communication connection established by negotiation to perform a series of data transmission / reception between programs on apparatuses connected via a network. A session is established by negotiating data and protocols to be transmitted and received between both programs communicating at the start of data communication, determining how to exchange data. While a session is established, data can be transmitted / received between programs according to the negotiation result. When the session is terminated by a request from one side, data can no longer be transmitted / received between programs.
[0032]
For example, in many cases, one internet telephone call is one session. During a call between Internet telephone programs, one VoIP session is established, and then both voice data are exchanged.
[0033]
In the following, “first information communication device” and “second information communication device” are shown by way of example using audio distribution and TV telephone service. In an example of audio distribution, an operation is performed from a home gateway which is a “communication relay device”, and data transmitted by an audio distribution server as a “first information communication device” is received by a “second information communication device” stereo. In the example of a TV phone, the “first information communication device” is connected to the Internet as the “second information communication device” with an IP phone, TV, and web camera connected to the home network. The audio relay device relays audio and video data to and from a TV phone so that the TV phone service can be used.
[0034]
(Embodiment 1)
FIG. 1 is a functional block diagram of a communication relay device 100 representing the first embodiment. FIG. 1 shows a connection with a device that relays communication in the case of a TV phone as an example.
[0035]
The communication relay device 100 includes a first relay session establishment unit 101, a negotiation information storage unit 102, and a session relay unit 103.
[0036]
The first relay session establishing unit 101 includes a relay start request accepting unit 111, a first session establishing unit 112, and a second session establishing unit 113.
[0037]
Each function will be described in detail.
The first relay session establishing unit 101 makes a request to relay communication between two information communication devices specified by a user input using a user interface or a message from a device on another network via the network. Accepts and has a function to establish a communication session with both devices. In this case, the video phone call request from the IP phone 130 is interpreted, a voice transmission / reception session to the IP phone 130, a video output session to the TV 131, a video input session to the web camera 132, and the TV phone. 120 is accepted as a communication relay request for establishing a TV phone session to 120.
[0038]
The negotiation information accumulating unit 102 is a part for accumulating information (called negotiation information) for communicating with a device on the network using a user input or an information collecting function on the network. The negotiation information includes information on a communication protocol that can be used and codec supported by the device in order to perform communication of media data such as audio media. In this case, negotiation information about the IP telephone 130 and the TV web camera 132 is held. In the present embodiment, the information collected by the negotiation information collection unit 107 is accumulated in the negotiation information accumulation unit 102.
[0039]
When the first relay session establishing unit 101 establishes a communication session with each of both devices, the session relay unit 103 receives session information regarding each session and relays communication data between the sessions. In the case of the example of the communication relay device 100 shown in FIG. 1, the communication between sessions established between the TV phone 120, the IP phone 130, the TV 131, and the web camera 132 is relayed.
[0040]
The external communication unit 104 includes a communication interface to the Internet.
On the other hand, the internal communication unit 105 is a network interface to a LAN (Local Area Network) such as a home network. In this embodiment, two different networks are connected. However, the present invention is not necessarily limited to this, and communication with a plurality of devices on the same network may be relayed.
The input / output unit 106 is a means for supporting input / output for the user of the relay device to perform device setting and the like, and includes a liquid crystal panel that displays information and receives user input. An interactive interface is provided by a GUI (Graphical User Interface) program included in the negotiation information collection unit 107 and the relay start reception unit 111.
[0041]
The negotiation information collection unit 107 uses the internal communication unit 105 to collect information on devices (such as the IP phone 130 and the TV web camera 132) on the home network using, for example, a UPnP (Universal Plug and Play) function. . Further, the negotiation information collection unit 107 incorporates a GUI program, and collects information on devices that the setter manually registers using the input / output unit 106. The collected information is stored in the negotiation information storage unit 102.
[0042]
The relay start request receiving unit 111 is a part that receives a relay start request, extracts information on both devices to be relayed from the start request, and transmits the information to the first session establishing unit. In this example, when a connection request from the IP phone 130 to the TV phone 120 is received, the request is interpreted and connected to each device including the TV 131 and the web camera 132 necessary for the IP phone 130 to use the telephone service. Acceptance processing is performed as a relay start request with the previous TV telephone 120. It is also possible to accept a request from the input / output unit 106 using a GUI.
[0043]
The first session establishment unit 112 obtains information about the device that has received a communication relay request from the relay start request reception unit 111 from the negotiation information storage unit 102, and uses it to perform a session with a device whose negotiation information is unknown. Establish. In this case, since the IP telephone 130, TV 131, and web camera 132 are stored, they can be acquired. Then, a codec that can be used is designated from the obtained negotiation, and a request for establishing a session is made to the TV phone 120 which is the other device whose negotiation information is unknown. If the session can be established, the second session establishment unit 113 is notified of the information, and requests establishment of a session with the remaining devices.
[0044]
The second session establishing unit 113 receives a request from the first session establishing unit 112, and uses the negotiation information received at that time and the first session information previously established to establish a communication session for the remaining devices. I do. In this case, the audio and video codec determined in the session established with the TV phone 120 is specified, and a connection request is made to the IP phone 130, TV 131, and web camera 132. If all necessary sessions are established, the information is transmitted to the session relay unit 103 to instruct the start of communication relay.
[0045]
FIG. 25 shows a hardware configuration diagram of the communication relay device 100. The functional configuration shown in FIG. 1 is realized as follows in the hardware configuration apparatus shown in FIG.
[0046]
In the present embodiment, the first relay session establishing unit 101 is software that cooperates with software modules including communication interfaces (external communication interface 2501, internal communication interface 2502) such as the external communication unit 104 and the internal communication unit 105. It is mounted, accumulated in the ROM 2507 included in the communication relay device 100, read out to the RAM 2504 at the time of execution, and a software program is executed by the CPU 2503 included in the communication relay device 100 to realize the function.
[0047]
Similarly, the negotiation information collection unit 107 and the session relay unit 103 are also implemented as software, held in the ROM 2507, called to the RAM 2504 at the time of execution, and executed using the CPU to realize the respective functions. The negotiation information storage unit 102 is a part of the flash memory 2505 for holding the negotiation information. The flash memory 2505 is also used together with the RAM 2504 to hold temporary data being executed by each software.
[0048]
The input / output unit 106 includes a liquid crystal panel 2506 and software for controlling the liquid crystal panel 2506. The software is held in the ROM 2507, read out to the RAM 2504 when necessary, and executed by the CPU 2503. In addition, a GUI is mounted on the remote control terminal, and an RF module 2508 is provided for remotely operating a relay start request and manual registration of a negotiation module.
[0049]
The configurations described later (FIGS. 7, 11, and 15) are the same hardware configuration as the communication relay device 100 of FIG. 1.
[0050]
FIG. 2 is a flowchart for explaining the flow of processing from reception of a relay start request until relay start.
[0051]
First, the relay start request receiving unit 111 receives a relay start request specifying a device (step S201).
[0052]
The relay start request receiving unit 111 generates a communication relay request for relaying communication by setting up a session based on the received request, and sends it to the first session establishing unit 112 (step S202).
[0053]
The first session establishing unit 112 acquires the negotiation information of the device included in the received relay request from the negotiation information storage unit 102 (step S203).
[0054]
It is confirmed whether the negotiation information has been acquired (step S204). If the negotiation information has not been acquired, it is determined that relaying is impossible and the result is returned to the relay start request reception unit 111 (step S205).
[0055]
When the negotiation information can be acquired, the codec of the acquired negotiation information is specified, and a first session establishment request (first connection request) is transmitted to the other device (step S206). Although the present embodiment focuses on the codec, the present invention is not limited to this.
[0056]
A response to the first connection request is received (step S207), and it is determined from the received response whether the first session has been established (step S208).
[0057]
If the first session cannot be established, the communication cannot be relayed, so that the relay is not possible and the result is returned to the relay start request receiving unit 111 (step S209).
[0058]
When the first session can be established, the second session establishment unit 113 is requested to establish a session with the remaining apparatus together with information on the established session such as codec and protocol (step S210).
[0059]
The second session establishment unit 113 requests the remaining devices to establish a session according to the request. However, at this time, referring to the information determined in the established first session, the second session establishment request is made to the unconnected device by designating the condition for establishing a session capable of relaying communication (step) S211). For example, the TV 131 and the web camera 132 are requested to establish a session by designating the video codec used in the session established with the TV phone 120. Note that when the IP telephone 130 makes a session establishment request by designating a voice codec that can be used for the first time when a relay start request is made, a connection request from the relay apparatus is not made.
[0060]
A response to the second session establishment request is received (step S212), and it is confirmed whether all the sessions have been established (step S213).
[0061]
If the second session establishment fails, the first session establishment unit 112 releases the first session established previously (step S214), and a relay failure result is returned to the relay start request reception unit 111 (step S215). .
[0062]
When all the sessions that have made session establishment requests have been established, a response is returned according to the result of the first session to the device that has received the session establishment request, such as the IP telephone 130 described above, and the session is relayed to the session relay unit 103. An instruction to start relaying is issued (step S216).
[0063]
The session relay unit 103 starts relaying communication by sending data received in each session to the relay destination session according to the instruction (step S217).
[0064]
FIG. 3 is a sequence diagram when a session is established in an example in which communication is relayed between two audio devices (audio device 301 and audio device 302). In this case, the audio device 301 (stereo device) corresponds to the first information communication device, and the audio device 302 (audio distribution server) corresponds to the second information communication device.
[0065]
In FIG. 3, the negotiation information storage unit 102 of the communication relay device 100 holds negotiation information that allows the audio device 301 to accept two audio media, GSM and G.723.
[0066]
A request (which is a communication relay start request) for instructing the communication relay device 100 to relay a communication by establishing a session with the audio device 301 and the audio device 302 is also shown. Specifically, when a music server and stereo are designated and viewed from a remote control device that can communicate with the availability means of the communication relay device, the audio device 302 that is a music distribution server and the stereo audio that outputs music content are output. The communication relay device accepts and processes the communication relay request designating the device 301. The communication relay request has a format of relay (media, node1, node2, direction) as in the example shown in FIG. "media" is a keyword indicating the type of media to be communicated, such as audio (audio), video (video), etc. "node1" and "node2" are IDs indicating the respective devices and addresses used when creating a session, "direction In "," specify the direction of media relay (from "node1" to "node2" for "1", "node2" to "node1" for "2", bidirectional for "3").
[0067]
Hereinafter, messages exchanged before the start of relay will be described with reference to FIG.
When there is a trigger for relaying voice communication between the audio device 301 and the audio device 302 to the communication relay device, the communication relay device 100 uses the negotiation information of the audio device 301 held by the negotiation information storage unit 102. Then, using the SIP (Session Initiate Protocol) INVITE message, a request is made to establish an audio media communication session in GSM or G.723 (3-1).
[0068]
The audio device 302 is a device that supports PCMU and G.723.
[0069]
Upon receiving the INVITE message (3-1), the audio device 302 selects G.723 supported by itself, and returns a SIP response for session establishment OK (3-2).
[0070]
The communication relay apparatus 100 can establish a communication session with the audio apparatus 302 by receiving the OK message (3-2), and therefore uses the G.723 codec determined there to request the audio apparatus 301 to establish a session. An INVITE message is sent (3-3). A session with the audio device 302 is always established from the codecs supported by the audio device 301.
[0071]
Since the audio apparatus 301 is a codec supported by the audio apparatus 301 in response to the session establishment request message received in (3-3), it returns a session establishment OK response without any problem in terms of codec (3-4).
[0072]
FIG. 4 illustrates the SIP message transmitted in the sequence diagram of FIG. Each message is numbered corresponding to FIG.
[0073]
Message (3-1) is an INVITE message for requesting connection for session establishment. From the SIP URL “relay@hgw100.com” for the relay of the communication relay device 100 to the SIP URL “usr2@audio302.com” of the audio device 302, the session request identifier is “12345678” and the audio media communication session The communication relay device 100 receives audio data at port 3456, conforms to the RTP / AVP protocol and profile, and uses either GSM or G.723 as audio data coding information. It is required to use.
[0074]
The message (3-2) is a response message to the INVITE message (3-1). "200 OK" is a message indicating that the request for session establishment has been accepted. Response that "usr2@audio302.com" has accepted the request for "12345678" for "relay@hgw100.home" of the connection request source Means a message. As for the media, an audio session is established with the G.723 codec in accordance with RTP / AVP, and the audio apparatus 302 returns that it receives communication at the 5004th port.
[0075]
The message (3-3) is a message requesting connection of the SIP URL to the SIP URL usr1@audio301.myhome of the audio apparatus 301. The communication relay apparatus 100 has relay@hgw100.myhome as a relay SIP URL in the network connected to usr1@audio301.myhome, and relay@hgw100.myhome sends an INVITE message as an identifier 12345679 to usr1@audio301.myhome. Is throwing. As communication media, audio uses RTP / AVP, and only the G.723 codec determined to be used in a session with the audio apparatus 302 is specified. The communication relay device 100 declares that port 3457 is used.
[0076]
Message (3-4) is a message that responds to accepting a request for a connection request with identifier 3-345679 of 3-3, and G.723 audio is communicated via RTP / AVP on port 4001 on audio device 301 side. It will respond when you receive it.
[0077]
FIG. 5 shows session information for managing a session established between each audio apparatus and relay apparatus described in FIGS. 3 and 4 by the relay apparatus 100.
[0078]
The first session information 501 is information related to the session (identifier 12345678) established with the audio device 302. When the G.723 audio data is received from the audio device 302 via the port 3456 and transmitted, the audio device 302 ( This indicates that a session to be sent to port 5004 of audio302.com has been established.
[0079]
The second session information 502 is information related to the session (identifier 12345679) established with the audio device 301. When the G.723 audio data is received from the audio device 301 via the port 3457 and transmitted, the audio device 301 ( audio301.myhome) indicates that a session to send to port 4001 has been established.
[0080]
When the session relay unit 103 receives such a pair of session information, the data received at the port 3456 is sent to the port 4001 of the audio device 301 (audio301.myhome), and the data received at the port 3457 is sent to the audio device 302 (audio302.com). Both sessions are relayed by sending to 5004 port.
[0081]
FIG. 6 shows negotiation information for the audio device 301. Negotiation information describes information necessary for negotiation when establishing a communication session for each device. Information is collected from devices on a network by communication, or a user manually communicates with the communication relay device 100. Based on the input and registered information, the negotiation information storage unit on the communication relay device 100 holds the information. This is data describing media that can communicate with the IP address of the apparatus, and is implemented in the format shown in the example of FIG. The information about the medium is composed of data format information such as one of input / output, connection protocol and address used for connection, use protocol profile, and codec.
[0082]
In FIG. 6, the audio device 301 has an IP address 192.168.1.1, and can perform two types of audio reception (in) and transmission (out) as media, both of which use SIP for session control. RTP / AVP can be used for data transfer. It expresses that the data codec supports two types of GSM and G.723. In this embodiment, it is composed of the IP address of the device and the information of the media that communicates with the device. The media information includes the type of data (audio, video, etc.), communication direction (input (in), output (out)), and connection protocol (SIP ("SIP URL")) including the connection address. , Media communication protocol profile (RTP / AVP) and data codec ({GSM, G.723}) information.
[0083]
As described above, the present invention negotiates media necessary for relaying. Further, in the present invention, the relayer negotiates so as to be able to communicate with a device having information in advance and a device having no information using the device.
[0084]
With the above configuration, when media transmission / reception between devices is relayed, there is no need to add special provisions for media matching between sessions between devices with unknown media information such as codecs. However, the media can be relayed by setting up a session so as not to cause inconsistency of the media.
[0085]
(Embodiment 2)
FIG. 7 is a functional block diagram of the communication relay device 200 according to the second embodiment.
[0086]
Here, the TV telephone 120 of FIG. 1 is more generally described as the second information communication apparatus 120, and the IP telephone 130 is also more generally described as the first information communication apparatus 130. The connection destination devices such as the first information communication device 130 and the second information communication device 120 are illustrated in a simplified manner, but include cases where there are a plurality of devices as in the example of the TV phone shown in FIG.
[0087]
Hereinafter, since the negotiation information storage unit 102 and the session relay unit 103 are the same as those in the first embodiment of FIG. 1, the description thereof will be omitted, and the second relay session establishment unit 701 will be described.
[0088]
The second relay session establishment unit 701 includes a first session establishment unit 712, a reservation session establishment unit 713, and a session reservation unit 714 in addition to the relay start request reception unit 711, and includes two devices (the information communication device 120 and the information communication device 120). When the information communication device 130) accepts an instruction to start communication relay, it designates two devices and requests the first session establishment unit 712 to establish a communication session and start communication relay.
[0089]
The relay start request unit 711 is similar to the relay start request reception unit 111 in FIG. 1, and requests according to a request by communication via the internal communication unit 105 or a user input from the GUI using the input / output unit 106. Accept.
[0090]
When receiving a request to start communication relay, the first session establishing unit 712 acquires negotiation information regarding a device to communicate from the negotiation information storage unit 102. The device (first information communication device 130) that has obtained the negotiation information is specified, and the session reservation unit 714 is requested to make a session reservation. In the case of a plurality of devices, a reservation is made for all of the plurality of devices. When the session reservation unit 714 has reserved a session, it receives session reservation information, and requests the other device (information communication device 120) to establish a communication session using the negotiation information of the information communication device 130. . If the session with the information communication device 120 is established, the reservation session establishing unit 713 is notified of the session reservation information with the previously established information communication device 130 together with the established session information.
[0091]
Reservation session establishment unit 713 receives reservation session information and established session information from the first session establishment unit, and establishes a session with information communication apparatus 130 using the reservation session information. At that time, a condition for enabling communication to be relayed is specified from the session information established with the information communication apparatus 120, a session establishment request is made to the information communication apparatus 130, and the session is established.
[0092]
When the session reservation unit 714 receives an instruction from the first session establishment unit to designate a device and make a session reservation, the session reservation unit 714 transmits a session reservation request to the designated device (information communication device 130). If the reservation is successful, a reservation ID is issued, and the reservation ID is required when establishing or canceling the session.
[0093]
This is a device in which the information communication apparatus 130 uses the function exclusively, and when another device has already established a session and is currently in use, it may not be able to connect even if a session establishment request is made. Therefore, it is intended to prevent connection failure by securing a connection right by reservation before connecting to an external device. A device that accepts a connection can accept a plurality of connections for functions that can be used by connecting to a plurality of devices, but other devices cannot be used while connected to one device. Since it is conceivable to refuse the connection for such a function, the right to establish a session is reserved in advance. After accepting the session reservation, the information communication apparatus 130 does not accept a session establishment request without a reservation ID issued at the time of reservation, and automatically returns a connection rejection response. Unable to establish session from no device. Note that such exclusive connection management is an example, and it is not always necessary to perform such exclusive management in order to ensure that the apparatus can be connected.
[0094]
Further, the negotiation information of the device can be included in the response to the reservation request, and the communication relay device 200 updates the negotiation information stored in the negotiation information storage unit 102 based on the received negotiation information in the response. It is also possible.
FIG. 8 is a flowchart up to the start of relay in the second embodiment.
[0095]
Referring to FIG. 8, the steps from S801 to S805 are the same as the steps from S201 to S205 in FIG.
[0096]
The first session establishing unit 712 instructs the session reservation unit 714 to reserve a session for the device (information communication device 130) that has obtained the negotiation information for the device that has been requested to relay communication. The reservation unit 714 transmits a session reservation request to the designated device (step S806).
[0097]
A response to the session reservation request is received (step S807). At the same time, in the case of a response including the negotiation information of the device, the negotiation information is added and updated in the negotiation information storage unit 102. If the reservation is successful, session reservation information is returned together.
[0098]
The first session establishment unit 712 determines whether or not a reservation has been made from the response (step S808). If the session reservation has not been made, an answer indicating that communication cannot be relayed is returned to the relay start request unit 711 (step S809).
[0099]
If the session can be reserved, the other apparatus (information communication apparatus 120) uses the negotiation information of the apparatus (information communication apparatus 130) that has reserved the session to request a session establishment (first connection request). Is performed (step S810).
[0100]
A response to the connection request made in step S810 is received (step S811), and it is determined whether the first session has been established (step S812).
If the first session cannot be established, the reserved session is canceled (step S813), and a reply indicating that communication cannot be relayed is returned to the relay start request unit 711 (step S814).
[0101]
When the first session is established, the session information and the reserved session information reserved in advance are transferred to the reserved session establishing unit 713, and the session reservation number acquired for the apparatus that reserved the session using the established session information is used. A session establishment request (second connection request) is transmitted (step S815). A response to the second connection request is received (step S816), and the success or failure of session establishment is confirmed (step S817).
[0102]
If the session cannot be established, the first session is released (step S818), and a reply indicating that communication cannot be relayed is returned to the relay start request unit 711 (step S819).
[0103]
After both sessions are established, as in FIG. 2, if a session establishment request is received, a response to the request is made and the session information of the first session and the second session is transmitted to the session relay unit 103. Instruct to relay communication between both sessions (step S820). The session relay unit 103 starts relaying communication by transmitting data received in each session from the transmitted session information to the relay destination session (step S821).
[0104]
In the second embodiment, the first session is established by reserving a session to be established later in advance. As a result, the second session is not established, and the communication is performed without communication. You can avoid releasing the session.
[0105]
FIG. 9 is a sequence diagram of message exchange at the time of connection in the example of audio distribution according to the second embodiment. The trigger message is the same as in FIG. The difference from FIG. 3 which is the sequence diagram of the first embodiment is that session reservation negotiations (9-1) and (9-2) are first performed in the audio apparatus 301. A "RSRV" message is specified for session reservation. An example of the “RSRV message” is shown in FIG. If accepted, unlike the SIP INVITE message, the codec to be used in the session established at this point is not confirmed, other session establishment requests are not accepted, and the session is accepted only from the device reserved exclusively It can be. At the same time, it issues a reservation number (11223344) and responds to the connection request source device together with an OK message for reservation confirmation. Also, the device negotiation information can be notified as “INFO”. In the case of 9-2, negotiation information is provided that it is possible to establish 3 (GSM) and 4 (G.723) codec sessions using RTP / AVP as audio media.
[0106]
FIG. 10 shows a message for making a session reservation. RSRV message (9-1) is sent for session reservation instead of INVITE for connection establishment. The RSRV message itself has no difference in information included with INVITE. A reservation number (RSRV No) is returned in response message (9-2). The message for establishing a session to the audio device 902 is the same as that in FIG. 3 (9-3, 9-4). Since the audio device 901 is in a session reserved state, when an INVIT message is sent, an extended format message with a reservation number (RSRV No) added is sent (9-5). When the audio device 901 in the reserved state receives the INVITE message (9-5), it checks whether there is a reservation number in the message and whether the reservation numbers match, and responds. Session establishment failure is returned for all INVITEs whose reservation numbers do not match. Message 9-6 returns a request to accept session establishment because the reservation number (RSRV No) matches.
[0107]
FIG. 26 is a diagram showing a basic configuration of an information communication apparatus having a session reservation function.
[0108]
The original function of the information communication apparatus 2600 is implemented by the information processing unit 2605, accepts input using the input unit 2606, and outputs from the output unit 2607.
[0109]
For example, in the case of a television, an input of a broadcast signal from the antenna is received by the input unit 2606, and an output signal created from the input signal from the antenna by the tuner in the information processing unit 2605 is output via the cathode ray tube of the output unit 2607. To do. On the other hand, the information processing unit 2605 can decode the mpeg video data received from the data transmission / reception unit via the communication unit 2601 from the network, and can mainly use the CRT of the output unit 2607.
[0110]
In order to establish a session with the network and perform data communication, SIP signaling related to session establishment is performed, and the session management unit 2603 manages the session being established by storing session information. The session information format is the same as that of the relay apparatus and is held in the format shown in FIG. Session reservation unit 2602 receives a signaling message related to the session received by communication unit 2601. If the received message is a message for session reservation, if there is no session being reserved, the session reservation ID is recorded and a reservation acceptance response is returned to the requesting device. When a general SIP signal other than reservation is accepted, if there is already a reserved session, the session reservation unit 2602 returns a connection rejection response without passing it to the session management unit. When there is no reserved session, a message is passed to the session management unit 2603, so that the session management unit 2603 performs normal SIP session management signaling.
[0111]
The data transmission / reception unit 2604 transmits data to the specified session from the information processing unit 2605 and transfers the received data to the information processing unit 2605 as received data from the session. For this purpose, session information of a session managed by the session management unit 2603 is used. In this way, the information processing unit 2605 supports data transmission / reception in a session.
[0112]
FIG. 27 is a flowchart of signaling processing related to session establishment in the information communication apparatus 2600 having a session reservation function.
[0113]
When information communication apparatus 2600 is activated, it starts accepting signaling processing (step S2701). Then, the port that receives the signal related to the session is monitored, and the data received at that port is passed to the session reservation unit 2602 (step S2702). The session reservation unit 2602 analyzes the received data and extracts a signaling message (step S2703). It is determined whether or not the extracted message is a session reservation request (step S2704).
[0114]
If it is a message other than a request for session reservation, it is confirmed whether it is an INVITE message which is a request message for establishing a session (step S2705). If it is an INVITE message, if it has a session reservation ID in the message, it is checked against the reservation ID currently stored as being reserved (step S2706). If the message has a reservation ID that matches the stored session reservation ID, it is delivered to the session management unit as a normal INVITE message and processed (step S2709). If it does not match the stored reservation ID, or if it is a general INVITE message that does not have a reservation ID in the message, it is determined whether or not it is a media session competing with the reserved session (step S2707). If it does not interfere with the establishment of a reserved session, it is passed to the session management unit as a normal INVITE message and processed (step S2709). However, if the session is established, the reservation session cannot be established. If it is received, it is not delivered to the session manager, but a rejection response is immediately returned.
[0115]
If it is not a session establishment request in step S2705, a signaling message is passed to the session management unit, and processing as a normal SIP signaling message is performed (step S2709). If the session reservation ID does not match in step S2706, there is another session that has already been reserved, so a connection rejection response is returned in response to the current session establishment request (step S2708).
[0116]
If the request message is a session reservation request message in step S2704, the session management unit is inquired to check whether there is a possibility that a reservation session cannot be established in the established session (step S2710). If there is a possibility that the establishment of a session for which reservation is desired in the currently established session may be hindered, a response rejecting the reservation is returned (step S2713). If there is no hindrance in the established session, the stored session reservation ID is confirmed to confirm whether there is a reserved session (step S2711). If there is no reserved session, the session reservation ID is issued and stored as it is (step S2715), and a response to the effect of reservation is returned (step S2716). If there is a session during the reservation, it is determined whether the reservation may interfere with a request for a new reservation (step S2712). If there is a possibility of blocking, a reservation rejection response is returned (step S2713). If there is no possibility of blocking, a new session reservation ID is issued, and the session reservation ID is added to the memory (step S2714), and the reservation can be made. A case response is returned (step S2716).
[0117]
In addition, in order to determine whether or not the session prevents establishment of a new session, information in the session reservation ID is also stored if necessary together with the reservation ID. Judgment rules can be determined based on the function of each model. For example, in the case of a device that has the function of outputting only one type of video, only one session for receiving video is set to be accepted. It is possible to do. It is also possible to set a priority order or the like according to the type of session or the connection destination device, and use it to determine whether or not to prevent it.
[0118]
(Embodiment 3)
Next, a third embodiment will be described. In order to implement the second embodiment, it is necessary to introduce a mechanism capable of making a reservation so that a session can be reliably established not only on the relay device but also on the device side that transmits and receives data via the relay device. However, since such a function is not present in the standard SIP currently used, the second embodiment cannot be said to be effective for an existing apparatus.
[0119]
Therefore, when using a device with a mechanism that does not have a reservation function, it is possible to establish a session that can be relayed reliably by establishing a session and correcting it so that it will not interfere with relaying later. it can. This is the third embodiment. However, in this case, there is no problem if the time lag from when both sessions are established until relaying is possible is small, but if it is large, the transmitting side does not know that and the transmitted data is not transmitted in large quantities, or There is a possibility that the real-time property may be seriously impaired, for example, it takes time to perform conversion for transmission so that the other party can receive. In that respect, the session is not established, but the second embodiment is meaningful in that there is a reservation as a state that can be reliably established.
[0120]
FIG. 11 is a functional block diagram of the communication relay device 300 according to the third embodiment.
Since the negotiation information accumulating unit 102 and the session relay unit 103 are the same as those in the first embodiment of FIG. 1, the description thereof will be omitted, and the third relay session establishment unit 1101 will be described. Although described as the second information communication device 120 and the first information communication device 130, the present invention also corresponds to a plurality of devices as shown in FIG. 2 as in the case of FIG.
[0121]
The third relay session establishing unit 1101 includes a first session establishing unit 1112, a temporary session correcting unit 1113, and a temporary session establishing unit 1114 in addition to the relay start request accepting unit 1111.
[0122]
When the relay start request reception unit 1111 receives an instruction for requesting the start of communication relay specifying the devices (the information communication device 120 and the first communication device 130) via the input / output unit 106 and the internal communication unit, the relay start request reception unit 1111 It designates and requests the first session establishment unit 1112 to establish a communication session and start communication relay.
[0123]
Upon receiving a request to start communication relay, the first session establishing unit 1112 acquires negotiation information regarding both devices from the negotiation information storage unit 102, and specifies the device (information communication device 130) that has acquired the negotiation information. The temporary session establishment unit 1114 is requested to establish a temporary session. The temporary session establishment unit 1114 receives a response indicating whether or not the temporary session has been established. A request for establishing a communication session is made to the device (information communication device 120) that has not been able to acquire the negotiation information using the negotiation information of the information communication device 130 that is a relay partner. At this time, temporary session information is not considered. If the session with the information communication device 120 is established, the temporary session information with the information communication device 130 is transmitted to the temporary session correction unit 1113 together with the established session information.
[0124]
The temporary session establishment unit 1114 receives the negotiation information regarding the information communication device 130 acquired by the first session establishment unit from the negotiation information storage unit, and makes a request for the provisional session establishment to the designated information communication device 130 using the received negotiation information. When a response to the session establishment request is received, session information is created if the session can be established, and returned to the first session establishment unit as temporary session information.
[0125]
When the temporary session correction unit 1113 receives the first session information and the temporary session information, the temporary session correction unit 1113 extracts a mismatch between the first session information and the temporary session information, and transmits a temporary session change request to the information communication apparatus 130 so as to match the first session. If the inconsistency is successfully corrected, information on the two sessions is sent to the session relay unit 103 and a communication relay start is requested. If the correction fails, a reply indicating that relaying is impossible is returned to the relay start request unit 1111.
[0126]
FIG. 12 is a flowchart up to the start of relay in the third embodiment.
The steps from step S1201 to step S1205 are the same as the steps from step S201 to step S205 in FIG.
[0127]
The first session establishment unit 1112 requests the provisional session establishment unit 1114 to establish a provisional session by designating a device (information communication apparatus 130) that has been able to acquire negotiation information for the device that has been requested to relay communication. The temporary session establishing unit 1114 transmits a session reservation request to the designated device (step S1206).
[0128]
A response to the temporary session establishment request in step S1206 is received, and the result is returned to the first session establishment unit 1112 (step S1207). If the reservation is successful, session reservation information is returned together.
[0129]
The first session establishment unit 1112 determines whether or not a provisional session has been established (step S1208). If the provisional session cannot be established, the first session establishment unit 1112 returns a reply indicating that communication cannot be relayed to the relay start request unit 1111 (step S1209).
[0130]
When the temporary session can be established, the other device (information communication device 120) uses the negotiation information of the device (information communication device 130) that has established the temporary session to request a session establishment (first connection request). Is performed (step S1210).
[0131]
A response to the connection request made in step S1210 is received (step S1211), and it is determined whether the first session has been established (step S1212). If the first session cannot be established, the temporary session is released (step S1213), and a reply indicating that communication cannot be relayed is returned to the relay start request unit 1111 (step S1214).
[0132]
When the first session is established, the session information and temporary session information are transferred to the temporary session correction unit 1113, and the temporary session correction unit 1113 has a problem in relaying the data of the temporary session and the first session. (Step S1215). Here, it is confirmed whether or not the media information in the session information matches.
[0133]
If the media information does not match and there is a problem in relaying as it is, a request message for correcting the media content of the temporary session is transmitted to the information communication device 130 so as to match the media information of the first session (step S110). S1216) A response to the temporary session content correction request transmitted in step S1216 is received (step S1217), and it is determined from the response content whether the temporary session has been corrected (step S1218).
[0134]
If the contents of the temporary session could not be corrected, both the first session and the temporary session are released (step S1219), and a reply indicating that communication cannot be relayed is returned to the relay start request unit 1111 (step S1220).
[0135]
After the two sessions are established, as in FIG. 2, if a session establishment request is received, a response is made to the session, and the session information of each established session is transmitted to the session relay unit 103. An instruction is given to relay the communication (step S1221). The session relay unit 103 starts relaying communication by sending data received in each session to the other session based on the transmitted session information (step S1222).
[0136]
The third embodiment is useful when the contents of a session once connected can be changed although exclusive control by reservation for session establishment is not possible. In this case, it is possible to establish a data transmission / reception session that can be reliably relayed even by a device having no session reservation function. However, each device can start data transmission / reception when a temporary session is established, but since relaying is not possible, there will be a time lag before actual communication is possible, but there may be a practically no problem. For example, this connection method has an advantage of being compatible with conventional SIP.
[0137]
FIG. 13 is a sequence diagram up to the start of relay in an example of audio distribution, and FIG. 14 is a message exchanged there. The two figures will be described together.
[0138]
The message 13-1 is a connection request (INVITE) message transmitted to the audio device 1301 and the message 13-3 is transmitted to the audio device 132 using the negotiation information of the audio device 1301, and the message 13-2 and the message 13-4 are transmitted. Is a response message to each INVITE message. Message 13-2 is an audio communication session using the GSM codec, and message 13-4 is a response establishing an audio communication session using the G.723 codec.
[0139]
Details of the message are the same as those described with reference to FIG. The message 13-5 is a message for requesting to change the session with the audio device 1301 to an audio communication session using the GSM codec in response to the establishment of two sessions. If an INVITE message is used and a request is received with the same ID as the call number (Call-ID) of an already established session, a process for changing the settings of an existing session is performed instead of establishing a new session. . In other words, once established as a session for communicating GSM codec data, the G.C. 723. 13-6 is a message that responds that the audio device 1301 accepts the change request and accepts the change to the G.723 session.
[0140]
(Embodiment 4)
FIG. 15 is a functional block diagram of the communication relay device 400 according to the fourth embodiment.
[0141]
Hereinafter, the fourth relay session establishment unit 1501 that is a feature thereof will be described.
In the fourth embodiment, as both devices that relay communication to the communication relay device 400, together with the information communication device, a plurality of communication device candidates (information communication device 131, information communication device 132, information The information communication device candidate group 1530 consisting of the communication devices 133) is designated, and a request is made to the relay start request receiving unit 1511.
[0142]
The request is made by a user via the input / output unit 106 or a request message transmitted from a device on the network via the internal communication unit 105.
[0143]
The relay start request accepting unit 1511 specifies the information communication device candidate group in the negotiation information sum creating unit 1515 in order to know the sessions that can be established by the devices in the information communication device candidate group 1530, and selects one of them. Requests creation of a negotiation information sum that is a combination of negotiation information that is media information of a session that can be established with the device.
[0144]
The negotiation information sum creating unit 1515 acquires negotiation information of information communication devices (information communication device 1531, information communication device 1532, information communication device 1533) included in the information communication device candidate group 1530 held by the negotiation information storage unit 102, A negotiation information sum is created from them. Each information communication device shows an example of one device, but a plurality of devices are also possible as in the other embodiments. The negotiation information sum is negotiation information created by collecting all elements supported by each candidate device for each element of negotiation information necessary for negotiation such as a protocol and a codec.
[0145]
The first session establishment unit 1512 receives the negotiation information sum of the second information communication device candidate group 1530 created by the negotiation information sum creation unit 1515, and with respect to the information communication device 120 specified by the relay start request reception unit 1511, A session establishment request is made using the negotiation information sum.
[0146]
The information communication device determination unit 1513 receives the information on the session established by the first session establishment unit 1512, and the other party in the information communication device candidate group 1530 capable of relaying communication with the first session based on the session information. The device (information communication device 1533) is determined with reference to the information in the negotiation information storage unit 102, and the information communication device 1533 determined as the communication partner, the negotiation information, and the first session information are transferred to the second session establishment unit 1514. .
[0147]
The second session establishing unit 1514 establishes the first session established with the information communication device 120 from the negotiation information handed over to the information communication device 1533 determined by the second information communication device determination unit 1513. A request for establishing a second session that specifies conditions for relaying communication based on information on the session is transmitted. If the second session is successfully established, information on the two established sessions is transmitted to the session relay unit 103, and an instruction is given to start relaying communication between the sessions.
[0148]
FIG. 16 is a flowchart until communication relay is started.
First, the relay start request accepting unit 1511 of the communication relay device 400 includes an information communication device candidate group 1530 (information communication device) that is a plurality of candidate devices that receive communication with the device (information communication device 120) that is the communication destination. The communication relay start request specifying 1531 to 1533) is received (step S1601). In this case, the request means is an example in which a request arrives from a device on another network, but is not necessarily limited thereto. It is also possible for the user to input and instruct directly to the communication relay device.
[0149]
The relay start request accepting unit 1511 delivers information about the designated plurality of candidate devices to the negotiation information sum creating unit 1515, and requests to create the second session negotiation information sum (step S1602).
[0150]
The negotiation information sum creating unit 1515 acquires session information for a plurality of designated candidate devices from the negotiation information storage unit 102 (step S1603), and the first session becomes a session that can be relayed to any device. Create a negotiation information sum. When communicating a plurality of media, negotiation information is created for each media (step S1604).
[0151]
The first session establishment unit 1512 uses the negotiation information sum received from the negotiation information sum creation unit 1515 to transmit a request for establishment of the first session to the information communication apparatus 120 instructed from the relay start request reception unit 1511. When requesting a plurality of media communication sessions, a session establishment request is made by designating all of the plurality of negotiation sums created in step S1604 (step S1605).
[0152]
When a response to the session establishment request transmitted in step S1605 is received (step S1606), it is determined from the response whether the first session has been established (step S1607).
[0153]
If the session cannot be established, a reply indicating that communication cannot be relayed is returned to the relay start request reception unit 1511 (step S1608).
[0154]
When the first session with the information communication device 120 is established, the negotiation information of all the information communication devices included in the information communication device candidate group 1530 is acquired from the negotiation information storage unit 102 (step S1609).
[0155]
From the negotiation information acquired in step S1609, one including the contents of the session determined in the first session is selected, and the second session connection destination device is determined. When there are a plurality of media, a connection destination device is determined for each media (step S1610). If there are multiple, present them to the user and select them.
[0156]
Information such as a codec not used for the first session in the negotiation information selected in step S1610 is deleted. (Step S1611).
[0157]
Using the negotiation information modified in step S1611, a session establishment connection request is transmitted to the information communication apparatus 1533 selected in step S1610 (step S1612).
[0158]
A response to the connection request transmitted in step S1612 is received (step S1613), and it is determined from the contents whether the session has been established (step S1614).
[0159]
If the session could not be established, the first session is released (step S1615), and a reply indicating that communication cannot be relayed is returned to the relay start request receiving unit 1511 (step S1616).
[0160]
If a session can be established, each established session information is transmitted to the session relay unit 103, and an instruction is given to start data relay between sessions (step S1617).
[0161]
The session relay unit 103 starts communication relay between sessions according to the received session information (step S1618).
[0162]
FIG. 17 is a diagram for explaining the negotiation information sum 171 using the negotiation information of the audio devices 1802, 1803, and 1804 as an example. Each negotiation information describes each IP address and media information (media type, connection protocol (address), data communication protocol profile, data format (codec)) as in the previous embodiments. The same. Negotiation information sum is a collection of information necessary for requesting the establishment of a session for media communication, and can be used in each protocol for each data type from the information registered in "media" of each negotiation information. Created by collecting all codecs. Negotiation information sum 171 indicates that each of audio transmission (in) and reception (out) can establish a communication session using one of GSM, G.723, and PCMU codecs using SIP and RTP / AVP. I mean.
It is also possible to specify a plurality of media.
For example,

In the case of a relay request such as “audio”, “video”, a media information negotiation sum can be created for each media, and a multimedia connection request that specifies them is connected to “destination” “av1.com Can be done. Then, from the response to the connection request, a connection destination can be selected and determined for each medium, and a connection request can be made for each medium.
[0163]
FIG. 18 is a sequence diagram showing session establishment for communication relay, and FIG. 19 shows each message.
[0164]
The communication relay apparatus 400 receives a message for requesting communication relay by designating three audio apparatuses (1802, 1803, 1804) together with the audio apparatus 1801. Since the communication relay device holds negotiation information of the three audio devices (1802, 1803, 1804), the communication relay device transmits an INVITE message of 18-1 based on the negotiation information sum 171 (see FIG. 17) created therefrom. . The media designates three codecs of 0 (PCMU), 3 (GSM), and 4 (G.723) based on the negotiation information sum 171. 18-2 is a response to the INVITE message of 18-1, and is a response when a communication session with 0 (PCMU) is established. The communication relay device 400 receives the response 18-2 and can communicate with the audio device 1801 through the PCMU. Therefore, the 18-3 INVITE message in which the PCMU is selected by selecting the audio device 1804 that supports the PCMU. Send. 18-4 is a response message for establishing a voice data communication session in PCMU for 18-3 INVITE.
[0165]
According to this embodiment, instead of designating a device in advance by a relay device, a communicable device can be selected from candidates and communicated based on an established communication session.
[0166]
Based on the fourth embodiment, as in the second and third embodiments, a reservation is made for a device in the information communication device candidate group, or a provisional session is established and corrected later. It is also possible to do.
[0167]
Heretofore, the four basic embodiments of the present invention have been described. The audio data distribution has been mainly described as an example, but an example of a TV phone service is shown as an example of combining a plurality of devices. Although this is an example of connection in the basic first embodiment, the present invention can be similarly applied to the second to fourth embodiments.
[0168]
FIG. 20 is a sequence diagram for establishing a session in the videophone service, and FIG. 21 shows an example of a message at that time.
[0169]
When the communication relay apparatus 100 receives a call request (20-1) from the IP telephone 131 to the TV telephone 120, the apparatus TV 132 and the web camera 133 that can be used for the TV telephone in combination with the IP telephone 131 are connected within the communication relay apparatus 100. A request TV telephone communication relay request 2001 for generating a session and relaying communication is generated by selecting a session between the TV 120, the IP telephone 131, the TV 132, and the web camera 133.
[0170]
The voice data session establishment request is included in the TV phone call request (20-1) from the IP phone 131. Based on the negotiation information of the IP phone 131, the TV 132, and the web camera 133, the communication relay device uses the GSM or G.723 voice and motion-jpeg (abbreviated as mjpeg in the figure) or mpeg2 A request is made to establish a videophone session for transmitting and receiving moving image media (20-2). The TV phone 120 returns a response that accepts the establishment of the TV phone session with G.723 audio and motion-jpeg video (20-3). Based on the session establishment result of (20-3), the communication relay device requests a session establishment request for a video transmission session specifying motion-jpeg for the TV 132 and a video reception session specifying motion-jpeg for the web camera 133. (20-4a, 20-4b). Each responds with a session establishment OK response (20-5a, 20-5b), and establishes a TV phone session establishment together with the G.723 voice session establishment response to the IP phone 131 that was the original connection request source. Returns response (20-6).
[0171]
In the first to fourth embodiments described above, the session establishment that combines the codec for audio distribution and videophone has been described as an example. However, the present invention is not limited to the codec, and the type of data to be communicated in advance is determined. Applicable to all negotiated parameters. For example, in the case where communication is performed after negotiating the display size of image data to be communicated in advance, the display size can be used as negotiation information to prevent the apparatus from communicating image data that cannot be displayed.
[0172]
22, 23, and 24 show examples of apparatuses to which the communication relay apparatus that implements the present invention is applied. In the figure, the TV phone service is described as an example, but the present invention is not limited to this service.
[0173]
FIG. 22 shows an embodiment in which the present invention is applied to a home gateway apparatus 2202 that enables the use of services on the Internet by combining the functions of a plurality of devices on a home network. In this example, the functions of the IP telephone 2205, the TV 2203, and the web camera 2204 on the home network are combined on the home gateway device 2202, and the TV phone service on the Internet is used. The home gateway apparatus 2202 can use the present invention when a call is made from the IP telephone 2205 to the TV telephone terminal 2201.
[0174]
FIG. 23 shows an IP telephone 2302 that makes it possible to use a TV phone service by relaying data about a video input / output function that it does not have to another device.
[0175]
When the IP telephone 2302 makes a videophone call to the videophone terminal 2301, it establishes a videophone session to the videophone terminal 2301 via the Internet and inputs video data that does not have a function for input / output by itself. A session is established between the TV 2303 and the web camera 2304 for output, and the video data is relayed to the TV 2303 and the web camera 2304 so that the TV phone service can be used. The technology of the present invention can be used for the IP telephone 2302 at this time.
[0176]
FIG. 24 shows an example of implementation in the service of the videophone service proxy on the Internet.
[0177]
The TV phone service proxy 2402 provides a service that allows a user to use a TV phone service by combining a plurality of devices by designating a combination of a plurality of devices. In this example, a request for a call to the TV phone terminal 2401 is made from the IP phone 2406 in the home to the TV phone service proxy via the home router 2403 connected to the Internet. At this time, regarding the functions that the IP telephone 2406 itself does not have, when the TV 2404 and the web camera 2405 are designated as video phone video input / output devices and a call request is made, the video phone service proxy 2402 receives the video input / output. Session for the designated device (TV 2404 and web camera 2405), and the video data communication with the TV phone terminal is relayed to enable the use of the TV phone service. This TV phone service proxy 2402 can also use the present invention.
[0178]
The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.
[0179]
【The invention's effect】
As described above, according to the present invention, when media transmission / reception between devices is relayed, special media matching between sessions is performed between devices with unknown media information such as codecs. Even if a regulation is not added, a media can be relayed by setting up a session so as not to cause inconsistency of media.
[0180]
Alternatively, when using the result of the session with the callee device from the relay device to establish the session with the callee device, the callee session is set even though the caller cannot establish the session. Can prevent establishment.
[0181]
Or, by selecting the device with the capability that the callee device wants by relaying the media from the multiple devices used on the caller side, it provides optimal performance to device users. be able to.
[Brief description of the drawings]
FIG. 1 is a functional block diagram of a communication relay device 100 representing a first embodiment.
FIG. 2 is a flowchart from relay start request reception to relay start in the first embodiment.
FIG. 3 is a sequence diagram of session establishment necessary for relay in the first embodiment.
4 is a signaling message for session establishment in the sequence diagram of FIG.
FIG. 5 is session information of two sessions established in FIG. 3;
FIG. 6 is an example of negotiation information of each information communication device held in the relay device in the present embodiment.
FIG. 7 is a functional block diagram of a communication relay device 200 according to the second embodiment.
FIG. 8 is a flowchart from relay start request reception to relay start in the second embodiment.
FIG. 9 is a sequence diagram of session establishment necessary for relay in the second embodiment.
FIG. 10 is a signaling message for session establishment in the sequence diagram of FIG. 9;
FIG. 11 is a functional block diagram of a communication relay device 300 according to a third embodiment.
FIG. 12 is a flowchart from relay start request reception to relay start in the third embodiment.
FIG. 13 is a sequence diagram of session establishment necessary for relay in the third embodiment.
FIG. 14 is a signaling message for session establishment in the sequence diagram of FIG. 13;
FIG. 15 is a functional block diagram of a communication relay device 400 according to the fourth embodiment.
FIG. 16 is a flowchart from relay start request reception to relay start in the fourth embodiment.
FIG. 17 is a diagram for explaining a “negotiation information sum” created from candidate devices to be relayed.
FIG. 18 is a sequence diagram of session establishment necessary for relay in the fourth embodiment.
FIG. 19 is a signaling message for session establishment in the sequence diagram of FIG.
FIG. 20 is a sequence diagram for explaining an example of making a videophone call by combining a plurality of devices using the communication relay device of the present invention.
FIG. 21 is a signaling message for establishing a session for relay in the sequence diagram of FIG. 20;
FIG. 22 is a diagram showing an example in which the present invention is incorporated into a home gateway device and a TV phone is used.
FIG. 23 is a diagram showing an example in which the present invention is mounted on an IP telephone and a videophone is carried out.
FIG. 24 is a diagram showing an example in which the present invention is implemented in a TV phone service server to make a TV phone call.
FIG. 25 illustrates an example of a hardware configuration according to the embodiment of this invention.
FIG. 26 is a diagram illustrating a functional configuration of an information communication apparatus having a session reservation function.
FIG. 27 is a flowchart for explaining signaling message processing such as session reservation and establishment in the apparatus having the configuration of FIG. 26;
[Explanation of symbols]
100, 200, 300, 400 Communication relay device, 101 First relay session establishment unit, 102 Negotiation information storage unit, 103 Session relay unit, 104 External communication unit, 105 Internal communication unit, 106 Input / output unit, 107 Negotiation information collection unit , 111 Relay start request accepting unit, 112 First session establishing unit, 113 Second session establishing unit, 120 TV phone, 130 IP phone, 131 TV, 132 web camera, 701 Second relay session establishing unit, 711 Relay start request accepting 712, first session establishment unit, 713 reservation session establishment unit, 714 session reservation unit, 1501 fourth relay session establishment unit, 1511 relay start request reception unit, 1512 first session establishment unit, 1513 information communication device determination unit, 1514 Second session Establishing unit, 1515 negotiation information sum creating unit, 1530 information communication device candidate group.

Claims (3)

A communication relay device that establishes a session with each of the first information communication device and the second information communication device and relays communication,
Negotiation information storage means for storing negotiation information used for session establishment of the first information communication device;
When receiving a communication relay start request designating the second information communication apparatus and a plurality of candidate apparatuses that communicate as the first information communication apparatus, the second information communication apparatus and the second information communication apparatus together with the negotiation information of the candidate apparatuses The first information communication device is requested from among the candidate devices of the first information communication device using a result of the session establishment request from the second information communication device. And a relay session establishment means for establishing a session for relaying communication to the selected device. The negotiation information stored by the negotiation information storage means includes information on the codec supported by the information communication device,
The relay session establishment means makes a session establishment request to the second information communication device using information on all the codecs supported by the candidate device, and the codec used in the established session can be used. The communication relay device according to claim 1, wherein one information communication device is selected and a session establishment request specifying the codec is made . The communication relay start request can specify a set of a plurality of devices as candidate devices of the first information communication device,
When the first information communication device selected from the candidate devices using the result of the session establishment request from the second information communication device is a set of a plurality of devices, the relay session establishment means The communication relay device according to claim 1, wherein a session is established for each of the devices.

Images