JP2005293065A - Information communication device, information communication program, and recording medium for recording this program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information communication device that enables data unsupported by a service to be additionally exchanged with a communication partner who is in communication via the service. <P>SOLUTION: When the data which it is desired to send or receive on a previously established session cannot be added, an Internet telephone service system 100 negotiates with the recipient of the data by means of information on the previously established session and establishes a new session to exchange the desired data. Information on the new session is stored in a session information retaining part in association with the original session currently in communication. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information communication device for transmitting and receiving data such as voice and images and information using a session established by negotiating with a communication partner via a network, and information for causing a computer to control such transmission and reception. The present invention relates to a communication program and a recording medium on which such an information communication program is recorded.

  The Internet Protocol (IP) is a specification for processing between various computer devices on the Internet without being aware of the network, and uses an application level protocol specified based on the IP. Multimedia bi-directional communication is realized.

  Specifically, a protocol SIP (Session Initiation Protocol) for establishing a session for performing communication such as voice and video between processes on each device between devices connected to the network and contents exchanged in the session Application level protocols such as SDP (Session Descriptor Protocol) for exchanging information on the network and RTP (Real-Time Transport Protocol) for packetizing media streams such as voice, text, and video are defined.

  One example of multimedia two-way communication based on these protocols is a real-time voice call represented by an Internet telephone. In general, in addition to voice calls between devices on the Internet for each service provider, the Internet phone service provides a mutual call with a voice telephone terminal such as a general fixed telephone network or a telephone number through a gateway. It is provided to users as an Internet telephone service that combines various functions such as connection management including IP address conversion, billing and authentication, and a videophone that adds video in addition to voice.

  As for the protocol used in the Internet telephone service, H. H.323 has prevailed earlier, but the above SIP is being de facto standardized. In any case, after establishing a session for transmitting and receiving data between devices that communicate via a server that is a device that provides services on the Internet, multimedia data such as voice is directly transmitted based on the session. Communication between devices is fundamental.

  In addition to Internet telephones, voice calls, electronic conferences, video-on-demand, etc. have begun to be provided, but based on Internet protocols and technologies, the types of data to be exchanged etc. It is becoming possible to freely define various services and provide them to users.

  The following is a prior art related to enabling exchange of a plurality of media data.

  As disclosed in Japanese Patent Application Laid-Open No. 9-168063, there is a technique that enables transmission / reception of auxiliary data related to a voice call. This is to transmit and receive auxiliary data in addition to voice data.

  Patent Document 2 (Japanese Patent Laid-Open No. 2002-251454) is a system that enables communication using characters, sounds, and images. Character, voice, and image applications communicate with each other.

  Patent Document 3 (Japanese Patent Application Laid-Open No. 2003-8778) acquires screen data of a call partner and displays it on its own screen, and uses a server that relays both voice and screen data called multi-communication. Is.

  Patent Document 4 (Japanese Patent Laid-Open No. 2001-298545) is a multimedia conference service providing system that realizes linked operation of a real-time audio conference and a data system conference. The terminal communicates with a conference participant via a server providing the service, and each terminal connects to the service server and transmits / receives data via the server.

  Japanese Patent Application Laid-Open No. 2003-6073 discloses a system for communicating audio visual data composed of sound and images and display data such as web.

Patent Document 6 (Japanese Patent Application Laid-Open No. 2000-172611) is a TV teleconference system. In addition to the TV teleconference screen, when the page displayed on the web browser on the conference participant's terminal changes, it is linked with it. The web browser page that the conference participant is browsing switches.
Even if you want to use data transmission / reception with the service while using the service specified by the service provider, it is generally not assumed that such data will be transmitted / received as a service. Data cannot be sent and received.

  For example, while you are making a voice call using the Internet voice call service, you can use a voice call service communication session to provide data such as maps and explanatory materials to the other party, or vice versa. You cannot receive and browse data such as materials you have.

  Such a situation does not change even if the terminal device holds such data, and the application has the ability to transmit and receive such data in addition to the voice call.

  The service provider assumes that the negotiation for session establishment for exchanging data assumed for the specified service is relayed between the calling party and the called party's terminal via the server, but is assumed as a service. Session setting signals that negotiate unacceptable data are not allowed.

Even if any of the above-mentioned prior arts are used, if it is not decided in advance what kind of data will be sent between terminals, how to send additional data to be communicated between terminals However, if the above negotiation or data communication is communicated via a server, the server negotiates communication or the data that is actually transmitted. Many have stipulated. None of the above-mentioned techniques includes a technique that enables data exchange other than prescribed in such a server, as is the case with many Internet telephones and video conference systems.
Japanese Patent Application Laid-Open No. 9-168063 "Terminal device for telephone system" JP 2002-251454 A "Communication system using the Internet and a reception system using this communication system" Japanese Patent Laid-Open No. 2003-8778 “Internet Multi Call System” JP 2001-298545 A "Telephone-based multimedia conference service providing system" JP 2003-6073 A "Network access system and network access method using the system" Japanese Patent Laid-Open No. 2000-172611 “Videophone System”

  In order to realize transmission / reception of data that is not permitted by the service provider, it is necessary to establish another session with the other party communicating with the service for data transmission / reception without service. However, the other party communicating with the service is performing session signaling via the service server, and information for directly signaling with the other party of communication, specifically information such as the signal destination address. I do n’t know.

  Also, assuming that the request destination for session establishment is known, the side that accepts the request for session establishment is that the newly received request for session establishment is related to the currently communicating session. Since it cannot send and receive, it cannot recognize that it is trying to establish an auxiliary session.

  Furthermore, even if it is possible to specify the relevant session when requesting the establishment of a session, or to make a request for associating multiple sessions after establishing the session, and to inform the other party of the association, It is difficult for both parties to confirm that the association is correct.

  Further, even if a session in communication and a newly established session are associated with each other, there is no conventional technique for managing them in association with each other. For example, consider a case in which a voice communication session and an image transmission session are managed in association with each other. When only simple association is managed, there may be a case where a session for image transmission / reception remains even if the session for voice communication is disconnected. However, in consideration of security, it may be preferable to perform an operation in which transmission / reception of images is permitted only during a conversation in a voice communication session.

  In view of the above problems, the problem to be solved by the present invention is to use the signaling information of the session established through the server provided by the service provider without using the server provided by the service provider. It is to provide a technique for establishing another session.

  Another problem to be solved by the present invention is to provide a technique for knowing that a new session is associated with an existing session when the establishment of a new session is requested by the other party. There is.

  In addition, another problem to be solved by the present invention is that when a new session is requested and established, the other party confirms that the new session is associated with an existing session. It is to provide the technology for.

  In addition, another problem to be solved by the present invention is that an additional session associated with the underlying session can be established only while the underlying session is established, and the underlying session is disconnected. If this happens, the additional session is also disconnected, and if the underlying session has not been established, only the additional session will not be established. It is to provide the technology for.

In order to solve the above problems, in an aspect of the present invention, an information communication device
Session control means for establishing and controlling a session as a connection for data communication with a communication partner apparatus, session information holding means for holding and managing information related to the session established by the session control means, and session information holding Data transmission / reception means for transmitting / receiving data in an established session using the information held by the means, and the session control means sends a data transmission destination to the communication partner of the already established session when the session is established Communication for requesting session establishment is performed with respect to the address acquired as the address to establish a new session.

  Therefore, such an information communication device exchanges data of a type that cannot be communicated with a partner device that is communicating by establishing a session even if the session established due to server restrictions or the like is changed. Can establish a session for communication.

  According to another aspect of the present invention, an information communication device establishes a session as a connection for performing data communication with a communication partner device, session control means for controlling the session, and a session established by the session control means. Session information holding means for holding and managing information related to, and data transmission / reception means for transmitting and receiving data in an established session using information held by the session information holding means, and the session control means is already established To the address acquired as the data transmission destination address of a certain session, a communication requesting establishment of a new session specifying the session specified by the session identification information as a main session is performed, and a new subordinate to the session Establish a secure session and Dependent on the session in the session information storage is managed in association as a new session.

  Therefore, with these devices, in addition to communication in an existing session, even if a new session for exchanging other data is established, the session can be associated and managed. It can be linked.

  According to still another aspect of the present invention, an information communication apparatus is established by a session control means for establishing a session as a connection for performing data communication with a communication partner apparatus and controlling the session, and a session control means. Session information holding means for holding and managing information related to a session, and data transmission / reception means for transmitting and receiving data in an established session using information held by the session information holding means, and the session control means is already established In response to a communication requesting establishment of a new session in which the session specified by the session identification information of the current session is designated as a main session, the new session is associated as a session subordinate to the designated main session. Session information To be managed by the means.

  Preferably, the communication data requesting session establishment specifying the main session is returned to the requesting apparatus when the new session established from the request is associated with the main session. The main session confirmation data is detected, and the main session confirmation data is detected in the main session to confirm that the newly established session is correctly associated with the designated main session in the communication partner device. Sub-session confirmation means is provided.

  Preferably, the session control means sends a response to the session establishment request source apparatus when a new session established from the request is associated with the main session in the session establishment request specifying the main session. An association confirmation data adding means for adding main session confirmation data that is expected to be received, and detecting the reception of the main session confirmation data in the main session, so that a newly established session is designated by the designated main entity Sub-session confirmation means for confirming that the session is correctly associated with the session.

  Preferably, the communication data for requesting establishment of a new session includes main session confirmation data for notifying the main session of the newly established session based on the communication data for requesting establishment of a new session. When the session control unit causes the session information holding unit to manage a new session in association with the main session, the main session confirmation is performed by transmitting data based on the main session confirmation data in the main session in the associated main session. A reply means is further provided.

  In addition, preferably, the session control means mainly takes a newly established session from communication requesting establishment of a new session specifying the session specified by the session identification information of the already established session as the main session. A main session confirmation data extracting means for extracting main session confirmation data that is expected to be returned when the session is associated with a session, and the session control means is a session whose main session information holding means is a new session. If the management is performed in association with the main session confirmation return means, the main session confirmation reply means for transmitting the data based on the main session confirmation data as the data of the main session in the session as the associated subject.

  Therefore, when these devices are used, when establishing a new session by associating with an existing session, it is confirmed that the device that requested the establishment of a new session surely associated the desired session. Can do.

  Preferably, the main session communicates sound data, the main session confirmation data is a character string generated whenever necessary, and the sub-session confirmation means converts the designated main session confirmation data into DTMF sound. By receiving the data as data and detecting the DTMF sound data in the main session, it is confirmed that the new session is correctly associated.

  Preferably, the main session is for communicating sound data, the main session confirmation data is a character string generated whenever necessary, and the main session confirmation reply means is a character string of the main session confirmation data. The generated DTMF sound data is returned in the main session.

  Therefore, when these devices are used, a new session for exchanging different data is established with respect to the existing voice communication session, and the new session is associated with the existing voice communication session and the session associated with the existing voice communication session is confirmed. be able to.

  Further preferably, when the session information holding means is requested to disconnect the second session managed in association with the session as the subject of the first session in the session information holding means, the session control means After disconnecting, the requested second session is disconnected.

  Therefore, when these devices are used, it is possible to prevent a session established for exchanging data for supplementing the main session from remaining after the main session is disconnected. .

  In addition, preferably, it comprises data synchronization input / output means for inputting / outputting data in synchronization with designated data, and the session control means is a new control managed in association with the currently established session. Data specifying information adding means for adding information specifying communication data in a currently established session to be synchronized with communication data of a newly established session in communication of a request for establishment of a new session or a response thereto The data synchronization input / output means inputs / outputs session communication data in synchronization according to information related to data synchronization.

  Therefore, when these devices are used, the data communicated in the main session and the data communicated in the session established to assist it can be synchronized and input / output to communicate in different sessions. However, you can communicate by receiving synchronized data.

  Further preferably, the already established session is a voice call session using a voice call service of Internet telephone, and performs communication for requesting establishment of a new session to a communication partner of the already established session. Thus, the newly established session communicates still image, moving image, or other application usable data that cannot be exchanged via the voice call session.

  Therefore, when these devices are used, when using a voice communication (voice call) service using the VoIP technology on the Internet, a still image, a moving image, or the It is possible to perform communication using more media by exchanging all application data available on the device.

  Similarly, the same thing as said apparatus is implement | achieved by introduce | transducing and executing the program containing each function which implement | achieves said each means using the hardware which a computer possesses. Such a program may be introduced by downloading using a network or the like, or may be recorded on a computer-readable recording medium, distributed by the recording medium, and introduced to the computer.

  In the present invention, a terminal device or a program uses the present invention even for data that cannot be transmitted / received in addition to the session, in contrast to a function that establishes a session between devices or programs and performs data transmission / reception. As a result, data other than that transmitted / received by the main function can be transmitted / received to / from a communication partner of the main function and used as a richer function.

  For example, even if only a session that transmits / receives only a specific data type can be established via a server provided by the service provider, the service is provided based on information obtained when a session that transmits / receives only the specific data type is established. A session can be established directly with the other party without going through a server provided by the user. In a session established directly with the other party, any data other than the specific data type can be exchanged.

In addition, even when a session establishment request is received directly without going through the server provided by the service provider, the association with the session through the server provided by the service provider can be confirmed, so a new session can be established with peace of mind. be able to.
In addition, the side that directly sends a session establishment request without going through the server provided by the service provider can confirm that a new session has been established via the session through the server provided by the VoIP service provider. You can use a new session with care.

  In addition, a session established directly without going through the server provided by the service provider is valid only while the session through the server provided by the service provider exists, and provided by the service provider without knowing it. Data is not transmitted / received using a session that does not go through the server.

  Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

(Embodiment 1)
FIG. 1 shows a functional configuration of an Internet telephone service utilization apparatus 100 which is an example of an information communication apparatus using the present invention. As will be described below, the present invention can also be realized by a program for operating the information communication apparatus on a computer or a storage medium storing such a program.

  The voice input unit 101 includes a voice input microphone built in the Internet telephone service utilization apparatus 100, and accepts a user's voice input. The received voice data is transferred to the data transmission / reception unit 108, and the encoded data is sent to the other party's device using the communication unit 105.

  The voice output unit 102 includes a speaker built in the Internet telephone service using apparatus 100 for outputting voice, and the data transmission / reception unit 108 decodes data received from the other party's apparatus via the Internet telephone service and outputs the voice. To do.

  The information display unit 103 includes a liquid crystal panel built in the Internet telephone service utilization apparatus 100 and displays information such as text and images to the user under the control of the service application unit 110.

  The information input unit 104 is a component for input including input by pen touch using the keyboard built in the Internet telephone service utilization apparatus 100 and the liquid crystal panel, and uses this to input a telephone number when making a call. Or perform operations related to data exchange of text and images other than voice calls.

  The communication unit 105 is a component for performing communication with an external network including a network interface, and is built in the Internet telephone service utilization apparatus 100.

  The Internet telephone service using apparatus 100 has a function of performing a voice call using the Internet using an Internet telephone service. The user data holding unit 109 is stored in the user data holding unit 109 by the service application unit 110. User data managed on (not shown) can be exchanged with a call partner.

  In order to implement such functions, all functions of the session establishing unit 106, the session information holding unit 107, the data transmitting / receiving unit 108, the user data holding unit 109, the service application unit 110, and the second session establishing unit 111 are included. The communication software 112 realizes the function using the hardware of the apparatus.

  The communication software 112 may be software pre-installed in the Internet telephone service utilization apparatus 100, or may be an application program that can be installed and used in a portable terminal such as a general-purpose personal computer apparatus or PDA. Good. In some cases, a part of the software is incorporated in the Internet telephone service using apparatus 100 and installed to operate as a program using its application program interface (API).

  The session establishment unit 106 establishes, changes, or establishes a connection (hereinafter often referred to as “session”) for communicating data to an external network using the communication unit 105 in accordance with an instruction from the service application unit 110. Negotiations such as termination are performed.

  The session establishment unit 106 performs session control together with a second session establishment unit 111 described later. In the present embodiment, signaling according to SIP (Session Initiation Protocol) standardized by IP (Internet Protocol) is performed. The session establishment unit 106 notifies the session information holding unit 107 of the negotiation result and information related thereto.

  The session establishing unit 106 has a function of receiving an incoming voice call. When session establishment unit 106 accepts a request for session establishment, session establishment unit 106 informs service application unit 100 that the call has been received. The service application unit 100 notifies the user that a voice call has been received by displaying a ring tone and an incoming call screen, and when the user accepts the incoming call, the service application unit 100 returns a session establishment response to the session establishment unit 106. answer. When a sub-session establishment request to be described later is accepted, the session establishment unit 106 notifies the service application unit 100 that an incoming call for sub-session establishment has been received, and the service application unit 100 similarly performs the same as the above-described normal session. When a user performs an operation for accepting sub-session establishment, the sound is transmitted to the user using sound or GUI (Graphical User Interface), and the session establishment unit 106 is informed of that. The session establishment unit 106 returns a response to the caller using the communication unit 105 and adds the established session information to the session information holding unit 107. When it is a sub-session establishment request, the established session information is added to the session information holding unit 107, and the requested main session confirmation data is converted to generate a DTMF (Dial Tone Multi Frequency) sound. Send using the specified main session. The main session confirmation data will be described in detail later.

  As described above, the session information holding unit 107 receives the result of the SIP signaling performed by the session establishing unit 106, and when the communication software 112 performs connection processing accordingly, information on the communicable session is stored in the storage device. Record and manage. The information regarding the session includes the address and port of the data transmission destination acquired from the other party by signaling using SIP. In addition, information on the relationship between sessions is also included, and when the association between sessions is notified from a second session establishing unit 111 (to be described later), information related thereto is added to, updated on, information about the session and held.

  The data transmission / reception unit 108 is a session established under the control of the service application unit 110 by the session establishment unit 106 or a second session establishment unit 111 (to be described later), and the information is held and managed by the session information holding unit 107. In accordance with the information, voice communication data and other communication data are transmitted / received using the communication unit 105, and the user data is provided to the other party according to the user's instruction or from the other party via the service application unit 110. Display the data.

  The user data holding unit 109 holds and manages user data on a storage device, and manages application data such as word processors and spreadsheets as files from data such as images, videos, and texts.

  The service application unit 110 is an application program including a voice call and a graphic user interface for exchanging information data with the other party during the call. In addition to the user interface for voice call functions such as making and receiving calls using the Internet phone service, the user can select the data to be shown to the other party during the call or vice versa. It has an interface for browsing or selecting data to be acquired from the received data, and data is negotiated using the session establishment unit 106 according to the user's input and data is transmitted using the data transmission / reception unit 108. Send to the other party or display the received data to the user.

  If the second session that communicates data other than the data communicated in the first session is not associated with the first session, a normal session may be established using the session establishing unit 106. . For example, when voice data is exchanged in a first session using a voice telephone service, but one side introduces video and provides video data, the first voice session and the second voice session are provided. Each video viewing session can be managed independently.

  The second session establishment unit 111 performs signaling for establishing a session for transmitting / receiving data other than voice to / from the other party during a voice call, and is a part of the configuration for session control of the present invention.

  In the present invention, the first session established first is called a main session, and the second session communicating data other than data communicated in the first established session is called a sub-session. The sub session is managed in association with the main session. That is, a new sub-session can be established only while the main session is established. When the main session is disconnected, all sub-sessions related to the main session are disconnected. Conversely, even if the sub-session is disconnected, the associated main session is not disconnected. In addition, a sub-session is never established when the main session is not established.

  In this embodiment, based on SIP, for a voice call that is a main session, establishment of a session (sub-session) associated with the main session is requested in order to transmit / receive other information during the voice call. . At this time, the sub-session establishment request is not a connection request message according to normal SIP, but a sub-session establishment request with the standard extended based on SIP.

  In this embodiment, the points extended for session management include the addition of an identifier (session identification information) of a voice call session as a main session as main session designation information, and management as a sub-session. The main session confirmation data for confirming the subsession is added to confirm that it is to be performed. The sub-session establishment request is transmitted to the IP address of the voice data transmission destination in the already established voice call session. Since the IP address of the voice data transmission destination that has already been established is held in the session information holding unit 107, it can be acquired from there. When the second session establishment unit 111 transmits the subsession establishment request, the second session establishment unit 111 checks the reception data in the session designated by the main session designation information and checks whether the DTMF sound corresponding to the main session confirmation data is received. . If a corresponding DTMF sound is detected, the session information holding unit 107 is notified to associate the main session with the sub-session, and managed in association with each other. That is, it includes a function as a sub-session confirmation unit that registers a sub-session as a session subordinate to the main session.

  As a simple example, if a sub-session is established without confirming the detection of the DTMF sound, it may be associated and registered only by that.

  FIG. 2 schematically shows signaling and session transmission / reception between devices in a scene where sub-data related to a call is transmitted / received together with a voice call using the Internet telephone service utilization apparatus 100 shown in FIG. It is a figure.

  Since signaling related to session establishment is performed by message transmission / reception in accordance with SIP, a session establishment request message is represented by “INVITE”. Further, since the sub-session establishment signaling is an extension of SIP, it is expressed as “SUB-INVITE”. A thin arrow indicates signaling for session establishment processing, and a thick arrow indicates an established session.

  Each process will be described with reference to FIG.

  i) The Internet telephone service utilization device 202 on the calling side performs the calling process via the Internet telephone service server 201. Here, an SIP INVITE message designating the telephone number of the other party is transmitted to the Internet telephone service server 201.

  ii) Internet telephone service server 201 includes the function of a SIP proxy server, searches the database for the IP address of the user terminal corresponding to the telephone number of the INVITE message, and uses the SIP INVITE message as a SIP proxy for that address. Do the transfer.

  iii) Internet phone service utilization device 203 on the receiving side, when receiving the INVITE, informs the user with a ring tone and an incoming call display, and when the user presses the “call” button on the GUI, a response “OK” for establishing a session is sent to the Internet. Return to the telephone service server 201.

  iv) The Internet telephone service server 201 transfers a response (“OK”) to the SIP INVITE message transferred to the Internet telephone service using apparatus 203 to the calling Internet telephone service using apparatus 202 as a SIP proxy server.

  vi) When the Internet telephone service using apparatus 202 receives OK, a voice call session can be established, and voice data is transmitted / received to / from the Internet telephone service using apparatus 203 using the session.

  vii) The internet telephone service using apparatus 202 considered sharing the data it has with the other party during the call. When the data to be shared is specified and the “data transmission” button is pressed, a request (SUB-INVITE) for establishing a subsession is directly transmitted to the voice data transmission destination device of the other party. In this example, the sub-session is established from the Internet telephone service utilization apparatus 202 side, but of course, the same can be done from the Internet telephone service utilization apparatus 203.

  viii-1) Internet telephone service using device 203 returns “OK” in the same way as SIP signaling, and viii-2) main session confirmation data in a subsession establishment request (SUB-INVITE) for a voice call main session DTMF sound generated by converting is transmitted in the main session.

  As a result, a sub-session is established and managed as a session supplementing the main session on both sides, and data other than voice (ix) can be exchanged between both devices using this session.

  FIG. 3 is a sequence diagram showing the contents outlined in FIG.

  At the start of a voice call, a telephone number “050-1234-5678” is designated to the Internet telephone service server 201 and a SIP INVITE message (F301) is transmitted to make a call.

  The Internet telephone service server 201 searches and acquires the current IP address (12.34.56.72) of the user terminal corresponding to the telephone number “050-1234-5678”, and receives the INVITE message ( F302) as a SIP proxy. When the Internet telephone service using apparatus 203 accepts the received INVITE (F302) and establishes a session, it returns OK (F303) via the SIP proxy, and the Internet telephone service server 202 receives OK (F304).

  As a result, a voice call session is established, and information for transmitting / receiving voice data (codec, data transmission destination IP address, port number) is passed along with OK (F303, F304), and voice data is transmitted between devices. Are directly transmitted and received (S1).

  The Internet telephone service using apparatus 203 knows the IP address (12.34.56.72) of the Internet telephone service using apparatus 203 as information on the transmission destination of the voice data in the established voice call session.

  After that, when you want to show the photo to the other party during a voice call, if you specify the photo data, a request for establishing a sub-session is made directly to establish a second session for exchanging that data. A sub-session establishment request (F305) is transmitted to the data transmission destination address (12.34.56.72) of the main session. At this time, the message includes the session identifier of the main session as main session information, and sub session association confirmation data (main session confirmation data) set for each request as information.

  A specific message example exchanged in FIG. 3 will be described later with reference to FIGS.

  When the Internet telephone service using apparatus 203 accepts the exchange of the sub data, it returns OK (F306) and transmits the DTMF sound generated from the confirmation data in the main session S1 (F307). Management is performed in association with the session S1. When the Internet telephone service using apparatus 202 receives the DTMF sound in the main session S1, it confirms that S2 has surely associated with the other party the main session S1, and the sub session S2 itself associates with S1 as the main session. And register to manage.

  FIG. 4 is a process flow diagram in the apparatus on the side (subsession calling side) requesting connection of the subsession. In FIG. 2, the internet telephone service utilization apparatus 202 corresponds to this. When the Internet telephone service using apparatus 202 is in a voice call with the Internet telephone service using apparatus 203, the user selects data to be transmitted to the other party using the application GUI (S401).

  The service application unit 110 inquires whether the selected data type can be added to the session currently communicating with the session establishing unit 106, in this case, a voice call session (S402), and can be added from the result. Whether or not (S403).

  The session establishment unit 106 can determine whether or not it can be added by performing signaling according to SIP.

  If it can be added to the current session, the data transmitting / receiving unit 108 performs signaling according to SIP, adds the selected data transmission / reception to the session, and updates the session information of the session information holding unit 107 according to the result (S404). .

  If the session cannot be added to the current session, the second session establishment unit 111 is requested to establish a subsession for communicating selection data. The second session establishment unit 111 acquires the address of the data transmission destination from the session information currently being communicated from the session information holding unit 107 (S405).

  The session information will be described later with reference to FIGS.

  A sub-session establishment request message (sometimes called a signal) is transmitted as a session for communicating the selected data to the acquired address. Specify the session ID of the currently communicating session in the sub-session establishment request (the call ID at the time of the connection request is used as the session ID after connection), and at the same time generate and attach the main session confirmation data ( S406).

  After the transmission, monitoring of a response to the request and reception of sub-session confirmation data in the main session is started (S407). Messages (signals) transmitted and received at the time of session establishment request and subsession establishment request will be described later with reference to FIGS.

  The second session establishment unit 111 receives a response to the transmitted subsession establishment request (S408), and confirms whether the session has been established (S409). If it can be established, the established session information is provisionally registered in the session information holding unit 107 (S410).

The temporary registration of session information will be described with reference to FIG. (In the implementation without confirmation, the association is registered in the session information holding unit 107 and the session information is updated here.)
The second session establishment unit 111 continues to monitor the data received by the communication unit, and monitors whether DTMF sound data corresponding to the main session confirmation data attached to the transmitted subsession connection request is received for a predetermined time. (S411), it is confirmed whether the corresponding DTMF sound has arrived (S412), the association is registered in the session information holding unit 107, and the session information is updated (S413). If the DTMF sound does not arrive after a predetermined time, or if the data obtained by converting the received DTMF sound does not match the main session confirmation data, the session information is deleted, the session is disconnected, The user is informed via the user interface of the application unit 110 that communication has failed (S414).

  There may be a case in which the response in the main session is not confirmed, and only the signaling is used as a sub-session so as to be associated and registered only on the calling side, or not associated.

  FIG. 5 is a processing flow of the apparatus that accepts the sub-session connection.

  A device having a function of accepting a subsession connection also activates a process of accepting a subsession establishment request when the communication software is activated, and starts reception monitoring of the subsession establishment request with the reception data of the communication unit 105 (S501). Normally, this process is always operating, but it is confirmed whether there is an event for canceling acceptance of a sub-session by user input or the like (S502), and if it matches, the process is terminated (S502).

  While there is no cancellation event, the received message is extracted (S503), and it is confirmed whether it is a sub-session connection request (S504).

  If it is not a sub-session connection request, it is ignored and monitoring is continued (S504).

  On the other hand, when the sub-session connection request is received, the user's judgment input as to whether or not to accept and notify the user with a GUI or ringtone via the service application unit 111 is received (S505).

  The user's input is confirmed (S506), and if the connection is OK, a connection acceptance response is returned (S508).

  If connection rejection is input, a connection rejection response is returned (S507). After returning a connection acceptance response, main session confirmation data is extracted from the sub-session establishment request, converted into DTMF sound, and transmitted in the designated main session in the sub-session establishment request (S509). Then, the established session is registered in the session information holding unit 107 as a sub-session (S510). It should be noted that the main session confirmation data return function can be omitted in the case where the embodiment does not require session association.

  FIG. 6 is an external view of the Internet telephone service utilization apparatus 100 according to this embodiment.

  The internet telephone service utilization apparatus 100 includes a liquid crystal panel 601 and allows input using the touch pen 602 on the liquid crystal panel. In addition, a hard key 603 for inputting numbers such as telephone numbers is provided. A microphone 604, a speaker 605, and an earphone connection jack 606 are provided on the apparatus main body, and voices are input / output using these. There is also an external antenna 607 connected to a built-in wireless LAN (Local Area Network) communication interface.

  FIG. 7 shows a hardware configuration of the Internet telephone service utilization apparatus 100.

  In FIG. 7, a communication unit 701 is hardware of a communication interface including a wireless LAN function, and communicates with the outside through an external antenna included. The CPU 702 is for performing arithmetic processing based on software.

  The flash memory 703 is used as a memory for executing user data and software. A ROM (Read Only Memory) 704 stores data such as embedded software.

  The display input / output unit 705 is a liquid crystal panel and its peripheral hardware, and accepts data display and panel touch input. The audio output unit 706 is a speaker and its peripheral hardware, and performs audio output. The voice input unit is hardware for voice input including a microphone. The key input unit 708 is for accepting key inputs on and around the hard key.

  FIG. 8 to FIG. 11 show examples of SIP messages, which express a message INVITE at the time of establishing an Internet standard SIP session and a response (“200 OK”) at the time of establishing the session. It should be noted that some information in the message unnecessary for the description of the present invention is omitted. These messages take the case of the connection described in FIG. 2 and FIG. 3 as an example.

  FIG. 8 shows an SIP message (signal) transmitted from the Internet telephone service using apparatus 202 to the Internet telephone service server 201 when requesting establishment of a voice call session which is the main session in FIG.

  From the message in FIG. 8, the Internet telephone service server 201 having a role as a SIP proxy sends the IP address (12.34) of the Internet telephone service using apparatus 203 which is a user terminal corresponding to the destination telephone number (050-123-4567). .56.72) is solved, and the message shown in FIG. Requests a session for transmitting and receiving GSM codec data with a sampling rate of 8000 Hz using RTP / AVP (Realtime Transport Protocol / Audio / Video profile) protocol for audio data, and uses the Internet telephone service utilization apparatus 202 (12.34. 56.71) declares that port 6001 will be used.

  The “200 OK” message in FIG. 10 follows the same route as the request, and reaches the connection request source Internet telephone service utilization apparatus 202 as the “200 OK” message in FIG. 11 via the SIP proxy of the Internet telephone service server 201. The negotiation is complete and the session is established.

  In the present embodiment, the present invention is realized by defining a specification for adding information for establishing a sub-session subordinate to the connected session of the present invention based on SIP.

  12 and 13 are examples of sub-session connection messages.

  In this embodiment, the standard SIP protocol is used, but the function of the “Call-Info” header defined in the SIP message is extended in order to add the function of sub-session connection. Originally, the “Call-Info” header is used to transmit information about a user on the calling side at the time of transmitting a request and a purpose of use at the time of transmitting a response by specifying a purpose of use. For example, it can be used for notifying image data to be used for an icon on the receiving side by designating “icon” as the purpose of use and transmitting information on a URL indicating the caller. “Sub-session connection” is added as a purpose of use, and a message is sent together with information on the main session and association by the call identifier. The format is specified as follows.

Call-Info: <main: (Main session Call-ID)> purpose = SubSession,
<code: (response sending code)> purpose = RequestCode,
<sync: (sync media during main session)> purpose = Sync
“Purpose = SubSession” is indispensable when a sub-session connection is requested.

Information of “purpose = RequestCode” is optional information that is attached when requesting the other party to confirm the sub-session association by a code reply. In addition, information to be added when there is a medium to be synchronized in the main session is information specified by “purpose = Sync”, which is also an option.
Specifically, in FIG. 12 and FIG. 13, the following information is attached.

Call-Info:
<main: 123123123123@12.34.56.71>; purpose = SubSession,
<code: 7777@12.34.56.71>; purpose = RequestCode
In the message of FIG. 12, this is a request to establish a session to be associated with the session having the call-ID of 123123123123@12.34.56.7, and if it is associated, the code of 7777@12.34.56.71 is returned. Demands.

  The response message in FIG. 13 includes the call-ID of the associated main session and a specified request code in the reply to indicate that it is a reply that accepted the above two requests. The request code is sent even if it is converted into data that can be sent in the main session.

  In the present embodiment, the above function expansion is defined for SIP. However, the present invention is not limited to the definition of this function expansion format. In other words, it is possible to negotiate including information specified for data transmission / reception between the main session and sub-session, such as session specification information for session association, information for confirming the association, whether synchronization is necessary, etc. Any other method can be used.

  FIG. 14 and FIG. 15 are examples of session information data, which is information relating to the session being connected. Session information data is data that is held and managed in order to manage a session in the apparatus.

  The data shown in FIG. 14 is data for holding information on a session established for a normal voice call using SIP using a session establishment unit. As a session identifier (session ID), a call-ID (Call-ID) at the time of a connection request is used, and information on data transmission / reception in this session is recorded in Media. In the example of FIG. 14, audio data is communicated using RTP / AVP with GSM codec data having a sampling rate of 8000 Hz. This is information about a set of address and port number for receiving both data. Normally, information “relation” for associating a session is set to main.

  FIG. 15 shows information on a session established as a subsession. In the case of a subsession, when the caller receives a “200 OK” response, “relation” is set as tmp, but the confirmation data is received and it is recorded as a subsession. .

  In the case of FIG. 15, this represents a sub-session of a session having ID 123123123123@12.34.56.71.

  When the session establishing unit 106 receives a signal or the like and disconnects the session, the session information holding unit 107 is referred to and the session information of the session to be disconnected is requested to be deleted. If the session establishment unit 106 is instructed to perform signaling for disconnecting the registered sub-session by specifying the ID of the session to be disconnected in “relation”, and if it is notified that the session has been disconnected, the session information Is deleted. By performing such processing, when the session instructed to be disconnected is a main session, the main session and all associated sub-sessions are disconnected. If the session instructed to be disconnected is a sub-session, there is no session registered for that sub-session, so only the sub-session is disconnected, but the main session is not disconnected. .

  16 to 18 are diagrams for explaining the GUI of the application.

  FIG. 16 is for selecting data to be exchanged with the other party in this device. Still image data such as “4/12 soccer game photo” and “4/19 piano recital photo” , "4/19 Piano presentation video" video data, BGM music data, office software files such as "4/20 meeting materials" can be selected. These data can be stored as a file system on the flash memory, and can be given a title and registered in the service application unit.

  FIG. 17 shows the apparatus of the other party whose subsession has been established based on the “4/12 soccer game photo” selected in FIG. 16, and obtains and displays thumbnail data corresponding to each photo data. . When a thumbnail is selected, actual photo data can be acquired and displayed.

  FIG. 18 shows a display screen when video data is selected. The video data transmitted on the video playback screen is encoded and played back.

  As shown in FIG. 18, when a plurality of streaming data is exchanged so as to add a video image to a voice call, in order to synchronize data, when establishing a sub-session, it is synchronized with data communicated in the main session. There is a second embodiment that makes it possible to request that The second embodiment is substantially the same as the first embodiment shown in FIG. 1 and functions to control the output of session information held in the session information holding unit 107 and data transmitted / received using the session information. Is added to the service application unit 110. The connection procedure is the same as that in the sequence diagram shown in FIG. 3, and the contents of the INVITE message for sub-session connection are different.

  FIG. 19 is an example of an INVITE message for establishing a subsession for exchanging moving image data in synchronization with audio data in the subsession, instead of the INVITE message in the subsession shown in FIG. Compared with the message example of FIG. 12, the following information is added to the Call-Info header.

<sync: audio 6001 RTP / AVP 4>; purpose = Sync
This means that the data transmitted in this session is requested to be output in synchronization with the audio data received at port 6001 by the main session.

  When the session is established according to the message of FIG. 19 and the synchronization request is approved, the audio data transmitted to the port 6001 in the main session and the video data of the payload type 31 transmitted in this session (H. 261 encoding data) is expected to be output in synchronization.

  The session information for the sub-session established based on the request message in FIG. 19 is as shown in FIG. 20, and is held in the session information holding unit 107. The “Relation” information in the session information of FIG. 20 needs to be synchronized with the specified audio data in addition to the information indicating that it is a sub-session for the specified main session (sub (123123123123@12.34.56.71)). Information (sync (audio ((GSM / 8000, RTP / AVP), (12.34.56.71:600112.34.56.72:6001))) indicating that there is included is included.

  The data transmitting / receiving unit 108 outputs the video data received at the 6002 port in synchronization with the audio data received at the 6001 port from the session information of FIG. For this purpose, the RTP data packet received at each port is buffered, and the video data sent at the same time as the time when the data is written into the decoder buffer of the audio codec is written into the decoder buffer of the video codec. However, if the difference in the estimated time required for decoding including buffering exceeds the preset value from each codec, parameter, etc., the shorter processing data will be delayed in consideration of the difference in required time. Adjust by writing to the decoder buffer. Each decoded data is transferred to the audio output unit 101 and the information display unit 103, and is output from each.

  The above data synchronization method is merely an example. Other time to synchronize a plurality of data, such as including the time information in the media data itself, not the RTP packet transmission time, and synchronizing it when it is decoded and delivered to the audio output unit 101 or the information display unit 103 It is also possible to use a technique.

  As can be seen from the examples described above, by using this patent, other data can be exchanged in addition to voice communication, which is the main communication, and information such as images and videos can be transferred to voice conversation. Added communication becomes possible.

  Also, by changing the service application unit 111, processing using GUI and data can be changed to various devices, which can be said to be all part of the present invention.

(Second Embodiment)
As information for associating the main session with the sub-session, it is possible to associate without adding the session identification information of the main session in the message exchanged in the sub-session.

  For example, when the establishment of a new session is requested during a voice call for a voice call that is the main session, the new session is a sub-session of the voice call with reference to the information included in the request for establishment of a new session. It is a method to consider that. Specifically, in a new session establishment request, (1) the source address of the session establishment request matches the peer address of the already established session, (2) the destination address of the session establishment request is already established. (3) The service requested by the new session establishment request (for example, image transmission / reception service) is set in advance in the own terminal as a service to be handled in the sub-session. If a condition such as “Yes” is satisfied, the new session is regarded as a sub-session of a voice call.

  In this embodiment, it is not necessary to consider the session identification information of the main session in the message exchanged in the sub-session.

(Embodiment as a program)
Although the embodiment of the apparatus of the present invention has been described above, a program having a function corresponding to the communication software 112 is also a part of the present invention (information communication program), and a recording medium storing the program is also included in the present invention. . Even in a device capable of installing the program later (for example, a portable terminal such as a PC or PDA), the communication unit, the input / output unit such as voice and display are replaced with those of the device, and the present invention is implemented as a program. be able to.

(Application example of the present invention)
Examples that can use the present invention include the following. However, the scope of the present invention is more general and is not limited to these examples.
1) During a call, it becomes a topic of the other day's soccer game, and the other party is shown an electronic album of digital camera photos taken at that time. The other party can get the data by selecting what he wants to see and what he wants.
2) An employee engaged in sales activities outside the company reported a telephone call. When asked about the current sales performance and inventory status, select the latest sales data and inventory data files in the company and provide them to the other party. While looking at the same material on both sides, if there is a question, you can use the data while guiding where it appears in the material.
3) During the phone call, I was told that I was going to buy a new video camera. You can send a photo of the candidate model and ask what opinions it should be. Specifically, a mark is dynamically added to a part of a photograph, and communication such as “This part is cool” is performed that cannot be exchanged only by voice.

  In addition, although the main communication is performed by voice call using the Internet telephone service, it is of course not limited thereto, and can be used for adding functions to all communication services.

  FIG. 21 and FIG. 22 are used to illustrate visual communication in which video is added to voice communication using the present invention.

  As a configuration, one is a PC 2102 connected to the Internet using ADSL, FTTH, or the like. Client software is installed on the PC 2102, and a voice Internet telephone using the Internet telephone service 2101 is possible. It is also possible to use the Internet phone function of the instant message client.

  On the other hand, as a connection partner, a device on the home LAN is connected to the Internet via the broadband router 2103. The VoIP telephone 2104 uses an Internet telephone service 2101 via a broadband router. The broadband router 2103 uses a UPnP IGD (Universal Plug and Play Internet Gateway Device) to allow a device having a local address in the home to be accessible from outside the home. This is the same as enabling voice chat when a Windows (R) Messenger on a home network uses a UPnP-compatible router.

  In such a configuration, the PC 2102 and the VoIP phone 2014 perform signaling for a voice call session via an Internet phone service (a server including a SIP proxy function), and as a result, send and receive voice data to make a voice call. Realized.

  FIG. 22 shows a case where a voice call session is established as shown in FIG. 21 and, for example, an image of a camera connected to a PC is transmitted to a call partner to function as a TV phone, or a digital camera in the PC is connected. Send photo data and application data.

  The network TV is a TV having a communication function that is connected to a network and has built-in communication software for displaying streaming moving images and digital photograph images received in an established session. The communication function may be realized in the form of a communication adapter. In this case, when a camera image or a digital camera image in the HDD is selected from the client on the PC side and a transmission instruction is made, connection request signaling for video transmission is performed as a sub-session related to a voice call to the network TV 2105, and as a result, It is possible to communicate data in an established session and show an image etc. to the other party. By using the present invention, this scene shown in FIGS. 21 and 22 can be realized. The device configuration and data to be communicated are merely examples, and the same can be realized in many similar scenes.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1 shows a functional configuration of an Internet telephone service utilization apparatus 100 as an embodiment of an information communication apparatus of the present invention. FIG. 2 illustrates signaling and an established session for establishing a connection for performing two voice and data communications using an Internet telephone service utilization apparatus. FIG. 3 is a connection sequence diagram for establishing the connection of FIG. 2. It is a flow at the calling side of the process of establishing a second session for data communication. It is a flow on the called side of processing for establishing a second session for data communication. It is an external appearance of the apparatus in the Example of this invention. It is a hardware block diagram in the Example of this invention. It is a figure explaining the call signal for voice calls transmitted to a SIP proxy. It is a figure explaining the calling signal transferred by the SIP proxy. It is a figure explaining the "200 OK" signal returned to a SIP proxy when a callee accepts session establishment. It is a figure explaining the "200 OK" signal which a SIP proxy transfers to a call origination apparatus. It is a figure explaining the request signal for subsession establishment. It is a figure explaining the response signal with respect to the request | requirement for subsession establishment. It is a figure explaining session information data. It is a figure explaining the session information of a subsession. It is an example of the screen which selects the data added by communication. It is an example of the screen which displays and selects the thumbnail of the photo data acquired by the side which received the subsession data. It is an example of the screen which is acquiring and reproducing | regenerating video data by a subsession. It is an example of a sub-session establishment request message for negotiating to output audio data of a main session and video data of a sub-session in synchronization. It is session information of the subsession established by the message of FIG. It is a figure which shows the scene which performs a voice call by the structure which can add a video. It is a figure which shows the scene which performs the visual communication which established the subsession which transmits / receives an image | video from the state of the voice call shown in FIG. 21, and added the image | video to audio | voice communication.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 Internet telephone service utilization apparatus, 101 Voice input part, 102 Voice output part, 103 Information display part, 104 Information input part, 105 Communication part, 106 Session establishment part, 107 Session information holding part, 108 Data transmission / reception part, 109 User data Holding unit, 110 Service application unit, 111 Second session establishment unit, 112 Communication software.

Claims (23)

Session control means for establishing a session as a connection for performing data communication with a communication partner apparatus and controlling the session;
Session information holding means for holding and managing information on the session established by the session control means;
Using the information held by the session information holding means, and data transmitting / receiving means for transmitting and receiving data in the established session,
The session control means establishes a new session by performing communication for requesting session establishment to the address acquired as the data transmission destination address when the session is established with respect to the communication partner of the already established session. An information communication device characterized in that Session control means for establishing a session as a connection for performing data communication with a communication partner apparatus and controlling the session;
Session information holding means for holding and managing information on the session established by the session control means;
Data transmission / reception means for transmitting / receiving data in an established session using information held by the session information holding means, the session control means is an address acquired as a data transmission destination address of the already established session Communication is performed to request establishment of a new session in which the session specified by the session identification information is designated as a main session, a new session subordinate to the session is established, and the session information is retained. An information communication apparatus, characterized in that means is associated with and managed as a new session subordinate to the session. Session control means for establishing a session as a connection for performing data communication with a communication partner device and controlling the session;
Session information holding means for holding and managing information on the session established by the session control means;
Data transmitting and receiving means for transmitting and receiving data in the session established using information held by the session information holding means,
The session control means receives a communication requesting establishment of a new session specifying the session specified by the session identification information of the already established session as the main session, and specifies the new session. An information communication apparatus characterized in that the session information holding unit manages the session information in association with a session subordinate to the session to be. Communication data requesting session establishment specifying the subject session is a main session that is returned to the requesting establishment device when a new session established from the request is associated with the subject session. Including verification data,
Sub-session confirmation means for confirming that the newly established session is correctly associated with the designated principal session by detecting reception of the main session confirmation data in the principal session The information communication apparatus according to claim 2, further comprising:   When the session control means associates a new session established from the request with a session establishment request designating the principal session, the session control means is returned to the requesting apparatus of the session establishment. An association confirmation data adding means for adding main session confirmation data that expects the main session confirmation data to be received, and by detecting the reception of the main session confirmation data in the main session, a newly established session is designated The information communication apparatus according to claim 2, further comprising sub-session confirmation means for confirming that the session is properly associated with the main session. The communication data requesting the establishment of a new session includes main session confirmation data for notifying the main session of the newly established session based on the communication data requesting the establishment of the new session,
When the session control unit causes the session information holding unit to manage a new session in association with the main session, the data based on the main session confirmation data is transmitted in the main session in the related main session. 4. The information communication apparatus according to claim 3, further comprising a main session confirmation / reply means for performing. The session control means includes a session newly established from a communication requesting establishment of a new session specifying the session specified by the session identification information of the already established session as the principal session, Including a main session confirmation data extraction means for extracting main session confirmation data expected to be returned when linked,
When the session control unit causes the session information holding unit to manage a new session in association with a main session, the session control unit transmits data based on the main session confirmation data as main session data in the associated main session. The information communication apparatus according to claim 3, further comprising a main session confirmation reply unit. The main session is for communicating sound data, and the main session confirmation data is a character string generated whenever necessary,
The sub-session confirmation means receives the designated main session confirmation data as DTMF sound data, and detects the DTMF sound data in the main session, thereby confirming that the new session is correctly associated. The information communication apparatus according to claim 4 or 5. The main session is for communicating sound data, and the main session confirmation data is a character string generated whenever necessary,
8. The information communication apparatus according to claim 6, wherein the main session confirmation reply means returns DTMF sound data generated from a character string of the main session confirmation data in the main session.   The session control means disconnects the first session when the session information holding means is requested to disconnect the second session managed in association with the main session of the first session. The information communication apparatus according to claim 2, wherein the second session requested above is disconnected. Data synchronization input / output means for inputting or outputting data in synchronization between specified data is provided.
The session control means synchronizes with the communication data of the newly established session in the communication of the request for establishing the new session managed in association with the currently established session, or the response to the request. Synchronization data designation information adding means for adding information specifying communication data in the established session,
The information communication apparatus according to any one of claims 2 to 10, wherein the data synchronization input / output unit performs input / output of communication data of a session in synchronization according to information related to the data synchronization. The already established session is a voice call session using an Internet phone voice call service;
By performing communication requesting the establishment of the new session to the communication partner of the already established session, the newly established session cannot be exchanged via the voice call session. Alternatively, the information communication apparatus according to any one of claims 1 to 11, wherein usable data of another application is communicated. A program for causing a computer to execute an information communication method,
A session control step for causing a computer to establish a session as a connection for performing data communication with a communication partner device and to control the session;
A session information holding step for causing the computer to hold and manage information on a session established by the session control function;
A data transmission / reception step for causing the computer to perform data transmission / reception in an established session using information held by the session information holding function,
The session control step further causes the communication partner of the already established session to perform communication for requesting the computer to establish a session with respect to the address acquired as the data transmission destination address when the session is established. An information communication program comprising the step of establishing A program for causing a computer to execute an information communication method,
A session control step for allowing a computer to establish and control a session as a connection for performing data communication with a communication partner device,
A session information holding step for causing the computer to hold and manage information on a session established by the session control function;
A data transmission / reception step for causing the computer to perform data transmission / reception in an established session using information held by the session information holding function,
The session control step further requests the establishment of a new session specifying the session specified by the session identification information as the main session for the address acquired as the data transmission destination address of the already established session. Including establishing a new session subordinate to the session by causing the computer to communicate, and further causing the computer to associate and manage the session as a new session subordinate to the session using the session information holding function. An information communication program characterized by A program for causing a computer to execute an information communication method,
A session control step for allowing a computer to establish and control a session as a connection for performing data communication with a communication partner device,
A session information holding step for causing the computer to hold and manage information on a session established by the session control function;
A data transmission / reception step for causing the computer to perform data transmission / reception in an established session using information held by the session information holding function,
In the session control step, a new session is designated by receiving a communication requesting establishment of a new session that designates the session specified by the session identification information of the already established session as a main session. An information communication program comprising a step of causing a computer to manage by using the session information holding function in association with a session subordinate to the main session. Communication data requesting session establishment specifying the subject session is a main session that is returned to the session establishment requesting device when a new session established from the request is associated with the subject session. Including verification data,
Further comprising a sub-session confirmation step of notifying the computer that the newly established session is correctly associated with the designated main session by detecting the main session confirmation data, The information communication program according to claim 14. The communication data requesting the establishment of a new session includes main session confirmation data for notifying a session that is a subject of the newly established session,
The session control step further causes the session information holding function to manage a new session in association with a main session, and transmits the main session confirmation data or corresponding data to the computer in the related main session. 16. The information communication program according to claim 15, further comprising a main session confirmation reply step. The main session is for communicating sound data, and the main session confirmation data is an arbitrary character string,
The sub-session confirmation step includes a step of receiving the designated main session confirmation data as DTMF sound data and causing the computer to detect the DTMF sound data in the main session. 16. An information communication program according to 16. The main session is for communicating sound data, and the main session confirmation data is an arbitrary character string,
18. The information according to claim 17, wherein the main session confirmation reply step includes a step of returning DTMF sound data generated from a character string of the main session confirmation data to the computer in the main session. Communication program.   When the session control step is requested to disconnect the second session managed in association with the session that is the subject of the first session in the session information holding function, the first session is sent to the computer. The information communication program according to any one of claims 14 to 19, further comprising a step of disconnecting the requested session after disconnecting. A data synchronization input / output step for causing the computer to input or output data in synchronization between specified data;
Communication data requesting establishment of a new session managed in association with a currently established session is a synchronization data designation that designates communication data to be synchronized between the currently established session and a newly established session Including information,
The session control step includes a step of holding on the computer information related to data synchronization between sessions established by the synchronization data designation information;
21. The data synchronization input / output step includes a step of causing the computer to input / output communication data of a session in synchronization according to information related to the data synchronization. Information communication program described in 1.   The already established session is a voice call session using the voice call service of the Internet telephone, and causes the computer to perform communication requesting the communication partner of the already established session to establish a new session, The newly established session causes a computer to communicate still image, moving image, or other application usable data that cannot be exchanged through the voice call session. Information communication program described in 1.   A computer-readable recording medium on which the information communication program according to any one of claims 13 to 22 is recorded.

Images