JP2005064761A - Ip telephone - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the problem related to a conventional IP telephone in which a communication session for voice and video is established while the transmission/reception of text information is not taken into account. <P>SOLUTION: A communication session establishment requirement generator 501 generates a requirement for establishing a communication session including a communication session for transmitting/receiving text information. A communication session establishing part 502 establishes a communication session based on the requirement generated by the communication session establishment requirement generator 501 to allow the transmission/reception of text information. The requirement generated by the communication session establishment requirement generating part 501 may be the one which is described using SDP or extended SDP. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an IP telephone apparatus that performs a call by IP communication.

  With the spread of the Internet, an IP telephone device that makes a call using the Internet protocol (Internet Protocol) has attracted attention (for example, see Non-Patent Document 1).

  Various protocols have been proposed for call control (signaling) methods in IP telephone apparatuses. For example, H.M. 323, MGCP (Media Gateway Control Protocol), SIP (Session Initiation Protocol), and the like have been proposed.

  In particular, SIP is defined as RFC 2543 as an Internet technical standard, and since then it has been revised as RFC 3261 to RFC 3265, and since messages are described in text, it is widely used as a protocol with excellent extensibility. (See Non-Patent Document 2, for example).

  FIG. 18 illustrates a sequence diagram illustrating a state of communication between the calling side and the called side when SIP is used. First, in order to start a call, the calling side transmits an INVITE message to the called side (step S1801). In response to the INVITE message, the called side transmits a Ringing message indicating that the call is being made to the calling side (step S1802). Thereafter, when the called party becomes ready (for example, when the handset is off-hook), an OK message is transmitted to the calling party (step S1803). In response to the OK message, the calling side transmits an Ack message (step S1804), a session for a call or the like is established, and then communication is performed between the calling side and the called side.

  After the communication is performed, for example, when the calling side performs an operation for terminating the call by on-hook or the like, a Bye message is transmitted from the calling side to the called side (step S1805). An OK message is transmitted (step S1806), and the call ends.

  FIG. 19 shows an example of an INVITE message in SIP. Messages based on SIP (hereinafter referred to as SIP messages) can be divided into four parts: a start line, a header field, a blank line, and a body. In the INVITE message illustrated in FIG. 19, the first line is the start line, the second to the tenth lines are header fields, the eleventh line is a blank line, and the subsequent lines from the twelfth line are the body. is there.

  The start line indicates the type of SIP message, the message destination, and the like.

  The header field consists of a line in which a header name and a header value are separated by a colon (“:”), and describes the call control.

  A blank line indicates the end of the header field.

  The body is a part that is added as necessary, and what description rule is based is not particularly defined as a SIP standard. Therefore, in the case of the INVITE message, the communication session is described, but any description can be used for the description of the communication session. Which description rule is used is specified by a header value corresponding to the header name Content-Type in the header field.

  In the case of FIG. 19, since “application / sdp” is specified as the header value corresponding to the header name “Content-Type”, the body is described by SDP (Session Description Protocol) defined by RFC2327 and the like. ing.

  In SDP, a description of a session is performed by listing description information in a format of <type> = <value> for each line. For example, a line “m = audio 5000 RTP / AUP 0” specifies a port number, a protocol, and the like for voice media communication.

Japan Patent Office, "Internet Protocol Telephone (IP Telephone) Technology", June 28, 2002, Internet <http://www.jpo.go.jp/shiryou/s_sonota/hyoujun_gijutsu/ip_tel/mokuji.html> Supervised by Yasuaki Chimura, Toshifumi Murata, "SIP textbook", IDG Japan, May 2003

  However, in the conventional IP telephone apparatus, although a voice or video communication session is established, establishment of a communication session for transmitting and receiving text information has not been considered. In order to send and receive text information, communication must be performed using a communication session different from the communication session started for an IP phone call, and it is necessary to obtain the IP address of the other party, It requires complicated operations such as having to operate other application programs. If the call partner is connected via a router, and the global IP address and private IP address are converted in the router, if the router is not set, the communication of text information In some cases, a communication session cannot be started.

  The present invention establishes a communication session including a communication session for sending and receiving text information so that an IP telephone apparatus using SIP can send and receive text information in parallel with voice and video calls. Is generated, and a communication session is established based on the request.

  In addition, an arbitrary description rule can be used as a request for establishing a communication session, but it may be performed based on SDP.

  The request for establishing the text information communication session may be descriptive information identified by “i” in the SDP.

  The IP telephone apparatus of the present invention may further include a text information transmitting / receiving unit that transmits and receives text information.

  The text information may include any one of text information stored in a file, text information generated by inter-process communication, and text information generated by a keyboard operation.

  In addition, the IP telephone apparatus of the present invention further includes a section for outputting text information, and the text information is output based on the timing of acquiring voice or / and video information by IP telephone communication. Also good.

  In addition, the IP telephone apparatus of the present invention has a section that enables web browsing such as a web page, and a URL input during a call is transmitted as text information, and a web page indicated by the URL However, it may be displayed on the other side.

  The web browsing section converts drawing operations performed on the screen into vector information, transmits the vector information as text information, and is drawn on the other side of the call. Also good.

  Further, when a scroll operation is performed on a portion that enables web browsing, the scroll operation may be transmitted as text information, and the scroll operation may be performed on the other side of the call.

  The IP telephone device of the present invention may be configured to store transmitted or / and received information including text information and reproduce the stored information.

  According to the IP telephone apparatus of the present invention, since a communication session for transmitting and receiving text information is established, it is possible to easily transmit and receive URLs, spelling of foreign languages, difficult kanji characters, and the like. In addition, since it is possible to make a call while browsing the same web page, it is possible to effectively make a meeting. Further, even if the other party is not present, a message can be left like an answering machine. In this case, since the message can display not only voice and video but also information indicated by the URL or include handwritten characters / graphics, a complicated instruction can be given.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to these embodiments, and can be implemented in various modes without departing from the spirit of the present invention.

(Outline of the present invention)
1 to 4 are diagrams for showing an outline of the present invention. The IP telephone apparatus according to the present invention can be realized by a personal computer in which a program is installed, as shown in FIGS. Of course, the IP telephone apparatus of the present invention is not limited to a personal computer, and a screen or a keyboard that can be displayed with a liquid crystal or the like may be connected to a normal telephone apparatus. In addition, the telephone device can be realized by a computer such as a personal computer or PDA that includes a CPU, a memory, a communication interface, and the like.

  In FIG. 1, IP telephone apparatuses 101 and 102 are connected via a communication network 103 such as the Internet. Assuming that a communication session is established between the two IP telephone apparatuses 101 and 102, characters constituting the text information are input to the screen 104 displayed on the IP telephone apparatus 101 using a keyboard or the like. To do. Then, the input text information is transmitted to IP telephone apparatus 102 and displayed on screen 105 provided in IP telephone apparatus 102. Thereby, it is possible to check the spelling of a foreign language or the like indicated by the sound of the voice call.

  In FIG. 2, when a URL is input on the screen 204 of the IP telephone apparatus 201 connected to the communication network 203 such as the Internet, the URL is transmitted as text information to the IP telephone apparatus 202 which is the other side of the call. IP telephone apparatus 202 interprets the URL, requests information such as a web page indicated by the URL, and displays and reproduces the information. Thereby, it is possible to make a call with the IP telephone apparatuses 201 and 202 while browsing the same web page and the like, and information transmission using the Internet can be smoothly performed.

  In FIG. 3, as shown in FIG. 2, a URL is first input from IP telephone apparatus 301, and a web page indicated by the URL is browsed between IP telephone apparatuses 301 and 302. Here, when a drawing operation with a pointing device, for example, a drawing operation (for example, a drag operation) is performed on the web page displayed on the IP telephone apparatus 301 side, the drawing operation is converted into text information. It is converted and transmitted to the IP telephone apparatus 302, and drawing is performed on the display screen 307 (in FIG. 3, "here" is drawn with a cross mark and hiragana by handwriting on the displayed map). The drawing operation can be expressed by, for example, vector information using the coordinate position between the start point and the end point of the drawing operation, and such vector information can be converted into text information. Thus, by reproducing the drawing operation on the screen on which the web page or the like is displayed, for example, it is possible to reliably instruct a route while viewing a map or the like. In addition, an instruction on how to modify the design of the web page, an instruction manual can be displayed as a web page, and the operation of the device can be explained.

  FIG. 4 shows an IP telephone apparatus that stores received information. When the person who operates the IP telephone device 401 on the transmitting side detects that the person who operates the IP telephone device 402 on the receiving side is absent (for example, when a call is made for a certain period of time but does not answer), When an instruction is given by voice or the like while an operation such as displaying a web page or the like is performed on the transmission side, information on the operation, voice and the like are accumulated on the reception side. When a person who operates the IP telephone device 402 on the receiving side performs a reproduction operation later, the reproduction is performed while maintaining the timing when the operation, voice, and the like are accumulated. This makes it possible to leave a complicated instruction even when the receiving side is absent.

(Embodiment 1: mainly corresponding to claim 1)
FIG. 5 illustrates a functional block diagram of the IP telephone apparatus according to Embodiment 1 of the present invention. IP telephone apparatus 500 includes a communication session establishment request generation unit 501 and a communication session establishment unit 502.

  Note that the IP telephone apparatus according to the first embodiment or subsequent embodiments is an IP telephone apparatus that establishes a communication session based on SIP. Therefore, the IP telephone apparatus has a communication interface such as the Internet rather than being configured by an electronic circuit, and if necessary, installs a program in a computer to which an input / output apparatus such as a microphone or a camera is connected. It is easy to configure. Note that the SIP standard has been defined as RFC2543, and has been revised as RFC3261 to 3265. The SIP in the present invention is not limited to these standards established in the past and present. In other words, it includes standards that will be enacted in future revisions.

  The “communication session establishment request generation unit” 501 generates a communication session establishment request. The “communication session establishment request” is a request for establishing a communication session including a communication session for transmitting and receiving text information. The communication session includes a communication session for transmitting and receiving voice information related to the IP telephone apparatus in addition to a communication session for transmitting and receiving text information. These communication sessions are established based on the description by SIP. Also, when the IP telephone device enables web browsing as another communication session, it requests a web server or the like for information such as a web page and receives information such as the requested web page. There may also be a communication session. Note that a communication session when using the Internet can be established by executing a program by designating the IP address, port number, and protocol of the communication partner. Therefore, the communication session establishment request includes specification of an IP address, a port number, and a protocol. When communication is performed via a router, when the router connects a network to which a global address is assigned and a network to which a private address is assigned, the network side to which the global address is assigned establishes a communication session. Commands for routers may also be included.

  In the above description, “communication session is established based on description by SIP”, but description such as communication session for transmission / reception for text information may be in the header field of SIP message. The description may also be in the body of the SIP message. The description in the header field is described by a line such as “TextPort: 2847”, for example. Here, “2847” means a port number (note that “TextPort: 2847” is an example, and only the text port 2847 is used to describe a communication session in such a header field. Not intended.) A protocol for communicating text may be specified before or after the port number. The protocol may be specified by a line different from the port number specification line. In implementations such as programs that handle many SIP messages, if there is a line that cannot be interpreted in the header field, the line is often ignored. Thus, a line that deviates from the current RFC standard. In many cases, there will be no problem. If an error occurs, the SIP message is requested to be retransmitted, and the side requesting retransmission transmits a SIP message from which the description of the communication session for text information transmission / reception is deleted.

  “Communication session establishment unit” 502 establishes a communication session based on the communication session establishment request generated by the communication session establishment request generation unit. For example, a communication session is established by performing operations such as Open, Bind, Listen, and Accept on the socket using the IP address, port number, and protocol.

  Note that the communication session established by the communication session establishment unit may be used by the IP telephone apparatus of the present invention, or may be used by a program other than the program that implements the IP telephone apparatus (for example, a communication session). The file descriptor or the like obtained by establishing the above may be transferred to another process by using the inter-process communication by the process of executing the program of the IP telephone apparatus.

  Since the present invention is an IP telephone apparatus, it is difficult to perform its function with only one IP telephone apparatus, and usually there is an IP telephone apparatus as a communication partner. Therefore, there are various relationships between the communication session establishment request generation unit and the communication session establishment unit. In the present invention, it is not particularly limited to one. For the sake of explanation, two examples of the relationship will be given.

  FIG. 6 illustrates the first relationship between the communication session establishment request generator and the communication session establishment unit. When receiving a SIP message (for example, an INVITE message) from another IP telephone apparatus (not limited to the IP telephone apparatus according to the present invention), the communication session establishment request generation unit 501 receives the header field of the received SIP message or / And generate a communication session establishment request according to the description of the body. The communication session establishment request generated by the communication session establishment request generation unit 501 is passed to the communication session establishment unit 502, and a communication session is established. When the communication session establishment request generation unit 501 and the communication session establishment unit are each configured as a program module (for example, a function or a class), the communication session establishment request is sent to the module constituting the communication session establishment unit 502. Realized as a passed parameter. The parameter may be realized, for example, as a structure in C language or a class instance in C ++ language.

  FIG. 7 illustrates a flowchart for explaining processing of the IP telephone apparatus illustrated in FIG. First, a SIP message is received by processing in the communication session establishment request generation unit 501 (step S701). Next, the communication session establishment request generation unit generates a communication session establishment request and passes it to the communication session establishment unit, and the communication session establishment unit establishes a communication session according to the received communication session establishment request (step S702). .

  FIG. 8 illustrates another relationship between the communication session establishment request generation unit and the communication session establishment unit. In FIG. 8, IP telephone apparatus 500 receives a communication session establishment request from other IP telephone apparatus 800. In this case, another IP telephone apparatus 800 is the IP telephone apparatus of the present invention. That is, communication session establishment request generation unit 801 of another IP telephone apparatus 800 generates a communication session establishment request. This communication session establishment request constitutes a header field or / and body of the SIP message. Therefore, in FIG. 8, the communication session establishment request is described based on, for example, the SDP arranged as the body of the SIP message, and is generally text information. The SIP message generated in this way is received by the IP telephone apparatus 500, a communication session establishment request constituting a header field or / and body is passed to the communication session establishment unit 502, and parsing (syntax analysis) of text information and the like is performed. Etc. are performed to interpret the communication session establishment request, and the communication session is established. Note that SDP is currently defined as RFC2327. In the present invention, the present invention is not limited to this rule, and includes standards that will be established as SDP in the future.

  FIG. 9 illustrates a flowchart for explaining processing of the IP telephone apparatus illustrated in FIG. FIG. 9A illustrates the processing of IP telephone apparatus 800. First, the communication session establishment request generation unit 801 generates a communication session establishment request (step S901). Next, the generated communication session establishment request is transmitted using the function of IP telephone apparatus 800 (step S902).

  FIG. 9B illustrates the processing of IP telephone apparatus 500. First, a communication session establishment request is received using the function of IP telephone apparatus 500 (step S903). Next, according to the received communication session establishment request, the communication session establishment unit 502 establishes a communication session (step S904).

(Embodiment 1: Main effects)
A communication session for text information is established by the IP telephone apparatus according to the present embodiment. As a result, text information can be transmitted and received at the same time as an IP telephone call.

(Embodiment 2: mainly corresponding to claim 2)
In the IP telephone apparatus according to Embodiment 2 of the present invention, in the IP telephone apparatus according to Embodiment 1, the communication session establishment request generated by the communication session establishment request generation unit is described based on the SDP description rule.

  For example, a voice media communication session is described by m = audio 50000 RTP / AUP 0 in the 16th line in the body described in the SDP of the SIP message illustrated in FIG. 19, but such a description is extended. Thus, a description such as m = text 12345... Is determined between the IP telephone apparatuses of the present invention. Here, “12345” is, for example, a port number. In addition, in the portion of “...”, A text information communication protocol may be specified. In addition, the version number of a module that communicates text information may be included.

(Embodiment 2: Main effects)
According to the present embodiment, it is possible to establish a session for transmitting and receiving text information by extending an SDP processing module or the like already used in an IP telephone apparatus.

(Third embodiment: mainly corresponding to claim 3)
As a third embodiment of the present invention, an IP telephone apparatus having a configuration in which the communication session establishment request generating unit of the IP telephone apparatus according to the second embodiment has text communication transmission / reception description information generating means will be described.

  The “text information transmission / reception description information generating means” generates description information for transmission / reception of text information as description information identified by “i” in the session description information based on the description rule of SDP. “Session description information based on SDP description rules” means a description of the format <type> = <value>. Further, “description information identified by“ i ”” means description information in which <type> is i.

  The description information in which <type> is i is a Session Description described by a character set of ISO 10646 according to the SDP standard. Since a character set of ISO 1064 is used, any text expression can be described in the description information in which <type> is i.

  Therefore, the text information transmission / reception description information generating means includes description information of a communication session for transmission / reception of text information in the <value> portion of i = <value>.

  FIG. 10 exemplifies the description of the SDP generated using the text information transmission / reception description information generating means. In the fourth line, “text / port = 2847” represents the description information of the communication session for sending and receiving text information. For example, the port number for sending and receiving text information is 2847. Yes. In this example, only the port number is shown, but the specification of the protocol, the text handling module, and the name / version of the application may be specified (the IP address can be known from the header field of the SIP message). You do n’t need to specify it here).

(Embodiment 3: Main effects)
Since any text expression can be described in the description information identified by “i”, the content of the description information identified by “i” is parsed in the parsing process of the SDP description. It is not considered. Therefore, it is possible to easily add processing for analyzing the content of the description information identified by “i”.

  The description information identified by “m” has a structure of <media> <port> <transport> <fmt list>, and the <media> part has audio, video in the current SDP standard. , application, data, control only appears, so when parsing, a program is built so that an error occurs if anything other than audio, video, application, data, control appears in the <media> part. There may be. For this reason, as described in the second embodiment, in order to allow a description such as m = text 12345..., More programs may be modified than in the present embodiment.

(Embodiment 4: mainly corresponding to claims 4 and 5)
As an embodiment 4 of the present invention, an IP telephone apparatus in which any one of the embodiments 1 to 3 has a text information transmitting / receiving unit will be described.

  FIG. 11 illustrates a functional block diagram of an IP telephone apparatus according to Embodiment 4 of the present invention. The IP telephone apparatus 1100 is configured such that the IP telephone apparatus according to any one of the first to third embodiments includes a text information transmission / reception unit 1101.

  The “text information transmitting / receiving unit” 1101 transmits / receives text information using the communication session established by the communication session establishing unit 502. For example, text information is transmitted and received using a file descriptor corresponding to the communication session established by the communication session establishment unit 502.

  The text information transmitted / received by the text information transmitting / receiving unit 1101 includes, for example, any one of text information stored in a file, text information generated by inter-process communication, and text information generated by keyboard operation. May be.

  The “text information stored in the file” may be text information to be stored in the file. Alternatively, it may be text information already stored in a file. The text information stored in the file from now on is text information received by the text information transmitting / receiving unit 1101 and is text information written in the file. The text information already stored in the file is text information that is read by the file operation and transmitted by the text information transmitting / receiving unit 1101.

  By transmitting and receiving the text information stored in the file by the text information transmitting / receiving unit, it is possible to hold a history of receiving the text information, or to transmit the text information prepared in advance in the file.

  The text information generated in the inter-process communication is text information generated when a process realizing the IP telephone apparatus communicates with another process. The other process may operate on the same computer as the computer on which the process for realizing the IP telephone apparatus operates. Or you may operate | move with a different computer.

  Examples of other processes include text editors, clipboards, and browsers that display web pages. For example, text information created by a text editor using inter-process communication is transmitted by the text information transmission / reception unit 1101, or text information received by the text information transmission / reception unit 1101 is input to the text editor. The clipboard is a buffer that temporarily holds text information that has been copied in a copy and paste operation. The text information received by the text information transmission / reception unit 1101 can be stored in the clipboard buffer by inter-process communication. Alternatively, the text information stored in the clipboard buffer is transmitted by the text information transmitting / receiving unit 1101. When the other process is a browser, the URL of the web page displayed by the browser is transmitted by the text information transmission / reception unit, or when the text information received by the text information transmission / reception unit represents the URL, the URL is processed by the browser. It is transmitted by inter-communication and displays the web page indicated by the URL. Or you may make it transmit / receive the source code of the web page displayed on the browser as text information.

  In this way, it is possible to perform cooperation with other applications by transmitting and receiving text information generated by inter-process communication.

  The text information generated by the keyboard operation is text information generated based on pressing a key on the keyboard. When an ordinary keyboard key is pressed, an ASCII character is generated. However, text information obtained by performing Roman character kana-kanji conversion or the like using the ASCII character may also be included.

  As described above, by transmitting and receiving text information generated by keyboard operation, it becomes possible to accurately transmit difficult kanji and foreign language spelling.

(Embodiment 4: Main effects)
In this embodiment, since the IP telephone apparatus has a text information transmission / reception unit, the IP telephone apparatus can transmit and receive text information, and text information can be transmitted and received easily.

(Embodiment 5: mainly corresponding to claim 6)
As an embodiment 5 of the present invention, an IP telephone apparatus that performs synchronous output of text information and output of voice or / and video will be described.

  FIG. 12 illustrates a functional block diagram of the IP telephone apparatus according to the present embodiment. The configuration of the IP telephone apparatus 1200 is such that the IP telephone apparatus according to the fourth embodiment includes a text information output unit 1201 and a voice or / and video acquisition unit 1202.

  A “text information output unit” 1201 outputs text information received by the text information transmission / reception unit 1101. For example, text information is output to a screen of a personal computer or the like on which a program for realizing an IP telephone device operates.

  The “voice or / and video acquisition unit” 1202 acquires voice or / and video by IP telephone communication. That is, it is a unit that acquires audio or / and video using the communication session established by the communication session establishment unit 502.

  In the present embodiment, the text information output unit 1201 outputs text information and outputs voice or / and video based on the timing at which voice or / and video is acquired by IP telephone communication and the timing at which text information is acquired. Synchronize with the output of.

  Normally, in IP telephone communication, audio or / and video information is transmitted / received using RTP (Real-Time Transport Protocol), so that when audio or / and video information is received, it is output immediately. However, buffering may be performed on the basis of a time stamp given to a header of a packet carrying audio or video information, and may be output after being aligned. Therefore, the text information output unit 1201 does not immediately output the received text information, but outputs it in synchronization with the audio and video information received at that time.

  For example, the voice information “It is obvious according to this text” is received first, the packet corresponding to “It is obvious according to” is received first, then the packet “It is” is received, Next, assume that a packet of “this text” is received. At this time, the voice information is not output until a packet of “this text” is received, but is buffered. Accordingly, when the text information is received when the voice information “this text” is received, the received voice information and the text information are immediately synchronized without synchronizing the voice information and the text information. When output, the text information is output after the voice “It is clear according to this text” is output. On the other hand, when synchronization is performed, the text information is output when the “this text” portion is output when the voice “It is clear according to this text” is output. Thereby, the relation between the voice and the text becomes clear.

  In order to do this, for example, the text information output unit 1201 has a packet of audio or / and video information acquired by the audio or / and video acquisition unit 1202 at a timing when the text information is acquired by the text information transmitting / receiving unit. To be associated. When the content of the associated audio or / and video information packet is output, text information is output.

(Embodiment 5: Main effects)
According to the present embodiment, a telephone call can be made without causing the operator of the IP telephone apparatus to feel uncomfortable due to a difference in the timing of output of voice information and text information. Similarly, it does not cause a sense of incongruity due to a difference in output timing between the video information and the text information.

(Embodiment 6: mainly corresponding to claim 7)
An IP telephone apparatus having a web browsing unit will be described as a sixth embodiment of the present invention.

  FIG. 13 illustrates a functional block diagram of the IP telephone apparatus according to the present embodiment. The IP telephone apparatus 1300 has a configuration in which the IP telephone apparatus according to the fourth embodiment includes a web browsing unit 1301.

  The “web browsing unit” 1301 is a unit that enables web browsing, for example, a means for specifying a URL (for example, specifying a URL using a keyboard), and a request for information such as a web page specified by the URL. Means for receiving information such as a web page returned in response to the request, and means for displaying and reproducing information such as a web page of a designated URL (for example, a display or a speaker). .

  In this embodiment, the web browsing unit 1301 includes a URL transmission unit 1302 and an information request unit 1303.

  “URL transmission means” 1302 causes the text information transmitting / receiving unit 1101 to transmit the URL of the information currently being browsed as text information. For example, when the URL is input to the means for designating the URL, the URL is transmitted to the text information transmission / reception unit 1101 as text information. Alternatively, when a button or the like on the screen is pressed, the URL of information displayed / reproduced is transmitted to the web browsing unit. Further, when another web page or the like is displayed / reproduced by clicking on a link of the displayed web page, the URL of the other web page or the like is transmitted as text information by the URL transmitting means 1302. It may be. When the text information transmitting / receiving unit 1101 transmits a URL as text information, a tag indicating that the text information is a URL may be added.

  If the text information received by the text information transmission / reception unit 1101 can be interpreted as a URL, the “information request unit” 1303 requests information indicated by the URL. For example, the information requesting unit 1303 monitors text information received by the text information transmitting / receiving unit 1101 and, if it can be interpreted as a URL, requests information indicated by the URL represented by the text information. Since the URL is described according to a certain syntax rule, whether the text information can be interpreted as a URL can be determined by determining whether the text information conforms to the syntax rule. If the URL is transmitted together with a tag indicating that the text information is a URL, whether the text information can be interpreted as a URL can be monitored by detecting the tag. .

  It is desirable that the size of the window for displaying information by web browsing unit 1301 is kept the same between the IP telephone devices on which a call is made. Therefore, when a window resizing operation is performed on one IP telephone apparatus, information indicating the window resizing may be transmitted as text information to another IP telephone apparatus. As text information indicating the resizing of the window, for example, “RESIZE: WIDTH = 200: HEIGHT = 250” may be used to indicate the width and height of the window after resizing by the number of pixels.

(Embodiment 6: Main effects)
According to the present embodiment, the URL of the information browsed by the web browsing unit is transmitted as text information to the other party of the IP telephone communication, and the information indicated by the URL transmitted as the text information is transmitted to the other party. It is displayed on the web browsing part of the IP telephone device. Thereby, it is possible to make a call while viewing the same web page. Thereby, sharing of information can be promoted, and communication can be performed efficiently.

(Embodiment 7: mainly corresponding to claim 8)
As an embodiment 7 of the present invention, an IP telephone apparatus in which a web browsing unit has a drawing function will be described.

  FIG. 14 illustrates a functional block diagram of the IP telephone apparatus according to the present embodiment. In the IP telephone apparatus 1400, the web browsing unit of the IP telephone apparatus according to the sixth embodiment includes a drawing operation conversion unit 1401, a vector information transmission unit 1402, and a drawing unit 1403.

  “Drawing operation conversion means” 1401 converts a drawing operation performed on the screen into vector information. Here, the “screen” means a screen on which information such as a web page is displayed. The “drawing operation” is a mouse operation (for example, button click, drag, etc.) or connected to an IP telephone device (or connected to a computer on which a program for realizing the IP telephone device operates). This is an operation using a pointing device such as a tablet, touch panel, light gun, or light pen. “Vector information” is information including the coordinates of the drawing start position, the direction in which the drawing operation is performed, the length of the drawing operation, and the like, and means information necessary to reproduce the drawing operation.

  Therefore, for example, when a drawing operation such as a mouse drag is performed, the drawing operation conversion unit 1401 converts the drawing operation conversion unit 1401 into vector information indicating the coordinates of the drag start position, the coordinates of the end position, and the like.

  The “vector information transmission unit” 1402 transmits the vector information converted by the drawing operation conversion unit 1401 to the text information transmission / reception unit as text information. For example, if the vector information converted by the drawing operation conversion unit 1401 is binary data, the binary data is converted into text information and transmitted to the text information transmission / reception unit 1101. As a method for converting binary data into text information, for example, methods such as UUENCODE and BASE64 are known, and these are used. If the vector information converted by the drawing operation conversion unit 1401 is text information such as “DRAG: X = 10, Y = 20: X = 30, Y = 50” from the beginning, the text information transmitting / receiving unit is used as it is. 1101 is transmitted. Note that a tag indicating that the information is vector information may be added and transmitted.

  If the text information received by the text information transmitting / receiving unit 1101 can be interpreted as vector information, the “rendering unit” 1403 performs rendering based on the vector information. For example, the drawing unit 1403 monitors the text information received by the text information transmission / reception unit 1101. When the drawing unit 1403 determines that the received text information can be interpreted as vector information, the drawing unit 1403 performs drawing based on the vector information. Whether the text information can be interpreted as vector information may be determined by determining whether the text information conforms to the syntax rules of the vector information. When a tag indicating vector information is added, the determination may be made by detecting the tag.

(Embodiment 7: Main effects)
According to the present embodiment, characters and figures drawn in such a manner as to be superimposed on information browsed and displayed by the web browsing unit are transmitted to the other party of the IP telephone communication, and are displayed on the other party. Characters and figures can be drawn by superimposing on information. Thereby, for example, directions can be shown while looking at a map, or instructions for correction in production of a web page or the like can be accurately performed while viewing the same web page between callers.

(Embodiment 8: Claim 8 will be mainly described)
As an eighth embodiment of the present invention, a description will be given of an IP telephone device that transmits a scroll operation to a web browsing unit as text information and performs a scroll operation based on the scroll operation transmitted as text information.

  15 and 16 illustrate functional block diagrams of the IP telephone apparatus according to the present embodiment. In the IP telephone apparatus 1500, the web browsing unit 1301 of the IP telephone apparatus according to the sixth or seventh embodiment includes scroll operation detection means 1501, scroll operation conversion means 1502, scroll operation transmission means 1503, and scroll means 1504. It has a configuration.

  “Scroll operation detecting means” 1501 detects a scroll operation. For example, a scroll bar is displayed on the screen displayed by the web browsing unit, and it is detected that a mouse drag operation or the like has been performed on the scroll bar. For example, how many pixels of movement or how many pixels of movement have occurred). Of course, the scrolling is not limited to the vertical direction, but may be performed in the horizontal direction.

  “Scroll operation conversion means” 1502 converts the scroll operation detected by the scroll operation detection means 1501 into text information. For example, when 10 variables are detected, it is converted into text information such as “SCROLL: UP: 10%”.

  The “scroll operation transmitting unit” 1503 causes the text information transmission / reception unit 1101 to transmit the text information converted by the scroll operation converting unit.

  “Scroll means” 1504 scrolls text information received by the text information transmitting / receiving means 1101 based on the text information when the scroll operation is converted. For example, when SCROLL: UP: 10% is received as text information, scrolling is performed upward by a variable of 10%. When the IP telephone apparatus according to the present embodiment is based on the seventh embodiment, when scrolling, characters / graphics drawn by the drawing means may be scrolled. In this way, even if scrolling is performed, the correspondence between information such as a web page indicated by a URL and characters / graphics is not disrupted.

(Embodiment 8: Main effects)
According to the present embodiment, when information that does not fit on one screen is displayed, when one of the IP telephone communications performs a scroll operation, the other can also be scrolled to synchronize with it. Thereby, for example, communication can be performed based on the display of the same information.

(Embodiment 9: Claim 10 will be mainly described)
As an embodiment 9 of the present invention, an IP telephone apparatus that stores and reproduces transmitted information and / or received information while retaining transmission and / or reception timing will be described.

  FIG. 17 illustrates a functional block diagram of the IP telephone apparatus according to the present embodiment. An IP telephone apparatus 1700 is configured such that any of the IP telephone apparatuses according to the first to eighth embodiments includes an information storage unit 1701 and an information reproduction unit 1702. Therefore, for example, if the IP telephone apparatus 1700 is based on the fourth embodiment, it has a text information transmission / reception unit.

  The “information storage unit” 1701 stores information transmitted and / or received information in the communication session established by the communication session establishment unit 502 while storing the transmission or reception timing. For example, the packet received by the communication session established by the communication session establishment unit 502 is stored in a hard disk device or the like together with the time of reception. In addition, when the transmitted information and / or the received information is stored, the transmitted information and / or the received information is stored together with the time or time stamp acquired for the storage. It may be. In addition, information to be transmitted and / or received information may be accumulated together with an accumulation elapsed time that is an elapsed time from the time when the previous accumulation was performed.

  The concept of “a communication session established by communication session establishment unit 502” is a concept that includes not only a communication session established by communication session establishment unit 502 but also a communication session that will be established in the future.

  “Information to be transmitted” means information to be transmitted by an operation on IP telephone apparatus 1700 or information to be transmitted. For example, if an utterance operation is performed, utterance voice information is transmitted. When the IP telephone apparatus 1700 is based on the sixth embodiment, the URL text information transmitted along with the display / reproduction of a web page or the like is transmitted information. When the IP telephone apparatus 1700 is based on the seventh embodiment, information (text information indicating the drawing operation) obtained by converting vector information generated along with the drawing operation into text information is transmitted. In the case of the eighth embodiment, text information (text information indicating the scroll operation) transmitted by the scroll operation transmitting unit after the scroll operation is converted by the scroll operation converting unit is transmitted.

  In particular, since the “communication session established by the communication session establishment unit 502” includes a communication session that will be established in the future, information to be transmitted is transmitted in a communication session that will be established in the future. Information is also included. Therefore, information generated by an operation on IP telephone apparatus 1700 in a state where a communication session is not established is also information transmitted in the present invention.

  “Received information” means information received by the IP telephone apparatus 1700 by establishing a communication session with another telephone apparatus or the like. For example, when the other telephone device is the IP telephone device of the present embodiment, the URL text information such as a web page displayed and reproduced on the other telephone device is received. In addition, text information indicating a drawing operation on another telephone device, text information indicating a scroll operation, and the like are received information.

  An “information reproduction unit” 1702 reproduces information stored in the information storage unit 1701. For example, the packet stored in the hard disk device together with the received time or time stamp, accumulated elapsed time, etc. is read and reproduced while maintaining the received time interval. Further, the transmission information stored together with the time transmitted to the information storage unit 1701 is read and reproduced. Further, instead of performing reproduction, the read information may be transmitted using an established communication session. Thus, by reproducing the information while maintaining the received timing, for example, in the case of audio, it can be heard in the same way as when it was recorded, and at the same timing as when it was recorded, Information indicated by the URL can be displayed and reproduced. Also, if for some reason (for example, network failure) a communication session cannot be established with the telephone device of the other party, voice information, video information, URL text information is prepared in case a communication session can be established. Text information indicating a drawing operation and text information indicating a scroll operation can be accumulated. In this case, the accumulated information can be transmitted when a communication session can be established later.

(Embodiment 9: Main effects)
Information accumulation processing by the information accumulation unit 1701 and information reproduction processing by the information reproduction unit 1702 may be performed in parallel. Further, after the accumulation process is performed, the reproduction process may be performed at a certain time interval. By being performed in parallel, it is possible to listen to important parts again in the case of language education. Further, when the reproduction process is performed at a certain time interval, a message can be left as in the current answering machine, for example. In the present invention, since the message includes not only voice information but also text information, a message having complicated contents can be left. For example, it is possible to display a specific web page and leave an audio description of the web page. Further, even when a communication session cannot be established, it is possible to leave an explanation or the like. Further, since the contents of transmission and reception can be accumulated and reproduced, it is possible to easily prove the fact of contract conclusion.

  The IP telephone apparatus according to the present invention establishes a communication session for transmitting and receiving text information, enables text information to be transmitted and received, makes a conversation by seeing the same web page among those who make a call, and handwriting It is useful as an IP telephone device or the like for performing a call by IP communication.

The figure for showing the outline of the present invention The figure for showing the outline of the present invention The figure for showing the outline of the present invention The figure for showing the outline of the present invention Functional block diagram of the IP telephone apparatus according to the first embodiment The figure which shows the relationship between a communication session establishment request production | generation part and a communication session establishment part Flowchart explaining processing of IP telephone apparatus The figure which shows the relationship between a communication session establishment request production | generation part and a communication session establishment part Flowchart explaining processing of IP telephone apparatus Example of SDP description Functional block diagram of IP telephone apparatus according to Embodiment 4 Functional block diagram of IP telephone apparatus according to Embodiment 5 Functional block diagram of IP telephone apparatus according to Embodiment 6 Functional block diagram of IP telephone apparatus according to Embodiment 7 Functional block diagram of IP telephone apparatus according to Embodiment 8 Functional block diagram of IP telephone apparatus according to Embodiment 8 Functional block diagram of IP telephone apparatus according to Embodiment 9 Sequence diagram showing a state of communication between the calling side and the called side when SIP is used Example of INVITE message in SIP

Explanation of symbols

500 IP telephone apparatus 501 Communication session establishment request generation unit 502 Communication session establishment unit

Claims (10)

An IP telephone apparatus for establishing a communication session based on SIP (Session Initiation Protocol),
A communication session establishment request generator for generating a communication session establishment request, which is a request for establishing a communication session including a communication session for sending and receiving text information;
A communication session establishment unit that establishes a communication session based on the communication session establishment request generated by the communication session establishment request generation unit;
An IP telephone apparatus. 2. The IP telephone apparatus according to claim 1, wherein the communication session establishment request generated by the communication session establishment request generation unit is described based on a description rule of SDP (Session Description Protocol). The communication session establishment request generation unit includes a text communication transmission / reception description information generation unit that generates description information for transmission / reception of text information as description information identified by “i” in the session description information based on the description rule of SDP. The IP telephone apparatus according to claim 2. The IP telephone apparatus according to any one of claims 1 to 3, further comprising a text information transmitting / receiving unit that transmits and receives text information using a communication session established by the communication session establishing unit. The IP telephone apparatus according to claim 4, wherein the text information includes any one of text information stored in a file, text information generated by inter-process communication, and text information generated by a keyboard operation. A text information output unit that outputs text information received by the text information transmission / reception unit;
An audio or / and video acquisition unit for acquiring audio or / and video by IP telephone communication;
Have
The text information output unit synchronizes the timing of acquiring voice or / and video by IP telephone communication with the output of the text information and the output of voice or / and video based on the timing of acquiring the text information. The IP telephone apparatus according to claim 4. It has a web browsing part that enables web browsing,
The web browsing unit includes URL transmitting means for transmitting the URL of the information currently being browsed to the text information transmitting / receiving unit as text information;
If the text information received by the text information transmitting / receiving unit can be interpreted as a URL, an information requesting means for requesting information indicated by the URL;
The IP telephone apparatus according to claim 4, comprising: Web browsing department
A drawing operation conversion means for converting a drawing operation performed on the screen into vector information;
Vector information transmitting means for transmitting the vector information converted by the drawing operation converting means to the text information transmitting / receiving unit as text information;
If the text information received by the text information transmitting / receiving unit can be interpreted as vector information, a drawing means for drawing based on the vector information;
The IP telephone apparatus according to claim 7, comprising: The web browsing unit includes a scroll operation detecting means for detecting a scroll operation;
Scroll operation conversion means for converting the scroll operation detected by the scroll operation detection means into text information;
Scroll operation transmitting means for transmitting the text information resulting from the conversion by the scroll operation converting means to the text information transmitting / receiving unit;
Scroll means for performing scrolling based on the text information when the text information received by the text information transmitting / receiving means is converted from the scroll operation;
The IP telephone apparatus according to claim 7 or 8, comprising: An information storage unit that stores information transmitted and / or received information in a communication session established by the communication session establishment unit while storing transmission and / or reception timing;
An information reproduction unit for reproducing information stored in the information storage unit;
The IP telephone apparatus according to claim 1, comprising:

Images