JP6509917B2 - Inter-terminal communication system, inter-terminal communication method, inter-terminal communication program, and communication server - Google Patents

Description

Embodiments of the present invention relate to an inter-terminal communication system, an inter-terminal communication method , an inter-terminal communication program , and a communication server .

  Conventionally, by transmitting and receiving voice data and image data to and from each other between portable terminal devices, it is possible to perform data communication in which the same image can be mutually processed in real time between callers using these portable terminal devices. A system is known (see, for example, Patent Document 1).

JP, 2000-261574, A

  In the data communication system as described above, personal information may be exchanged between portable terminal devices. Therefore, in such a data communication system, a secure communication environment is required. However, in the data communication system as described above, a secure communication environment has not been provided.

The present invention provides an inter-terminal communication system, an inter-terminal communication method , an inter-terminal communication program , and a communication server capable of transmitting and receiving audio data and image data in real time between terminal devices in a secure communication environment. To aim.

One embodiment of the present invention, a terminal information receiving unit that receives from the previous SL terminal device terminal identification information for identifying the terminal device includes a telephone number of the terminal device, the first terminal apparatus among the plurality of terminal devices The terminal identification information in which the terminal information receiving unit receives compatibility between a first application operating and a second application operating in a second terminal device different from the first terminal device among the plurality of terminal devices A determination unit based on the telephone number of the first terminal device and the telephone number of the second terminal device, and the registration information of the terminal device stored in advance, the first application, and , exit to the the session between the second application, the conformity judging unit and the second terminal apparatus from the first terminal device based on the compatibility of the determination result by A session establishing section for constructing, based on the approval information transmitted from the second terminal device in response to a request of the session constructed to be a terminal communication system comprising a.

The inter-terminal communication system according to an embodiment of the present invention may further include a determination result transmitting unit that transmits the determination result by the compatibility determination unit to the first terminal device in response to the determination request transmitted by the first application. Further equipped.
Further, in the inter-terminal communication system according to one embodiment of the present invention, the session construction unit is configured to set an internet protocol address of the first terminal apparatus via a push server based on the determination result of the compatibility by the compatibility determining unit. by transmitting to the second terminal device, and outputs a request for the session construction between the first application and the second application to the second terminal device.

Further, the inter-terminal communication system according to an embodiment of the present invention further includes the second terminal apparatus, and the second terminal apparatus is configured to receive the session when a request for session construction by the session construction unit is output. An image for requesting approval for a request for construction is displayed on a display unit included in the second terminal device.

Moreover, the communication system between terminals according to one embodiment of the present invention further includes a relay unit relaying communication between the first application and the second application based on the session constructed by the session construction unit. .

Moreover, the communication system between terminals according to an embodiment of the present invention further includes the first terminal apparatus, and the first terminal apparatus is based on the communication status between the first application and the second application. It is selected whether to communicate with the second application via the relay unit or to communicate with the second application not via the relay unit .

In one embodiment of the present invention, a terminal information receiving procedure in which a server device receives, from the terminal device, terminal identification information that includes the telephone number of the terminal device and identifies the terminal device; The terminal information is compatible with the first application operating in the first terminal device among the terminal devices and the second application operating in the second terminal device different from the first terminal device among the plurality of terminal devices, the terminal information A determination is made based on the telephone number of the first terminal apparatus and the telephone number of the second terminal apparatus included in the terminal identification information received in the reception procedure, and the registration information of the terminal apparatus stored in advance. and sex determination procedures, the server device, and wherein the first application, the session between the second application, adapted in the conformity judging procedure A session construction procedure constructed on the basis of approval information transmitted from the second terminal device in response to a request for session construction output from the first terminal device to the second terminal device based on the determination result of Is an inter-terminal communication method.

Further, an embodiment of the present invention causes a computer of the server device in communication with the terminal device, the terminal information receiving step of receiving the terminal identification information for identifying the terminal device includes a telephone number of the terminal device from the terminal device And a first application operating in the first terminal device among the plurality of terminal devices and a second application operating in the second terminal device different from the first terminal device among the plurality of terminal devices The telephone number of the first terminal apparatus and the telephone number of the second terminal apparatus, which are included in the terminal identification information received in the terminal information receiving step, and the registration information of the terminal apparatus stored in advance. a conformity judging step of judging based, and the first application, the session between the second application, the suitability Constructed based on the approval information transmitted from the second terminal device in response to a request of the session construction output from compatible based on the determination result of the first terminal device to the second terminal device in the determining step It is an inter-terminal communication program for executing a session construction step.
Further, according to an embodiment of the present invention, there is provided a terminal information receiving unit for receiving, from the terminal device, terminal identification information for identifying the terminal device including a telephone number of the terminal device, and a first terminal device among the plurality of terminal devices The terminal identification in which the terminal information receiving unit receives compatibility between a first application operating in step and a second application operating in a second terminal device different from the first terminal device among the plurality of terminal devices A determination unit based on the telephone number of the first terminal device and the telephone number of the second terminal device included in the information and the registration information of the terminal device stored in advance; the first application And a session between the second application and the second terminal device from the first terminal device based on the determination result of the compatibility by the suitability determining unit. , A session constructing unit for constructing on the basis of the approval information transmitted from the second terminal device in response to a request of the session construction output Te is a communication server comprising.

  According to the present invention, it is possible to provide an inter-terminal communication system capable of transmitting and receiving audio data and image data in real time between terminal devices in a secure communication environment.

It is a schematic diagram which shows an example of a structure of the terminal device of this embodiment. It is a schematic diagram which shows an example of the share menu button displayed on the display part of the terminal device of this embodiment. It is a schematic diagram which shows an example of the outline | summary of the information sharing function which the communication system between terminals of this embodiment provides. It is a schematic diagram which shows an example of selection operation of the information sharing function which the communication system between terminals of this embodiment provides. It is a schematic diagram showing an example of the composition of the communication system between terminals of this embodiment. It is a table | surface which shows an example of the registration information which the signaling server of this embodiment memorize | stores. It is a flowchart which shows an example of the operation | movement procedure of the registration of this embodiment. It is a flowchart which shows an example of the operation | movement procedure of session construction of this embodiment.

[Embodiment]
Hereinafter, an embodiment of an inter-terminal communication system 1 according to the present embodiment will be described with reference to the drawings.
The inter-terminal communication system 1 of the present embodiment provides an information sharing function between a plurality of terminal devices 10. The terminal device 10 mentioned here is a communication device capable of mutual communication between devices by voice or characters, and is, for example, a mobile phone or a smartphone. The terminal device 10 can be connected to a high-speed data communication line capable of transmitting and receiving audio information and image information on the same line. The high-speed data communication line is, for example, an LTE (Long Term Evolution) communication network. This high-speed data communication line provides a service (VoLTE; Voice over LTE) that enables voice communication in addition to transmission and reception of digital information such as images and characters.

  The information sharing function is a function of sharing image information or audio information among a plurality of terminal devices 10. More specifically, one terminal device 10 transmits image information or audio information to another terminal device 10. Thus, the inter-terminal communication system 1 causes the terminal device 10 on the receiving side to display or reproduce the image displayed on the terminal device 10 on the transmitting side or the sound being reproduced. Further, the inter-terminal communication system 1 provides not only a one-way information sharing function from one terminal device 10 to another terminal device 10, but also a two-way information sharing function between the terminal devices 10.

  The inter-terminal communication system 1 includes a plurality of terminal devices 10. In the following description, when distinguishing each of the several terminal device 10, it describes, for example as the terminal device 10-1 and the terminal device 10-2. Moreover, in the following description, when not distinguishing each of these some terminal devices 10, it only describes with the terminal device 10. FIG. The configuration of the terminal device 10 will be described with reference to FIG.

[Configuration of terminal device]
FIG. 1: is a schematic diagram which shows an example of a structure of the terminal device 10 of this embodiment. The terminal device 10 includes a display unit 100, an operation detection unit 110, an imaging unit 120, a sound reproduction unit 130, a sound collection unit 140, a communication unit 150, and a control unit 160.

  The display unit 100 includes a liquid crystal display, and displays images such as characters and photographs. In the image displayed by the display unit 100, the user selects a standby image displayed when waiting for an incoming call, an application image provided by an application operating on the terminal device, and various functions provided by the terminal device. Menu images etc. are included.

  The application image includes a dialer image provided by a telephone (voice communication) application, an image of an address book provided by an address book application for managing a name and a telephone number, and an e-mail address. Also, the application image includes a moving image provided by a moving image reproduction application, a web image provided by a web browser application, a map image provided by a map application, and an image of a photograph provided by a photo album application. In addition, the application image includes various images such as an image of a mail text provided by the e-mail application and an image of a chat provided by the text chat application.

  Further, among menu images displayed by the display unit 100, a menu image for selecting an information sharing function is particularly referred to as an information sharing menu image. The information sharing menu image is also referred to as a sharing menu ball image or a sharing menu button image. Here, the menu includes various menus in addition to the information sharing menu. For example, the menu includes a voice recognition menu. The voice recognition menu is a menu for selecting a voice recognition function. The voice recognition function is a function of the terminal device 10 recognizing a voice and extracting a keyword corresponding to the recognized voice. The terminal device 10 displays a web page associated with the keyword by outputting the extracted keyword to a search engine or the like. In addition, the terminal device 10 displays a search result such as information on a store obtained by outputting the extracted keyword to a search engine or the like. In addition, the menu shown here is an example and it is not restricted to this. The functions selected by the menu include all functions that can be used during a voice call. Also, in the following description, this shared menu ball image is simply referred to as "shared ball", and the shared menu button image is also referred to simply as "shared button". An example of this shared menu button is shown in FIG.

  FIG. 2 is a schematic view showing an example of the shared menu button displayed on the display unit 100 of the terminal device 10. As shown in FIG. In this example, the image PMB of the shared menu button is displayed at an arbitrary position on the display unit 100 so as to overlap the application image PAP.

  Returning to FIG. 1, the operation detection unit 110 includes a transparent touch panel sensor that covers the display unit 100, and detects a user's operation. There are various types of user operations. Examples of the type of operation include a tap operation, a drag operation, and a pinch operation. The tap operation is an operation in which the user releases the finger immediately after touching the position on the touch panel. The drag operation is an operation in which the user moves the finger touching the touch panel in the direction in which the finger is in contact with the touch panel. The pinch operation is an operation to change the distance between the two fingers touched by the user on the touch panel. In addition, the tap operation includes a single tap operation which is performed only once and a double tap operation which rapidly repeats the single tap operation twice. In addition, the drag operation includes a swipe operation whose moving speed is faster than that of the drag operation and an even faster flick operation. Further, the pinch operation includes a pinch out operation for widening the distance between two fingers touching the touch panel, and a pinch in operation for narrowing the distance between two fingers touching the touch panel.

  In addition, although the case where a user operates by touching a touch panel sensor with a finger was made into an example and demonstrated here, it is not restricted to this. For example, the user may operate using a pointer for operation instead of the finger. That is, the operation detection unit 110 detects an operation by a finger or an object other than the finger (for example, a pointing rod) as an operation of the user.

  The imaging unit 120 includes a camera capable of capturing a still image and a moving image. The camera includes an imaging element such as a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor and an optical member such as a lens, and captures an image of the periphery of the terminal device 10. The imaging unit 120 includes an in-camera 121 including a lens on the front surface side (display surface side of the display unit 100) of the terminal device 10 and an out-camera 122 including a lens on the back surface side of the terminal device 10. The in-camera 121 is used when imaging a user who operates the terminal device 10. The out camera 122 is used when imaging a landscape around the terminal device 10 or the like.

  The sound reproduction unit 130 includes a speaker, and reproduces a sound based on input sound information. The sound reproduction unit 130 includes an ear-calling speaker 131 and a speaker mode speaker 132. The ear-to-phone call speaker 131 is used when making a call by placing the terminal device 10 on the user's ear. The speaker mode speaker 132 is used to reproduce a sound in a state in which the terminal device 10 is talked from the ear. The case where the terminal device 10 is placed in contact with the user's ear to make a call is also referred to as an earpiece mode or a normal call mode. In addition, the case where the sound is reproduced in a state where the terminal device 10 is spoken from the ear is also referred to as a hands-free mode, a speakerphone mode, or a speaker mode.

  The terminal device 10 may be provided with a proximity sensor 133 for switching between the in-ear mode and the speaker mode. The proximity sensor 133 detects whether any object (for example, the user's ear) is in proximity to the terminal device 10. In the case where the proximity sensor 133 is provided, when the proximity sensor 133 detects that the object is in proximity to the terminal device 10, the terminal device 10 switches to the in-ear mode. When the proximity sensor 133 detects that the object is not in proximity to the terminal device 10, the terminal device 10 switches to the speaker mode.

  The sound collection unit 140 includes a microphone, and collects the sound around the terminal device 10 and converts the collected sound into sound information. The sounds around the terminal device 10 include noises around the terminal device 10, sounds that the user is producing for a call, and sounds that the speaker of the sound reproducing unit 130 is producing. That is, the sound collection unit 140 collects various sounds such as noise around the terminal device 10, the voice of the user in a call, and the sound emitted by the speaker of the terminal device 10.

  The communication unit 150 includes a communication control IC (Integrated Circuit), and communicates with other devices. The terminal device 10 communicates with another device by the communication operation by the communication unit 150. In the following description, the description of the configuration and operation of the communication unit 150 is omitted.

  The control unit 160 includes a CPU (Central Processing Unit), and controls each unit included in the terminal device 10. The terminal device 10 performs operations such as display on the display unit 100, detection of an operation by the operation detection unit 110, and communication with another device by the communication unit 150 under the control of each unit by the control unit 160. In the following description, the description of the configuration and operation of the control unit 160 is omitted.

[Overview of information sharing function]
Next, an outline of the information sharing function provided by the inter-terminal communication system 1 will be described with reference to FIG.
FIG. 3 is a schematic view showing an example of an outline of the information sharing function provided by the inter-terminal communication system 1. The information sharing function provided by the inter-terminal communication system 1 includes, as an example, a function of sharing an image being displayed, a function of sharing a handwritten image, a function of sharing position information, and sharing of an image captured by a camera. There is a function.
An example of the display image by the function which shares the image in process of display is shown to FIG. 3 (A). An example of the display image by the function which shares a handwritten image is shown to FIG. 3 (B). An example of the display image by the function which shares positional information is shown in FIG.3 (C). An example of the display image by the function which shares the image which the camera imaged is shown in FIG. 3 (D).

  These information sharing functions are provided by an information sharing function application operating on the terminal device 10. In the following description, this information sharing function application will also be described as an information sharing application AP1. The information sharing application AP1 provides an information sharing function by operating in cooperation with the basic software in the terminal device 10 and other applications.

  Here, the basic software in the terminal device 10 with which the information sharing application AP1 cooperates includes communication software for the terminal device 10 to communicate with another device. The other applications in the terminal device 10 with which the information sharing application AP1 cooperates include a basic address book application AP2 and an image sharing address book application AP3.

  The basic address book application AP2 is an application for storing a thumbnail image, a name, a telephone number, an e-mail address and the like of a communication counterpart. That is, the basic address book application AP2 is an application provided as a basic function of the terminal device 10 regardless of whether the terminal device 10 supports the information sharing function. Here, the case where the terminal device 10 supports the information sharing function means the case where the terminal device 10 has installed an application for providing the information sharing function. Further, the case where the terminal device 10 does not correspond to the information sharing function means the case where the terminal device 10 has not installed an application for providing the information sharing function.

  The image sharing address book application AP3 is an application that displays operation buttons and the like used for image sharing. The image sharing address book application AP3 displays various operation images so that the user operating the terminal device 10 can easily use the information sharing function. The image sharing address book application AP3 is an application that provides an information sharing function.

  Here, in describing the information sharing function, a method of describing the terminal device 10 in the description of the present embodiment will be described. The operating state of the terminal device 10 has the following two distinctions.

  The first distinction is the distinction between the terminal device 10 requesting information sharing and the terminal device 10 requesting information sharing. In the following description, among the plurality of terminal devices 10, the terminal device 10 requesting information sharing is also referred to as the requesting terminal device 10, and the terminal device 10 requesting information sharing is requested The terminal device 10 on the side is also described. The request-side terminal device 10 makes a request for information sharing to the request-side terminal device 10. When there is a request for information sharing from the request-side terminal device 10, the requested-side terminal device 10 starts information sharing with the request-side terminal device 10 by accepting the request. In the following description, among the plurality of terminal devices 10, the request-side terminal device 10 is also described as a terminal device 10-1, and the request-side terminal device 10 is also described as a terminal device 10-2.

The second distinction is the distinction between the terminal device 10 that sends information sharing target information and the terminal device 10 that receives information sharing target information. In the following description, among the plurality of terminal devices 10, the terminal device 10 on the side of transmitting information sharing target information will also be described as the terminal device 10 on the information transmitting side or the terminal device 10-S. Moreover, the terminal device 10 on the side which receives the information of the information sharing object is also described as the terminal device 10 on the information receiving side or the terminal device 10-R.
Of the terminal device 10 on the request side and the terminal device 10 on the request side, which of the information sharing targets is to be transmitted and which is to receive the information depends on the functions among the information sharing functions. It depends on the difference, the operation state of the terminal device 10 and the like. That is, in this inter-terminal communication system 1, there are cases where the request-side terminal apparatus 10 sends information sharing target information and the request-side terminal apparatus 10 sends information sharing target information.

  Further, in the following description, the terminal device 10 may be described by combining the first distinction and the second distinction described above. In this case, the terminal device 10 on the request side and the information transmission side is also described as a terminal device 10-1S. The terminal device 10 on the request side and the information reception side is also described as a terminal device 10-1R. The terminal device 10 on the requested side and the information transmission side is also described as a terminal device 10-2S. The terminal device 10 on the requested side and the information receiving side is also described as a terminal device 10-2R.

[Information sharing function 1: Sharing of displayed image (display screen sharing function)]
Next, the outline of each information sharing function will be described with reference to FIG. Among the information sharing functions provided by the inter-terminal communication system 1, first, sharing of the image being displayed (display screen sharing function) will be described.

  The inter-terminal communication system 1 provides a display screen sharing function. With this display screen sharing function, an image is displayed between the terminal devices 10 by displaying the image P1 displayed on the display unit 100 of the terminal device 10 as the image P2 on the display unit 100 of another terminal device 10. It is a function to share. An example of a screen displayed on the terminal device 10 by the display screen sharing function is shown in FIG. The images displayed on the display unit 100 mentioned here include the above-described standby image, application image, and menu image.

  When the display screen sharing function is selected in a certain terminal device 10-1, the inter-terminal communication system 1 sets the image P1 displayed on the display unit 100 of the terminal device 10-1 to the other sharing destination. Is displayed as an image P2 on the display unit 100 of the terminal device 10-2.

  A specific example of the display screen sharing function will be described. For example, in the terminal device 10-1, the case where a photo album application is activated and the photo album application displays an image of a photo (image P1 shown in FIG. 3A) on the display unit 100 will be described. . In this case, the inter-terminal communication system 1 displays the image P1 of the photo displayed on the display unit 100 of the terminal device 10-1 as the image P2 on the display unit 100 of the other terminal device 10-2 as the sharing destination. Let In this manner, the image P1 of the same picture is displayed on the display unit 100 of each of the two terminal devices 10, whereby the image P1 of the picture is shared.

  Next, another specific example of the display screen sharing function will be described. For example, a case where a moving image application is activated in the terminal device 10-1 and the moving image application displays a moving image with sound on the display unit 100 will be described. In this case, the inter-terminal communication system 1 causes the moving image displayed on the display unit 100 of the terminal device 10-1 to be displayed on the display unit 100 of the other terminal device 10-2 as the sharing destination. By displaying the same moving image on each of the display units 100 of the two terminal devices 10 in this manner, the moving image is shared. Further, at the same time as the sharing of the image, the inter-terminal communication system 1 reproduces the sound being reproduced from the sound reproducing unit 130 of the terminal device 10-1 from the sound reproducing unit 130 of another terminal device 10-2 which is the sharing destination. Let By reproducing the same sound from the sound reproduction units 130 of the two terminal devices 10 in this manner, the sound added to the moving image is shared. In this way, a moving image with sound is shared between the two terminal devices 10. That is, according to the inter-terminal communication system 1, any information of image information and sound information can be shared.

[Information sharing function 2: Sharing of handwritten image (handwriting sharing function)]
Next, among the information sharing functions provided by the inter-terminal communication system 1, sharing of handwritten images (handwriting sharing function) will be described with reference to FIG. 3 (B).
The inter-terminal communication system 1 provides a handwriting sharing function of sharing an image of a handwritten figure. Here, the image of the handwritten figure is an image of the trajectory of the drag operation displayed on the display unit 100 by dragging the operation detection unit 110 of the terminal device 10 with a finger or the like. That is, with the handwriting sharing function, the image P3 of the handwritten figure displayed on the display unit 100 by dragging the operation detection unit 110 of the terminal device 10 with a finger or the like is displayed on the display unit 100 of another terminal device 10 It is a function to share an image between the terminal devices 10 by displaying as P4.

  A specific example of the handwriting sharing function will be described. For example, the case where the handwriting tool application is activated in the terminal device 10-1 and the handwriting tool application displays an image of a handwritten figure (image P3 shown in FIG. 3B) on the display unit 100 will be described. Do. In this case, the inter-terminal communication system 1 uses the image P3 of the handwritten figure displayed on the display unit 100 of the terminal device 10-1 as the image P4 on the display unit 100 of the other terminal device 10-2 as the sharing destination. Display. In this manner, the same handwritten graphic image is displayed on the display unit 100 of each of the two terminal devices 10, whereby the handwritten graphic image is shared.

[Image layer display]
Note that the display unit 100 of the terminal device 10 displays a photograph displayed by the photo album application (for example, an image P5 of FIG. 3B) and an image of a handwritten figure displayed by the handwriting tool application (for example, FIG. 3B) Can be superimposed and displayed. That is, the display unit 100 of the terminal device 10 can stack and display a plurality of images. In this case, the display unit 100 displays an image by a layer set for each application. This layer is a logical hierarchy of images to be stacked and displayed.
For example, the display unit 100 displays the image P5 in the first layer which is a lower layer and the image P3 in a second layer which is a layer higher than the first layer. Here, the upper layer is a layer that displays an image on the near side (the side closer to the user) among the plurality of stacked layers. The lower layer is a layer that displays an image on the back side (the side far from the user) among the plurality of stacked layers. For the images displayed in these layers, opacity can be set, for example, between 0% and 100%. When the opacity of the image displayed in the upper layer is 100%, the upper image is opaque and the image of the lower layer is hidden, so the image of the lower layer is not displayed. When the opacity of the image displayed on the upper layer is 0%, the upper image is transparent, and the image of the lower layer is transparently displayed without being hidden.
When there are a plurality of areas in a certain layer, this opacity can be set for each of these areas. For example, if the layer on which the handwriting tool application displays an image includes an area in which the image of the handwritten graphic is displayed and an area in which nothing is displayed, the opacity of these areas may be set for each area. it can.

In addition, the operation detection unit 110 detects an operation on the highest layer. In this example, the case where the handwriting tool application displays the image P3 of the handwritten graphic on the highest second layer will be described. In this case, the operation detection unit 110 outputs an operation (for example, a drag operation) detected by the touch panel to the handwriting tool application displaying an image on the highest layer. The handwriting tool application displays an image indicating the trajectory of the drag operation on the display unit 100 as an image of a handwritten figure, based on the drag operation output from the operation detection unit 110.
Here, as another example, the case where the menu control software displays the shared menu button image on the third layer higher than the second layer will be described. In this case, the operation detection unit 110 detects an operation on the highest layer, ie, the third layer. The operation detection unit 110 detects an operation (for example, a tap operation) on the position at which the shared menu button image is displayed by using the touch panel. The operation detection unit 110 outputs the detected operation (for example, a tap operation) to the menu control software displaying an image on the highest layer. The menu control software selects the function corresponding to the position of the tap operation based on the operation output from the operation detection unit 110 and provides the selected function.
That is, the operation detection unit 110 detects an operation on the highest layer among the plurality of layers of the image displayed on the display unit 100. Therefore, in the example shown in FIG. 3B, even when the image P3 of the handwritten figure is displayed on a layer lower than the image P5 of the photo, even if the user operates the touch panel of the display unit 100, The image of the handwritten figure according to this operation is not drawn.

In the handwriting sharing function, the inter-terminal communication system 1 can also share the image of the handwritten figure in a bidirectional manner between the plurality of terminal devices 10. Specifically, the inter-terminal communication system 1 causes the image P3 of the handwritten figure displayed on the display unit 100 of the terminal device 10-1 to be displayed on the display unit 100 of the other terminal device 10-2 as the sharing destination. Display as P4. In this case, the inter-terminal communication system 1 causes the image P6 of the handwritten figure displayed on the display unit 100 of the terminal device 10-2 to be displayed on the display unit 100 of the other terminal device 10-1 as the sharing destination. Display. By displaying the image of the handwritten figure on each of the display units 100 of the two terminal devices 10 in this manner, the image of the handwritten figure is shared bidirectionally.
In the handwriting sharing function, the mechanism in which the inter-terminal communication system 1 shares an image and the mechanism in which the inter-terminal communication system 1 shares an image in the display image sharing function described above are different in the following points. That is, in the display image sharing function, the inter-terminal communication system 1 shares an image by sharing data obtained by capturing an image displayed on the display unit 100 between the terminal devices 10. On the other hand, in the handwriting sharing function, the inter-terminal communication system 1 shares the image by sharing data for drawing the image, not the data obtained by capturing the image. Specifically, in the handwriting sharing function, the terminal device 10-S on the information sending side is the coordinate data of the handwritten figure detected by the operation detection unit 110 of the terminal device 10-S, and the color, thickness, etc. of the line. Data (that is, data for drawing an image) is transmitted to the terminal device 10-R on the information receiving side. The terminal device 10-R on the information receiving side displays an image on the display unit 100 of the terminal device 10-R based on the received coordinate data of the handwritten figure, and data such as line color and thickness.

[Information sharing function 3: location information sharing (location information sharing function)]
Next, among the information sharing functions provided by the inter-terminal communication system 1, sharing of position information (position information sharing function) will be described with reference to FIG. 3 (C).
The inter-terminal communication system 1 provides a position information sharing function of sharing position information among a plurality of terminal devices 10. Here, the position information is information indicating a certain position such as the current position of the terminal device 10 or the position designated by the user. In the following, as an example, a case where the position information is information indicating the current position of the terminal device 10 will be described.
The position information includes information indicating the current position of the terminal device 10. The information indicating the current position includes, for example, longitude, latitude, altitude, and direction / direction of the terminal device 10. When the current position of the terminal device 10 is in a building, for example, the position information includes the name of the building, the number of floors in the current position (floor name), the name of a room in the building, etc. It may be In addition, when the current position of the terminal device 10 is, for example, in a theater, a cinema, or a sports match venue, the position information includes the position of the seat, the sign number of the seat, and the type of seat (for example, It may include reserved seats and free seats).

  A specific example of the position information sharing function will be described. For example, in the terminal device 10-1, a map application is activated, and the map application displays a map image (a map image P9 shown in FIG. 3C) around the current position of the terminal device 10-1. The case where it is displayed on will be described. In this case, the inter-terminal communication system 1 displays the map image P9 displayed on the display unit 100 of the terminal device 10-1 as the map image P10 on the display unit 100 of the other terminal device 10-2 as the sharing destination. Let By displaying the same map image on the display unit 100 of each of the two terminal devices 10 in this manner, the map image is shared.

  Here, the terminal device 10-1 causes the terminal device 10-2 to display position information indicating the current position of the terminal device 10-1 together with the map image P9. In this manner, by displaying the map image and the position information indicating the current position of the terminal device 10-1 on the respective display units 100 of the two terminal devices 10, the map image and the terminal device 10-1 can be obtained. The current position is shared.

  In the position information sharing function, the inter-terminal communication system 1 can also share position information bi-directionally among a plurality of terminal devices 10. Specifically, in the terminal-to-terminal communication system 1, the terminal device 10 is displayed when the display unit 100 of the terminal device 10-2 displays the map image P9 and the position information indicating the current position of the terminal device 10-1. The position information indicating the current position of -2 is displayed on the display unit 100 of the terminal device 10-1 together with the map image P10. In this manner, the display unit 100 of each of the two terminal devices 10 displays the map image and the position information indicating the current position of the terminal device 10-1 and the position information indicating the current position of the terminal device 10-2. Be done. Thereby, the current positions of the plurality of terminal devices 10 are shared bidirectionally.

[Information sharing function 4: Camera image sharing (camera image sharing function)]
Next, among the information sharing functions provided by the inter-terminal communication system 1, sharing of camera images (camera image sharing function) will be described with reference to FIG.
The inter-terminal communication system 1 provides a camera image sharing function of sharing camera images among a plurality of terminal devices 10. Here, a camera image is an image which the imaging part 120 of the terminal device 10 images. The camera image includes an image of a landscape around the terminal device 10 and an image of a user operating the terminal device 10. Further, the camera image includes a real-time image currently captured by the imaging unit 120 of the terminal device 10. That is, the camera image includes a real time image indicating the current scenery around the terminal device 10 and a real time image indicating the current situation of the user operating the terminal device 10.

  A specific example of the camera image sharing function will be described. For example, in the terminal device 10-1, a camera application is activated, and the camera application displays a real-time image (real-time image P11 shown in FIG. 3D) showing the current scenery around the terminal device 10-1. The case of displaying on the unit 100 will be described. In this case, the inter-terminal communication system 1 displays the real-time image P11 displayed on the display unit 100 of the terminal device 10-1 as the real-time image P12 on the display unit 100 of the other terminal device 10-2 as the sharing destination. Let By displaying the same real-time image on the display unit 100 of each of the two terminal devices 10 in this manner, the real-time image is shared.

[Overview of Information Sharing Function Selection Operation]
Next, an outline of an operation in which the user activates the information sharing function will be described with reference to FIG.
FIG. 4 is a schematic view showing an example of the selection operation of the information sharing function provided by the inter-terminal communication system 1 of the present embodiment.
Here, the case where user A (Mr. A) and user B (Mr. B) use display device sharing using the terminal device 10 will be described as an example. Further, in the description of this example, the terminal device 10 used by the user A is the request-side terminal 10 on the information transmission side, that is, the terminal device 10-1S. Further, in the description of this example, the terminal device 10-2 is the requested-side terminal 10 of the information receiving side, that is, the terminal device 10-2R. Further, some terminal devices 10 may not support the display screen sharing function. In the explanation of this example, the case where each terminal device 10 corresponds to the display screen sharing function will be described.

  The user A and the user B use the display screen sharing function by sequentially performing the operations shown in FIGS. 4 (A) to 4 (E). The user A and the user B are in voice communication via the LTE communication network. FIG. 4A shows an example of an image displayed on each of the terminal devices 10 when the user A and the user B are performing a voice call via the LTE communication network.

  At this time, the image PMB of the shared menu button is displayed on the display unit 100 of the terminal device 10-1S of the user A and the display unit 100 of the user B. The display of the image PMB of the sharing menu button indicates that the terminal device 10 on the other side of the communication corresponds to one of the information sharing functions described above. In this example, the display of the image PMB of the sharing menu button indicates that both the terminal device 10-1S and the terminal device 10-2R correspond to the display screen sharing function.

  The user A taps the image PMB of the shared menu button displayed on the display unit 100 of the terminal device 10-1S. When the operation detection unit 110 of the terminal device 10-1S detects this tap operation, the launcher image P20 is displayed (see FIG. 4B). The launcher image P20 is an example of the menu image described above. In this example, the launcher image P20 indicates an icon image of a display screen sharing function, a handwriting sharing function, a position information sharing function, and a camera sharing function. When the user taps the position on the display unit 100 where the icon image is displayed, the function associated with the icon image is activated. Here, a case where the user A taps the icon image P21 of the display screen sharing function among the information sharing functions displayed in the launcher image P20 will be described.

  When the operation detection unit 110 of the terminal device 10-1S detects this tap operation, a function explanation image P22 of the display screen sharing function is displayed (see FIG. 4C). In addition, when the operation detection unit 110 of the terminal device 10-1S detects this tap operation, a consent image P23 for starting screen sharing is displayed on the display unit 100 of the terminal device 10-2R of the sharing destination. The consent image P23 is an image displayed on the request-side terminal device 10 for information sharing, and prompts the user to perform an operation indicating whether the request-side terminal device 10 accepts the request for information sharing. It is an image. In this example, the consent image P23 is an image for prompting the user B to perform a tap operation indicating whether or not to accept the request for screen sharing from the user A.

  Next, the user B taps on the image P24 of the acceptance button of the acceptance image P23. When the operation detection unit 110 of the terminal device 10-2R detects this tap operation, an image P25 indicating that the connection is in progress is displayed on each of the display units 100 of the terminal device 10-2R and the terminal device 10-1S (see FIG. See D). At this time, a session of inter-terminal communication for display screen sharing is established between the terminal device 10-1S and the terminal device 10-2R.

  Next, when a session of inter-terminal communication for sharing display screen is established between the terminal device 10-1S and the terminal device 10-2R, the image P26 displayed on the display unit 100 of the terminal device 10-1S Is displayed as an image P27 on the display unit 100 of the terminal device 10-2R (see FIG. 4E). That is, display screen sharing is started between the terminal device 10-1S and the terminal device 10-2R.

[Configuration of inter-terminal communication system]
Next, the configuration of the inter-terminal communication system 1 providing the above-described information sharing function will be described with reference to FIG.
FIG. 5 is a schematic diagram showing an example of the configuration of the inter-terminal communication system 1 of the present embodiment. The inter-terminal communication system 1 includes the following devices in addition to the plurality of terminal devices 10 (in this example, the terminal devices 10-1S and 10-2R). That is, the inter-terminal communication system 1 includes a signaling server 20, an authentication server 30, a push server 40, and a relay server 50.

  The signaling server 20 manages a session of information sharing communication performed between the terminal devices 10. Specifically, the signaling server 20 can communicate with the plurality of terminal devices 10, the authentication server 30, and the push server 40. When the terminal device 10 supports the information sharing function, the signaling server 20 performs registration (initial registration) of information of the terminal device 10. In addition, when the terminal device 10 requests information sharing, the signaling server 20 performs a signaling process for establishing a session of communication with the terminal device 10 of the sharing destination. In addition, when the terminal device 10 requests information sharing, the signaling server 20 sends a response as to whether the terminal device 10 of the sharing request destination is compatible with the information sharing function, the requesting terminal device 10. Do against

The signaling server 20 includes a terminal information reception unit, a suitability determination unit, a determination result transmission unit, and a session construction unit as its functional units.
Among these, the terminal information receiving unit receives terminal information from the terminal device 10. The terminal information includes terminal identification information for identifying the terminal device 10 and application identification information for identifying an application operating on the terminal device 10.
The compatibility determination unit determines the compatibility between the first application operating in the terminal device 10-1 and the second application operating in the terminal device 10-2 based on the terminal information.
The determination result transmission unit transmits the determination result by the compatibility determination unit to the terminal device 10-1 in response to the determination request transmitted by the first application operating in the terminal device 10-1.
The session construction unit constructs a session between the first application that has transmitted the request for communication start and the second application, based on the terminal information, in response to the request for communication start transmitted by the first application.

  Also, the signaling server 20 determines whether the terminal device 10 is a legitimate device at the start of session construction. Whether or not the terminal device 10 is a legitimate device can be determined by various means. In this example, the signaling server 20 determines, based on the telephone number and the IP address transmitted from the terminal device 10, whether the terminal device 10 is a legitimate device. More specifically, the signaling server 20 determines whether the telephone number and IP address transmitted from the terminal device 10 match the telephone number and IP address assigned to the terminal device 10 in advance. It is determined whether the terminal device 10 is a legitimate device. In the following description, the determination performed by the signaling server 20 as to whether or not the terminal device 10 is a legitimate device will also be described as secure determination.

  Also, the signaling server 20 stores registration information. The signaling server 20 uses this registration information to construct a session and make a secure determination. The registration information stored in the signaling server 20 will be described with reference to FIG.

  FIG. 6 is a table showing an example of registration information stored in the signaling server 20 according to the present embodiment. The signaling server 20 stores the telephone number of the terminal device 10, the terminal model name, the push ID, and the application version as registration information. Here, the push ID is identification information for identifying the application compatible with the information sharing function operating on the terminal device 10.

  Referring back to FIG. 5, after the session is established, the signaling server 20 determines at a predetermined frequency whether the terminal device 10 is a legitimate device. The signaling server 20 establishes a session or maintains the established session only when it determines that the terminal device 10 is a legitimate device. Specifically, the signaling server 20 issues a token to the terminal device 10 when it is determined that the terminal device 10 is a legitimate device. The token is permission information for the terminal devices 10 to communicate with each other via the high-speed communication line. This token has an expiration date from the time of issuance. The terminal device 10 can share screen information with another terminal device 10 when the valid token is issued. Further, the terminal device 10 can not share screen information with another terminal device 10 when the token is not issued and when the issued token is overdue. Thus, the signaling server 20 manages the session between the terminal devices 10.

  The authentication server 30 stores the telephone number of the terminal device 10 and the Internet protocol address (IP address) in association with each other. When the signaling server 20 requests the IP address corresponding to the telephone number, the authentication server 30 returns the IP address corresponding to the telephone number of the terminal device 10 to the signaling server 20.

  If the combination of the telephone number and the IP address for a certain terminal device 10 does not match the combination of the telephone number and the IP address stored in the authentication server 30, the terminal device 10 is not a legitimate device. there is a possibility. The signaling server 20 acquires a telephone number and an IP address from a certain terminal device 10 and compares the telephone number and the IP address stored in the authentication server with the combination of the telephone number and the IP address. Determine If it is determined that the combination of the telephone number and the IP address matches as a result of the comparison, the signaling server 20 issues a token to the terminal device 10. Also, if it is determined that the combination of the telephone number and the IP address does not match as a result of the comparison, the signaling server 20 does not issue a token to the terminal device 10.

  The push server 40 stores a plurality of push IDs. The push ID stored in the push server 40 and the application operating on the terminal device 10 are associated by the signaling server 20. Specifically, when the downloaded new application is activated for the first time in the terminal device 10, the terminal device 10 requests the push server 40 to issue a push ID. The push server 40 issues a push ID to a new application of the terminal device 10 based on this request, and transmits the issued push ID to the terminal device 10. The terminal device 10 transmits information in which the new application and the issued push ID are associated to the signaling server 20 as registration information. The signaling server 20 stores the registration information transmitted from the terminal device 10. Thereby, the push ID stored in the push server 40 and the application operating on the terminal device 10 are associated by the signaling server 20.

  In addition, when the application is upgraded in the terminal device 10, the push server 40 issues a new push ID along with the upgrade. That is, the push server 40 is updated as the application version of the application operating on the terminal device 10 is updated.

  In addition, when the signaling server 20 makes a request for session construction start to the request-side terminal device 10, the push server 40 pushes the telephone number of the request-side terminal device 10 by the push technology, and the request-side terminal device Send to 10 The push technology is a technology for push distribution of a communication request to the terminal device 10 from the server side (in this example, the signaling server 20 and the push server 40 side) using an IP address. In the following description, transmission of information by push technology is also described simply as pushing information.

  The relay server 50 is a relay server that performs information sharing communication among the plurality of terminal devices 10 when peer-to-peer connection can not be made in the information sharing communication among the plurality of terminal devices 10. Peer-to-peer connections are also referred to as P2P connections. When the P2P session of the information sharing communication between the plurality of terminal devices 10 can not be established even after a predetermined time, a session via the relay server 50 is established.

[Operation procedure of communication system between terminals]
Next, the operation procedure of the communication system 1 between terminals will be described with reference to FIGS. 7 and 8. First, with reference to FIG. 7, an operation procedure of registration (initial setting) of the terminal device 10 will be described. Next, with reference to FIG. 8, an operation procedure of session construction by the inter-terminal communication system 1 will be described. The numbers in step S shown in FIG. 5 correspond to the numbers in step S in FIGS. 7 and 8.

[Operation procedure of inter-terminal communication system 1: initial setting]
An operation procedure of registration (initial setting) of the terminal device 10 will be described with reference to FIG. Here, a case where the terminal device 10-1 and the terminal device 10-2 sequentially perform registration will be described.

FIG. 7 is a flowchart showing an example of the operation procedure of registration according to this embodiment.
The terminal device 10-1 transmits, to the push server 40, a request for issuance of a push ID corresponding to the activated application when the application compatible with the information sharing function is activated in the terminal device 10-1 ((1) Step S10).
When the push server 40 receives the request for issuance of the push ID, the push server 40 transmits the push ID corresponding to the activated application to the terminal device 10-1 (step S20). The terminal device 10-1 acquires a push ID from the push server 40 (step S30).

  Next, the terminal device 10 transmits registration information to the signaling server 20 (step S40). Here, the registration information includes the push ID acquired in step S10, application version information of the application corresponding to the push ID, the telephone number of the own apparatus, and the terminal model name of the own apparatus.

  The signaling server 20 stores the registration information transmitted in step S20 (step S50), and ends the registration process for the terminal device 10-1.

  Next, the signaling server 20 transmits a telephone number to the authentication server 30 (step S60). The telephone number is a telephone number included in the registration information transmitted in step S20.

  Authentication server 30 receives the telephone number transmitted in step S60, determines whether this telephone number is a telephone number registered in advance, and transmits this determination result to signaling server 20 (step S70). Here, the telephone number registered in advance in the authentication server 30 is information indicating that the terminal device 10 is a legitimate terminal device 10. That is, the authentication server 30 determines whether the telephone number included in the registration information transmitted from the terminal device 10 is the telephone number of the authorized terminal device 10. Further, the legitimate terminal device 10 mentioned here is a terminal device 10 used by a legitimate user registered in advance. That is, the signaling server 20 determines whether or not the terminal device 10 that has transmitted the registration information is a terminal device 10 used by a legitimate user who has been registered in advance. That is, the signaling server 20 authenticates the user of the terminal device 10 in steps S60 and S70.

  In addition, the terminal device 10-2 performs registration in steps S10-2 to S70-2 illustrated in FIG. Here, step S10-2 to step S70-2 correspond to step S10 to step S50 described above. The description of steps S10-2 to S70-2 is omitted.

[Operation of inter-terminal communication system 2: session construction]
Next, with reference to FIG. 8, an operation procedure of session construction of the terminal device 10 will be described.
FIG. 8 is a flow chart showing an example of an operation procedure of session construction of this embodiment. Here, the case where a session is established between the terminal device 10-1 and the terminal device 10-2 will be described. Here, a case where the terminal device 10-1 is a request side of information sharing and the terminal device 10-2 is a request side of information sharing will be described.

The request-side terminal device 10-1 transmits a request for information sharing to the signaling server 20 (step S100).
The signaling server 20 receives a request for information sharing from the terminal device 10 (step S110). The information sharing request includes the telephone number of the requested terminal device 10.

Next, the signaling server 20 compares the telephone number received in step S110 with the registration information stored in advance to determine whether the received telephone number is available (step S120). .
Note that the signaling server 20 can also make a push ID determination instead of, or in addition to the determination of the telephone number. Specifically, the signaling server 20 determines whether or not the push ID is registered in the registration information corresponding to the telephone number accepted in step S110.

  Next, when the signaling server 20 determines that the telephone number received in step S110 is available (step S120; YES), the information sharing function can be used for the request-side terminal device 10 It notifies that there is (step S130). On the other hand, when the signaling server 20 determines that the telephone number received in step S110 is not available (step S120; NO), the information sharing function can not be used for the request-side terminal device 10 Notify that and finish the process.

  In the above, in the process of establishing a session after the signaling server 20 makes a request for information sharing to the signaling server 20, it is indicated that the information sharing function can be used for the request-side terminal device 10 Although described as notifying, it is not limited to this. As an example, the signaling server 20 may notify the request-side terminal device 10 that the information sharing function is available before the information sharing request is made. In this case, the signaling server 20 sends a request to the requesting terminal device 10 before the request for information sharing is made by background processing of the voice call at the start of the voice call between the terminal devices 10 or during the voice call. And notify that the information sharing function is available.

  Also, as another modification, the signaling server 20 may notify that the information sharing function can be used according to the conditions illustrated below, instead of or in addition to the determination of the telephone number. Good. As an example, the signaling server 20 indicates that the information sharing function can be used when the information sharing application is installed on both the request-side terminal device 10 and the request-side terminal device 10. Notice. Also, as an example, in the signaling server 20, the application version of the information sharing application installed in the request-side terminal device 10 and the application version of the information sharing application installed in the request-side terminal device 10 are the same. In the case of, it is notified that the information sharing function is available. Also, as an example, in the case where the signaling server 20 has compatibility between the information sharing application installed in the request-side terminal device 10 and the information sharing application installed in the request-side terminal device 10, Notify that the information sharing function is available.

  Also, as another example, the signaling server 20 is a terminal device in which both the request-side terminal device 10 and the request-side terminal device 10 support communication by a high-speed data communication line (for example, VoLTE). In this case, it notifies that the information sharing function is available.

Next, upon receiving the notification that the information sharing function is available, the request-side terminal device 10 transmits a request for session construction to the signaling server 20 (step S140). The session construction request includes the telephone number and IP address of the terminal device 10 on the transmission request side and the telephone number of the terminal device 10 on the request side.
In addition, the front-back relation of the processing timing of step S100 mentioned above and step S140 does not matter. For example, step S100 may be performed first and step S140 may be performed, or step S100 and step S140 may be performed simultaneously.

  Next, upon receiving the session construction request transmitted in step S130, the signaling server 20 transmits session construction information to the push server 40 (step S150). The session construction information includes the telephone number of the request-side terminal device 10 and the push ID. At this time, the signaling server 20 acquires a push ID by searching for registration information using the telephone number of the terminal device 10 on the request side as a search key. The push ID corresponds to the information sharing application operating in the request-side terminal device 10.

  When the push server 40 receives the session construction information transmitted in step S150, the push server 40 pushes an activation request for the information sharing application to the requested terminal device 10 based on the push ID included in the session construction information. (Step S160). At this time, the information pushed by the push server 40 includes the telephone number of the terminal device 10 on the request side.

  When the push of step S160 is performed, the requested-side terminal device 10 determines whether the received telephone number of the request-side terminal device 10 matches the telephone number of the other party currently in communication (step S170). If the requested terminal device 10 determines that the received telephone number of the requesting terminal device 10 matches the telephone number of the other party currently in communication (step S170; YES), the process proceeds to step S180. Advance. On the other hand, when the requested terminal device 10 determines that the received telephone number of the request-side terminal device 10 does not match the telephone number of the other party currently in communication (step S170; NO), information sharing is performed. Is transmitted to the request-side terminal apparatus 10 via the signaling server 20, and the process ends.

  Next, the request-side terminal device 10 displays an information sharing approval image, and waits for the user's approval operation (step S180). The requested terminal device 10 transmits session construction approval information to the signaling server 20 when the user approves the operation (step S180; YES) (step S190). The session construction approval information includes the telephone number, IP address and port number of the terminal device 10 of the requestee. On the other hand, when the requested terminal device 10 performs an operation that the user does not approve (step S180; NO), the request-side terminal device 10 via the signaling server 20 does not approve the information sharing. Send to to finish the process.

  Next, upon receiving the session construction approval information transmitted in step S190, the signaling server 20 constructs a session between the terminal device 10 on the request side and the terminal device 10 on the request side (step S200). , End the process of session construction. Specifically, in step S200, the signaling server 20 transmits the IP address and port number of the request-side terminal device 10 transmitted in step S190 to the request-side terminal device 10. Next, the request-side terminal device 10 transmits the IP address and port number of the request-side terminal device 10 to the signaling server 20. When the signaling server 20 receives the IP address and port number of the requesting terminal device 10, the signaling server 20 transmits the received IP address and port number to the requested terminal device 10. As a result, the request-side terminal device 10 acquires the IP address and port number of the request-side terminal device 10. Also, the request-side terminal device 10 acquires the IP address and port number of the request-side terminal device 10. That is, the plurality of terminal devices 10 mutually acquire the IP address and port number of the terminal device 10 of the information sharing partner.

  When the process of session construction ends, the terminal device 10-1 and the terminal device 10-2 mutually share information (step S210).

[Modification: Operation of inter-terminal communication system (Modification 1): Switching of communication line]
Next, switching of the communication line by the relay server 50 will be described. In the case of the present embodiment, in the information sharing communication among the plurality of terminal devices 10, the P2P session is established using the LTE line. Further, in the case of the present embodiment, in the information sharing communication among the plurality of terminal devices 10, a session via the relay server 50 is established using a wireless LAN circuit.

  Here, when a voice call between a plurality of terminal devices 10 is performed using an LTE channel, and a state in which information sharing communication uses an LTE channel and a state in which a wireless LAN channel is used are switched. There is. In this case, since the IP address of the terminal device 10 used for information sharing communication changes due to the switching of the line, the inter-terminal communication system 1 reestablishes the session. During re-establishment of this session, the terminal device 10 on the transmitting side temporarily stores the communication state before switching the line, and after re-establishing the session, based on the stored communication state, Restore information sharing.

Moreover, when communicating by the LTE circuit between the several terminal devices 10 corresponding to the information sharing function, the communication system 1 between terminals can also be controlled as follows. In addition, when communicating by an LTE circuit between a plurality of terminal devices 10 corresponding to the information sharing function mentioned here, the case where information sharing communication is performed in a plurality of terminal devices 10 or a plurality of terminals is performed. A case in which a voice call is being made between the apparatuses 10 and both the terminal apparatuses 10 implement an application compatible with the information sharing function is included.
In this case, when the communication line between the plurality of terminal devices 10 can select the LTE line and the communication line other than the LTE line, the inter-terminal communication system 1 performs the communication line between the plurality of terminal devices 10 as the LTE line. And control so as not to switch to a communication line other than the LTE line.

  In addition, in information sharing communication among a plurality of terminal devices 10, there is a case of switching between a state of using an LTE line and a state of using a wireless LAN line, or a case in which a session once disconnected is reestablished. In this case, the inter-terminal communication system 1 establishes a session by omitting the acceptance procedure by the request-side terminal device 10 (or the request-side terminal device 10). In this case, the inter-terminal communication system 1 selects whether to omit the acceptance procedure based on the time from session switching or disconnection to session re-establishment. For example, the inter-terminal communication system 1 omits the acceptance procedure if the time from when the session is switched or disconnected to when the session is reestablished is less than or equal to a predetermined timeout time. Further, the inter-terminal communication system 1 does not omit the acceptance procedure if the time until the session is re-established after the session is switched or disconnected is longer than the predetermined timeout time. That is, when the session established once is switched or disconnected, the inter-terminal communication system 1 omits the acceptance procedure when the session is switched or disconnected for a relatively short time. Thus, the inter-terminal communication system 1 can reduce the time and effort of the user when the session is switched or disconnected.

Here, a specific example of switching of the communication line by the relay server 50 will be described.
The terminal device 10 transmits error information to the signaling server 20 when the session establishment fails. The error information is information indicating that a session has not been established within a predetermined time. That is, the error information is information indicating that communication for sharing information can not be performed between the terminal devices 10. Here, the predetermined time is a time-out time which is clocked when the connection request for session establishment is transmitted from the request-side terminal 10 to the request-side terminal 10, and is, for example, 2 seconds. The error information can be transmitted by both the request-side terminal device 10 and the request-side terminal device 10. That is, the signaling server 20 receives error information from either or both of the request-side terminal device 10 and the request-side terminal device 10.
In the following example, the case where the request-side terminal device 10 transmits error information to the signaling server 20 will be described.

When receiving the error information from the request-side terminal device 10, the signaling server 20 executes a procedure for switching the communication line with the relay server 50.
The request-side terminal device 10 transmits a room creation request to the signaling server 20. The room creation request is information that requests the relay server 50 to create a room. The room is a virtual space provided by the relay server 50 and used by the plurality of terminal devices 10 to share information. The rooms are distinguished, for example, as room 1, room 2 ... by the assigned number. The number assigned to this room is also called a room ID. The terminal device 10 connects to any of the rooms. Terminal devices 10 connected to a room with the same room ID can share information with each other. For example, when two terminal devices 10-1 and 10-2 are connected to the room 1, the two terminal devices 10-1 and 10-2 may share information with each other. it can.

The room creation request contains the telephone number of the terminal device 10 on the request side. That is, the request-side terminal device 10 transmits a room creation request including the telephone number of the request-side terminal device 10 to the signaling server 20.
When the signaling server 20 receives the telephone number of the terminal device 10 on the request side, the signaling server 20 outputs a request to the relay server 50 to confirm the free space of the relay server 50. When the relay server 50 receives the request to confirm the free space of the relay server 50, the relay server 50 determines whether or not a new room can be created, and transmits the determination result to the signaling server 20.
If the received determination result indicates that a new room can be created, the signaling server 20 transmits a room creation request to the relay server 50. As described above, the room creation request includes the telephone number of the terminal device 10 on the request side.
When receiving the room creation request, the relay server 50 issues a new room ID and creates a room with this room ID. The relay server 50 also issues an entry key for entering the created room. The relay server 50 transmits a response to the room creation request to the signaling server 20. The response to the room creation request includes the room ID issued by the relay server 50 and the entry key. Upon receiving the response to the room creation request, the signaling server 20 transmits information including the room ID and the entry key included in the response to the request-side terminal apparatus 10 as a response to the room creation request.

  The request-side terminal device 10 receives, from the signaling server 20, a response to the room creation request. As described above, the response to the room creation request includes the room ID issued by the relay server 50 and the entry key. The request-side terminal device 10 transmits, to the relay server 50, a request for entering the room. The room entry request includes the room ID received from the signaling server 20 and an entry key. That is, the request-side terminal device 10 transmits information including the room ID issued by the relay server 50 and the room entry key to the relay server 50 as a room entry request. When the relay server 50 receives the room entry request, the relay server 50 collates the room ID included in the room entry request with the entry key. If the combination of the room ID and the entry key is correct as a result of the comparison, the relay server 50 causes the request-side terminal device 10 to enter the room.

Further, the request-side terminal device 10 invites the request-side terminal device 10 to enter the room. Specifically, the request-side terminal device 10 transmits, to the signaling server 20, a request for an invitation to enter a room. The request for invitation to enter the room includes the identification information of the request-side terminal device 10, the identification information of the request-side terminal device 10, the room ID, and the entry key. Here, the identification information of the terminal device 10 is information for identifying the terminal device 10, such as the telephone number and the IP address of the terminal device 10.
When the signaling server 20 receives a request for invitation to enter a room from the request-side terminal device 10, the signaling server 20 transmits a push request to the push server 40. The push request includes identification information of the request-side terminal device 10, identification information of the request-side terminal device 10, a room ID, and an entry key.
When the push server 40 receives the push request from the signaling server 20, the push server 40 transmits invitation information for entering the room to the request-side terminal device 10. The invitation information for entering the room includes identification information of the terminal device 10 on the request side, identification information of the terminal device 10 on the request side, a room ID, and an entry key. In addition, when the push server 40 transmits invitation information for entering a room, the push server 40 transmits, to the signaling server 20, a response indicating that invitation information for entering a room has been sent. When the signaling server 20 receives the response indicating that the invitation information for entering the room has been sent, the signaling server 20 sends a response to the request for invitation for entering the room to the request-side terminal device 10.

On the other hand, when the request-side terminal device 10 receives the invitation information for entering the room from the push server 40, the user of the request-side terminal device 10 has received the invitation information for entering the room. Notify and wait for the operation to enter the room. When the user of the terminal device 10 on the request side performs an operation to enter the room, the terminal device 10 on the request side receives this operation, and the terminal device 10 on the request side enters the room to the room. Send a request for When the request-side terminal device 10 receives a request to enter a room from the request-side terminal device 10, the request-side terminal device 10 transmits a response to the request to enter the room to the request-side terminal device 10. The response to the request for entering the room includes information indicating the communication mode via the relay server 50. Here, the communication mode via the relay server 50 is also referred to simply as a relay mode or a relay mode. The communication mode in which the terminal devices 10 directly communicate with each other without the relay server 50 is also referred to as P2P mode or peer-to-peer mode.
In this example, it is assumed that the request-side terminal device 10 transmits a request for entering the room to the request-side terminal device 10 when the user enters the room entry operation. Although explained, it is not limited to this. The requested terminal device 10 may transmit a request for entering the room to the request-side terminal device 10 without requiring a user operation. As a result, the terminal device 10 on the requested side automatically requests the terminal device 10 on the requesting side to enter the room without requiring an operation by the user in rebuilding (reconnecting) the session. Can be sent.

  When the request-side terminal device 10 receives a response to the request for entering the room from the request-side terminal device 10, the request-side terminal device 10 transmits a request for entering the room to the relay server 50. The room entry request includes the room ID received from the push server 40 and an entry key. Here, the room ID received from the push server 40 matches the room ID of the room in which the terminal device 10 on the request side has already entered. Also, the room entry key received from the push server 40 matches the room entry key of the room in which the request-side terminal device 10 has already entered the room. That is, the request-side terminal device 10 transmits, to the relay server 50, a request for entering the room in which the request-side terminal device 10 has already entered. When the relay server 50 receives the room entry request, the relay server 50 collates the room ID included in the room entry request with the entry key. If the combination of the room ID and the room entry key is correct as a result of the comparison, the relay server 50 causes the requested terminal device 10 to enter the room.

  According to this procedure, the terminal device 10 on the request side and the terminal device 10 on the request side enter the same room provided by the relay server 50. This enables information sharing via the relay server 50 between the request-side terminal device 10 and the request-side terminal device 10.

[Modification: Operation of inter-terminal communication system (Modification 2): Periodic authentication operation]
After the session is established, the signaling server 20 determines at a predetermined frequency whether or not the terminal device 10 is a legitimate device. That is, the signaling server 20 periodically performs an operation of authenticating whether the terminal device 10 is a legitimate device at a predetermined frequency. The predetermined frequency is, for example, every few seconds. Further, the regular terminal device 10 mentioned here is a device in which the combination of the telephone number and the IP address matches the combination of the telephone number and the IP address registered in advance in the authentication server 30.
Thereby, the communication system 1 between terminals can exclude utilization of the information sharing function by the terminal device 10 which is not regular.

[Modification: Modification of session construction procedure]
Next, a modification of the session construction procedure of the inter-terminal communication system 1 will be described. In this modification, the inter-terminal communication system 1 constructs a session as follows. Here, the case where the registration of the terminal device 10 has already been completed will be described. Here, the process will be described in comparison with steps S100 to S210 in the procedure of session construction shown in FIG. For this reason, illustration of step S300 to step S370 about the procedure of the modification of a session construction procedure is abbreviate | omitted.

  The signaling server 20 receives a request for information sharing from the request-side terminal device 10 (step S300). This step S300 corresponds to the above-described steps S100 to S110. The request for information sharing includes the telephone number of the terminal device 10 on the request side and the telephone number of the terminal device 10 on the request side. That is, this modification differs from step S100 described above in that the request for information sharing includes the telephone number of the terminal device 10 on the request side.

  Next, the signaling server 20 compares the telephone number received in step S300 with the registration information stored in advance to determine whether the received telephone number is available (step S310). . This step S310 corresponds to the above-described step S12. Here, the signaling server 20 determines whether or not the telephone number of the terminal device 10 on the request side and the telephone number of the terminal device 10 on the request side are available. That is, the present modified example differs from step S120 described above in that the determination target whether or not it is usable includes the telephone number of the terminal device 10 on the request side.

  Next, if the signaling server 20 determines that the telephone number received in step S310 is available (step S310; YES), the IP address of the requestee is given to the requester terminal device 10 It transmits (step S320). In this case (step S310; YES), the signaling server 20 transmits session construction information to the push server 40 (step S330). This step S330 corresponds to the above-described steps S130 to S150. The session construction information includes the IP address of the request-side terminal device 10 and the push ID corresponding to the information sharing application operating on the terminal device 10. That is, this modification differs from step S130 to step S150 described above in that the procedure for the request-side terminal apparatus 10 to transmit a session construction request is omitted.

  When the push server 40 receives the session construction information transmitted in step S330, the push server 40 transmits the IP of the request-side terminal apparatus 10 to the request-side terminal apparatus 10 based on the push ID included in the session construction information. The address is pushed (step S340). Step S340 corresponds to step S160 described above. That is, this modification is different from step S160 described above in that the push server 40 pushes an IP address instead of the telephone number of the terminal apparatus 10 on the request side.

  When the push of step S340 is performed, the terminal device 10 of the request side displays an approval image of information sharing and waits for the user's approval operation (step S350). This step S350 corresponds to the above-described steps S170 to S180. That is, in the terminal device 10 of the requestee side, the present modification is different from the above-described step S170 in that the coincidence determination of the telephone numbers is omitted.

  The requested terminal device 10 transmits session construction approval information to the signaling server 20 when the user approves the operation (step S350; YES) (step S360). This step S360 corresponds to the above-described step S190. On the other hand, when the requested terminal device 10 performs an operation that the user does not approve (step S 350; NO), the request-side terminal device 10 via the signaling server 20 does not approve the information sharing. Send to to finish the process.

  Next, upon receiving the session construction approval information transmitted in step S360, the signaling server 20 constructs a session between the terminal device 10 on the request side and the terminal device 10 on the request side (step S370). , End the process of session construction. This step S370 corresponds to the above-described step S200. That is, according to the session construction procedure of the present modified example, it is possible to construct a session with a simpler procedure, as compared to the procedures from step S100 to step S200 described above.

[Modification of user interface: Sharing suspension / Prohibition of sharing some images]
Note that the information sharing function can interrupt or cancel the operation by the operation of the user. For example, when interrupting the operation while using the information sharing function, the user double-taps the display unit 100. The operation detection unit 110 of the terminal device 10 detects this double tap operation. When the operation detection unit 110 detects a double-tap operation during the operation of the information sharing function, the terminal device 10 interrupts the provision of the image information to the other terminal device 10 of the sharing partner.
Further, the terminal device 10 is configured to resume provision of image information to another terminal device 10 of the other party when the operation detection unit 110 detects a double tap operation while the operation of the information sharing function is interrupted. It is also good.

Moreover, although the terminal device 10 was demonstrated as what carries out the whole area | region of the display part 100 in a display screen sharing function until now, it is not restricted to this. The terminal device 10 may share an image of a partial area instead of the entire area of the display unit 100 in the display screen sharing function. For example, in a case where images of a plurality of applications are displayed on the display unit 100, the terminal device 10 may determine whether to share an image or not for each application or each type of application. Further, the terminal device 10 may not share the text area of the electronic mail, for example, when the image of the electronic mail application is displayed.
Note that the terminal device 10 may store in advance an application for which an image is to be shared. In this case, the user performs an operation on the terminal device 10 to select in advance an application that shares an image and an application that does not share an image among the applications having the information sharing function. The terminal device 10 stores an application for which an image is to be shared, based on the operation to select. Further, when the information sharing function is activated, the terminal device 10 determines whether or not the application is the target of the image sharing based on the information stored in advance.

[Modification: Tablet-type terminal]
In addition, although the case where the terminal device 10 is a mobile telephone, a smart phone, etc. was made into an example and demonstrated until now, it is not restricted to this. For example, the terminal device 10 may be a device such as a tablet. Here, the mobile phone and the smart phone are provided with the speaker 131 for telephone call and can talk to the ear. On the other hand, the tablet does not have the ear-call speaker 131. That is, the terminal device 10 may be a device not provided with the ear-call speaker 131. When the terminal device 10 is a tablet, a call may be made in the speaker mode.

[Modification: Sharing information during text communication]
Although the inter-terminal communication system 1 has been described as providing the information sharing function during voice communication in the above description, the present invention is not limited to this. The inter-terminal communication system 1 may provide an information sharing function during communication by text. For example, the inter-terminal communication system 1 may provide an information sharing function during a chat provided by the text chat application.

  While the embodiments of the present invention and the modifications thereof have been described above, these embodiments and the modifications thereof are presented as examples, and are not intended to limit the scope of the invention. These embodiments and their modifications can be implemented in other various forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and the gist of the invention, and are included in the invention described in the claims and the equivalent scope thereof.

  Each of the above-described devices has a computer inside. The process of each process of each device described above is stored in a computer readable recording medium in the form of a program, and the above process is performed by the computer reading and executing this program. Here, the computer readable recording medium refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory or the like. Alternatively, the computer program may be distributed to a computer through a communication line, and the computer that has received the distribution may execute the program.

Further, the program may be for realizing a part of the functions described above.
Furthermore, it may be a so-called difference file (difference program) that can realize the above-described functions in combination with a program already recorded in the computer system.

DESCRIPTION OF SYMBOLS 1 ... Terminal communication system, 10 ... Terminal device, 20 ... Signaling server, 30 ... Authentication server, 40 ... Push server, 50 ... Relay server

Claims (9)

A terminal information receiving unit that receives, from the terminal device, terminal identification information that includes the telephone number of the terminal device and identifies the terminal device;
The compatibility between the first application operating in the first terminal device among the plurality of terminal devices and the second application operating in the second terminal device different from the first terminal device among the plurality of terminal devices, Determination based on the telephone number of the first terminal device and the telephone number of the second terminal device included in the terminal identification information received by the terminal information receiving unit, and the registration information of the terminal device stored in advance The appropriateness determination unit to
In a session construction in which a session between the first application and the second application is output from the first terminal device to the second terminal device based on the determination result of the compatibility by the compatibility determining unit. A session construction unit configured on the basis of approval information transmitted from the second terminal device in response to a request;
Inter-terminal communication system comprising The inter-terminal communication system according to claim 1, further comprising: a determination result transmission unit that transmits the determination result by the compatibility determination unit to the first terminal apparatus according to the determination request transmitted by the first application. The session construction unit transmits the Internet protocol address of the first terminal device to the second terminal device via a push server based on the result of the determination of the compatibility by the compatibility determination unit. The communication system according to claim 1 or 2, wherein a request for establishing the session between the second application and the second application is output to the second terminal apparatus. Further comprising the second terminal device;
The second terminal device is
4. The display device according to claim 1, wherein an image for requesting approval for the request for session construction is displayed on a display unit included in the second terminal device when the session construction unit receives a request for session construction. Communication system between terminals given in one paragraph. The relay part which relays communication between a said 1st application and a said 2nd application based on the said session which the said session construction part builds is further provided with any one of the Claims 1-4 characterized by the above-mentioned. Communication system between terminals. Further comprising the first terminal device;
The first terminal device is
Whether to communicate with the second application via the relay unit or to communicate with the second application not via the relay unit based on the communication status between the first application and the second application The communication system between terminals according to claim 5 which chooses. A terminal information receiving procedure in which the server device receives, from the terminal device, terminal identification information that includes the telephone number of the terminal device and identifies the terminal device;
The server apparatus includes: a first application operating in a first terminal apparatus among the plurality of terminal apparatuses; and a second application operating in a second terminal apparatus different from the first terminal apparatus among the plurality of terminal apparatuses The compatibility is defined as the telephone number of the first terminal device and the telephone number of the second terminal device included in the terminal identification information received in the terminal information reception procedure, and the registration information of the terminal device stored in advance. Procedure for determining suitability based on
The server apparatus outputs a session between the first application and the second application from the first terminal apparatus to the second terminal apparatus based on the determination result of the compatibility in the compatibility determination procedure. A session construction procedure constructed on the basis of approval information transmitted from the second terminal device in response to a request for session construction;
An inter-terminal communication method comprising: In a computer provided in a server device that communicates with a terminal device,
A terminal information receiving step of receiving from the terminal device terminal identification information that includes the telephone number of the terminal device and identifies the terminal device;
The compatibility between the first application operating in the first terminal device among the plurality of terminal devices and the second application operating in the second terminal device different from the first terminal device among the plurality of terminal devices, Based on the telephone number of the first terminal apparatus and the telephone number of the second terminal apparatus included in the terminal identification information received in the terminal information receiving step, and the registration information of the terminal apparatus stored in advance. A suitability determination step of determining
In a session construction in which a session between the first application and the second application is output from the first terminal device to the second terminal device based on the determination result of the compatibility in the compatibility determination step. A session construction step of constructing based on approval information transmitted from the second terminal device according to a request;
Inter-terminal communication program to execute. A terminal information receiving unit that receives, from the terminal device, terminal identification information that includes the telephone number of the terminal device and identifies the terminal device;
The compatibility between the first application operating in the first terminal device among the plurality of terminal devices and the second application operating in the second terminal device different from the first terminal device among the plurality of terminal devices, Determination based on the telephone number of the first terminal device and the telephone number of the second terminal device included in the terminal identification information received by the terminal information receiving unit, and the registration information of the terminal device stored in advance The appropriateness determination unit to
In a session construction in which a session between the first application and the second application is output from the first terminal device to the second terminal device based on the determination result of the compatibility by the compatibility determining unit. A session construction unit configured on the basis of approval information transmitted from the second terminal device in response to a request;
Communication server comprising

Images