JP6081973B2 - Inter-terminal communication system, inter-terminal communication method, and inter-terminal communication program - Google Patents

Description

  Embodiments described herein relate generally to an inter-terminal communication system, an inter-terminal communication method, and an inter-terminal communication program.

  Conventionally, data communication by which voice data and image data can be mutually processed in real time between callers using these portable terminal devices by transmitting and receiving voice data and image data to and from each other. A system is known (see, for example, Patent Document 1).

JP 2000-261574 A

  In the data communication system as described above, personal information may be exchanged between portable terminal devices. For this reason, in such a data communication system, a secure communication environment is required. However, in the data communication system as described above, a secure communication environment has not been provided.

  An object of the present invention is to provide an inter-terminal communication system, an inter-terminal communication method, and an inter-terminal communication program capable of transmitting and receiving audio data and image data in real time between terminal devices in a secure communication environment. .

  One embodiment of the present invention includes a terminal information receiving unit that receives terminal information including terminal identification information for identifying a terminal device and application identification information for identifying an application that operates on the terminal device, from the terminal device; Compatibility between a first application that operates in the first terminal device of the terminal devices and a second application that operates in a second terminal device different from the first terminal device among the plurality of terminal devices, A conformity determination unit that determines based on terminal information; a determination result transmission unit that transmits a determination result by the conformity determination unit to the first terminal device in response to a determination request transmitted by the first application; The first application that has transmitted the communication start request in response to the communication start request transmitted by the first application. The session between the second application, a terminal communication system comprising a session constructing unit for constructing, based on the terminal information.

  The terminal-to-terminal communication system according to an embodiment of the present invention further includes a relay unit that relays communication between the first application and the second application based on the session constructed by the session construction unit. It is characterized by that.

  Moreover, the inter-terminal communication system according to an embodiment of the present invention further includes the first terminal device and the second terminal device, wherein the first terminal device includes the first application and the second application. On the basis of the communication status, whether to communicate with the second application via the relay unit or to communicate with the second application without going through the relay unit is selected.

  In the inter-terminal communication system according to an embodiment of the present invention, the session construction unit sends a request for session construction between the first application and the second application to the second terminal device via a push server. Is output to the second terminal device by communication with the second terminal device.

  In the inter-terminal communication system according to an embodiment of the present invention, the compatibility determination unit determines whether the first application and the second application are the same application based on the application identification information. By determining, the compatibility between the first application and the second application is determined.

According to one embodiment of the present invention, a server device receives terminal information from the terminal device including terminal identification information for identifying the terminal device and application identification information for identifying an application operating on the terminal device. The information reception procedure, the server device operates on a first application that operates on the first terminal device among the plurality of terminal devices, and a second terminal device that is different from the first terminal device among the plurality of terminal devices. A compatibility determination procedure for determining compatibility with the second application based on the terminal information, and a determination result by the compatibility determination procedure according to a determination request transmitted from the first application by the server device, a determination result transmitting step of transmitting to the first terminal apparatus, server apparatus, a communication opening that the first application sends And a session construction procedure for constructing, based on the terminal information, a session between the first application that has transmitted the communication start request and the second application in response to the request. It is.

  According to one embodiment of the present invention, a computer including a server device that communicates with a terminal device includes terminal identification information that identifies the terminal device and application identification information that identifies an application that operates on the terminal device. A terminal information receiving step for receiving information from the terminal device; a first application operating on the first terminal device among the plurality of terminal devices; and a second different from the first terminal device among the plurality of terminal devices. The compatibility determination step for determining compatibility with the second application operating in the terminal device based on the terminal information, and the determination result by the compatibility determination step according to the determination request transmitted by the first application A determination result transmission step of transmitting to the first terminal device; and the first application In response to a communication start request to be transmitted, a session construction step is performed for constructing a session between the first application that has transmitted the communication start request and the second application based on the terminal information. This is a terminal-to-terminal communication program.

  According to the present invention, it is possible to provide an inter-terminal communication system capable of transmitting and receiving audio data and image data between terminal devices in real time in a secure communication environment.

It is a schematic diagram which shows an example of a structure of the terminal device of this embodiment. It is a schematic diagram which shows an example of the share menu button displayed on the display part of the terminal device of this embodiment. It is a schematic diagram which shows an example of the outline | summary of the information sharing function which the communication system between terminals of this embodiment provides. It is a schematic diagram which shows an example of selection operation of the information sharing function which the communication system between terminals of this embodiment provides. It is a schematic diagram which shows an example of a structure of the communication system between terminals of this embodiment. It is a table | surface which shows an example of the registration information which the signaling server of this embodiment memorize | stores. It is a flowchart which shows an example of the operation | movement procedure of the registration of this embodiment. It is a flowchart which shows an example of the operation | movement procedure of session construction of this embodiment.

[Embodiment]
Hereinafter, an embodiment of the inter-terminal communication system 1 according to the present embodiment will be described with reference to the drawings.
The inter-terminal communication system 1 of the present embodiment provides an information sharing function among a plurality of terminal devices 10. The terminal device 10 here is a communication device that can communicate with each other by voice or text, and is, for example, a mobile phone or a smartphone. The terminal device 10 can be connected to a high-speed data communication line capable of transmitting and receiving voice information and image information through the same line. The high-speed data communication line is, for example, an LTE (Long Term Evolution) communication network. This high-speed data communication line provides a service (VoLTE; Voice over LTE) that enables voice calls in addition to transmission and reception of digital information such as images and characters.

  The information sharing function is a function for sharing image information or audio information among a plurality of terminal devices 10. More specifically, a certain terminal device 10 transmits image information or audio information to another terminal device 10. Accordingly, the inter-terminal communication system 1 displays or reproduces the image displayed on the transmission-side terminal device 10 or the sound being reproduced on the reception-side terminal device 10. The inter-terminal communication system 1 provides not only a one-way information sharing function from one terminal apparatus 10 to another terminal apparatus 10 but also a two-way information sharing function between the terminal apparatuses 10.

  The inter-terminal communication system 1 includes a plurality of terminal devices 10. In the following description, when distinguishing each of the plurality of terminal devices 10, for example, they are described as a terminal device 10-1 and a terminal device 10-2. Moreover, in the following description, when not distinguishing each of these several terminal devices 10, it describes as the terminal device 10 only. The configuration of the terminal device 10 will be described with reference to FIG.

[Configuration of terminal device]
FIG. 1 is a schematic diagram illustrating an example of a configuration of the terminal device 10 according to the present embodiment. The terminal device 10 includes a display unit 100, an operation detection unit 110, an imaging unit 120, a sound reproduction unit 130, a sound collection unit 140, a communication unit 150, and a control unit 160.

  The display unit 100 includes a liquid crystal display and displays images such as characters and photographs. The image displayed by the display unit 100 is for a user to select a standby image displayed when waiting for an incoming call, an application image provided by an application operating on the terminal device, and various functions provided by the terminal device. Menu images and so on.

  This application image includes a dialer image provided by a telephone (voice communication) application, and an address book image provided by an address book application that manages names, telephone numbers, and mail addresses. In addition, the application image includes a moving image provided by the moving image reproduction application, a web image provided by the web browser application, a map image provided by the map application, and a photo image provided by the photo album application. The application image includes various images such as a mail text image provided by the e-mail application and a chat image provided by the text chat application.

  Of the menu images displayed on the display unit 100, the menu image for selecting the information sharing function is particularly referred to as an information sharing menu image. The information sharing menu image is also referred to as a shared menu ball image or a shared menu button image. Here, the menu includes various menus in addition to the information sharing menu. For example, the menu includes a voice recognition menu. The voice recognition menu is a menu for selecting a voice recognition function. The voice recognition function is a function in which the terminal device 10 recognizes a voice and extracts a keyword corresponding to the recognized voice. The terminal device 10 displays a web page related to the keyword by outputting the extracted keyword to a search engine or the like. Further, the terminal device 10 displays a search result such as store information obtained by outputting the extracted keyword to a search engine or the like. The menu shown here is an example and is not limited to this. The functions selected by the menu include all functions that can be used during a voice call. In the following description, the shared menu ball image is also simply referred to as “shared ball”, and the shared menu button image is also simply referred to as “shared button”. An example of this shared menu button is shown in FIG.

  FIG. 2 is a schematic diagram illustrating an example of a shared menu button displayed on the display unit 100 of the terminal device 10. In this example, the shared menu button image PMB is displayed at an arbitrary position on the display unit 100 so as to overlap the application image PAP.

  Returning to FIG. 1, the operation detection unit 110 includes a transparent touch panel sensor that covers the display unit 100, and detects a user operation. There are various types of user operations. Examples of operation types include a tap operation, a drag operation, and a pinch operation. The tap operation is an operation in which the user releases the finger immediately after touching the finger at a position where the touch panel is located. The drag operation is an operation in which the user moves a finger touching the touch panel in a certain direction while touching the touch panel. The pinch operation is an operation in which the user changes the interval between two fingers that touch the touch panel. The tap operation includes a single tap operation that is touched only once and a double tap operation that repeats the single tap operation twice quickly. Further, the drag operation includes a swipe operation in which the moving speed is faster than that of the drag operation and a faster flick operation. The pinch operation includes a pinch-out operation that increases the interval between two fingers that touch the touch panel, and a pinch-in operation that decreases the interval between two fingers that touch the touch panel.

  Here, the case where the user performs an operation by touching the touch panel sensor with a finger has been described as an example, but the present invention is not limited thereto. For example, the user may operate using an operation indicator bar instead of a finger. That is, the operation detection unit 110 detects an operation with a finger or an object other than the finger (for example, a pointing stick) as a user operation.

  The imaging unit 120 includes a camera that can capture still images and moving images. The camera includes an imaging element such as a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor and an optical member such as a lens, and captures an image around the terminal device 10. The imaging unit 120 includes an in-camera 121 having a lens on the front side of the terminal device 10 (display surface side of the display unit 100) and an out-camera 122 having a lens on the back side of the terminal device 10. The in-camera 121 is used when imaging a user who operates the terminal device 10. The out camera 122 is used when capturing an image of the scenery around the terminal device 10.

  The sound reproducing unit 130 includes a speaker and reproduces sound based on input sound information. The sound reproducing unit 130 includes an ear-talking speaker 131 and a speaker mode speaker 132. The ear-talking speaker 131 is used when the terminal device 10 is placed on the user's ear to make a call. The speaker mode speaker 132 is used when sound is reproduced while the terminal device 10 is spoken from the ear. The case where the terminal device 10 is placed on the user's ear to make a call is also referred to as an earing mode or a normal call mode. A case where sound is reproduced while the terminal device 10 is spoken from the ear is also referred to as a hands-free mode, a speakerphone mode, or a speaker mode.

  Note that the terminal device 10 may include a proximity sensor 133 for switching between the ear-touch mode and the speaker mode. The proximity sensor 133 detects whether any object (for example, a user's ear) is close to the terminal device 10. In the case where the proximity sensor 133 is provided, when the proximity sensor 133 detects that an object is in proximity to the terminal device 10, the terminal device 10 switches to the earpiece mode. When the proximity sensor 133 detects that an object is not in proximity to the terminal device 10, the terminal device 10 switches to the speaker mode.

  The sound collection unit 140 includes a microphone, collects sounds around the terminal device 10, and converts the collected sounds into sound information. The sounds around the terminal device 10 include the noise around the terminal device 10, the sound that the user is making to make a call, and the sound that is produced by the speaker of the sound reproducing unit 130. That is, the sound collection unit 140 collects various sounds such as noise around the terminal device 10, the voice of the user during a call, and the sound emitted from the speaker of the terminal device 10.

  The communication unit 150 includes a communication control IC (Integrated Circuit), and performs communication with other devices. The terminal device 10 communicates with other devices by the communication operation by the communication unit 150. In the following description, description of the configuration and operation of the communication unit 150 is omitted.

  The control unit 160 includes a CPU (Central Processing Unit) and controls each unit included in the terminal device 10. The terminal device 10 performs operations such as display on the display unit 100, detection of an operation by the operation detection unit 110, communication with another device by the communication unit 150, and the like by the control of each unit by the control unit 160. In the following description, description of the configuration and operation of the control unit 160 is omitted.

[Overview of information sharing function]
Next, an overview of the information sharing function provided by the inter-terminal communication system 1 will be described with reference to FIG.
FIG. 3 is a schematic diagram illustrating an example of an outline of an information sharing function provided by the inter-terminal communication system 1. Examples of the information sharing function provided by the inter-terminal communication system 1 include a function for sharing an image being displayed, a function for sharing a handwritten image, a function for sharing position information, and an image captured by a camera. There is a function.
An example of the display image by the function of sharing the image being displayed is shown in FIG. An example of a display image by a function for sharing a handwritten image is shown in FIG. An example of a display image by the function of sharing position information is shown in FIG. An example of a display image by a function of sharing an image captured by the camera is shown in FIG.

  These information sharing functions are provided by an information sharing function application that operates on the terminal device 10. In the following description, this information sharing function application is also referred to as an information sharing application AP1. The information sharing application AP1 provides an information sharing function by operating in cooperation with the basic software in the terminal device 10 and other applications.

  Here, the basic software in the terminal device 10 with which the information sharing application AP1 cooperates includes communication software for the terminal device 10 to communicate with other devices. Other applications in the terminal device 10 with which the information sharing application AP1 cooperates include a basic address book application AP2 and an image sharing address book application AP3.

  The basic address book application AP2 is an application that stores thumbnail images, names, telephone numbers, mail addresses, and the like of communication partners. That is, the basic address book application AP2 is an application provided as a basic function of the terminal device 10 regardless of whether or not the terminal device 10 supports the information sharing function. Here, the case where the terminal device 10 is compatible with the information sharing function refers to the case where the terminal device 10 has installed an application that provides the information sharing function. Further, the case where the terminal device 10 does not support the information sharing function refers to a case where the terminal device 10 does not install an application that provides the information sharing function.

  The image sharing address book application AP3 is an application that displays operation buttons and the like used for image sharing. The image sharing address book application AP3 displays various operation images so that a user operating the terminal device 10 can easily use the information sharing function. The image sharing address book application AP3 is an application that provides an information sharing function.

  Here, in describing the information sharing function, a description method of the terminal device 10 in the description of the present embodiment will be described. The operation state of the terminal device 10 has the following two distinctions.

  The first distinction is a distinction between the terminal device 10 that requests information sharing and the terminal device 10 that requests information sharing. In the following description, the terminal device 10 that requests information sharing among the plurality of terminal devices 10 is also referred to as the requesting terminal device 10, and the terminal device 10 that is requested to share information The terminal device 10 on the side is also described. The requesting terminal device 10 makes a request for information sharing to the requested terminal device 10. When the request-side terminal device 10 receives an information sharing request from the request-side terminal device 10, the requested-side terminal device 10 accepts the request to start information sharing with the request-side terminal device 10. In the following description, of the plurality of terminal devices 10, the requesting terminal device 10 is also referred to as a terminal device 10-1, and the requested terminal device 10 is also referred to as a terminal device 10-2.

The second distinction is a distinction between the terminal device 10 that transmits information to be shared and the terminal device 10 that receives information to be shared. In the following description, the terminal device 10 that transmits information to be shared among the plurality of terminal devices 10 is also referred to as an information transmitting terminal device 10 or a terminal device 10-S. Further, the terminal device 10 on the information receiving target side is also referred to as an information receiving terminal device 10 or a terminal device 10-R.
Note that which of the requesting terminal device 10 and the requested terminal device 10 transmits information to be shared and which receives this information depends on the function between the information sharing functions. It depends on the difference and the operating state of the terminal device 10. That is, in the inter-terminal communication system 1, there are a case where the requesting terminal device 10 transmits information to be shared information and a case where the requested terminal device 10 transmits information to be shared information.

  In the following description, the terminal device 10 may be described by combining the first distinction and the second distinction described above. In this case, the terminal device 10 on the requesting side and the information transmitting side is also referred to as a terminal device 10-1S. The terminal device 10 on the requesting side and the information receiving side is also referred to as a terminal device 10-1R. The terminal device 10 on the requested side and the information transmission side is also referred to as a terminal device 10-2S. The terminal device 10 on the requested side and the information receiving side is also referred to as a terminal device 10-2R.

[Information sharing function 1: Sharing images being displayed (display screen sharing function)]
Next, an overview of each information sharing function will be described with reference to FIG. Among the information sharing functions provided by the inter-terminal communication system 1, first, sharing of an image being displayed (display screen sharing function) will be described.

  The inter-terminal communication system 1 provides a display screen sharing function. With this display screen sharing function, an image P1 displayed on the display unit 100 of the terminal device 10 is displayed as an image P2 on the display unit 100 of another terminal device 10, whereby an image is displayed between the terminal devices 10. It is a function to share. An example of a screen displayed on the terminal device 10 by this display screen sharing function is shown in FIG. The image displayed on the display unit 100 here includes the above-described standby image, application image, and menu image.

  When the display screen sharing function is selected in a certain terminal device 10-1, the inter-terminal communication system 1 uses the image P1 displayed on the display unit 100 of the terminal device 10-1 as a sharing destination. Is displayed on the display unit 100 of the terminal device 10-2 as an image P2.

  A specific example of this display screen sharing function will be described. For example, a case will be described in which a photo album application is activated in the terminal device 10-1, and this photo album application displays a photo image (image P1 shown in FIG. 3A) on the display unit 100. . In this case, the inter-terminal communication system 1 displays the image P1 of the photograph displayed on the display unit 100 of the terminal device 10-1 as the image P2 on the display unit 100 of the other terminal device 10-2 that is the sharing destination. Let In this way, the image P1 of the same photograph is displayed on the respective display units 100 of the two terminal devices 10, whereby the photograph image P1 is shared.

  Next, another specific example of the display screen sharing function will be described. For example, a case where a moving image application is activated in the terminal device 10-1 and the moving image application displays a moving image with sound on the display unit 100 will be described. In this case, the inter-terminal communication system 1 displays the moving image displayed on the display unit 100 of the terminal device 10-1 on the display unit 100 of the other terminal device 10-2 that is the sharing destination. In this way, the same moving image is displayed on the respective display units 100 of the two terminal devices 10, thereby sharing the moving image. Simultaneously with the image sharing, the inter-terminal communication system 1 reproduces the sound reproduced from the sound reproduction unit 130 of the terminal device 10-1 from the sound reproduction unit 130 of the other terminal device 10-2 that is the sharing destination. Let In this way, the sound attached to the moving image is shared by reproducing the same sound from the sound reproducing units 130 of the two terminal devices 10. In this way, a moving image with sound is shared between the two terminal devices 10. That is, according to the inter-terminal communication system 1, it is possible to share both information of image information and sound information.

[Information sharing function 2: Sharing handwritten images (handwriting sharing function)]
Next, among the information sharing functions provided by the inter-terminal communication system 1, handwritten image sharing (handwriting sharing function) will be described with reference to FIG.
The inter-terminal communication system 1 provides a handwriting sharing function for sharing an image of a handwritten graphic. Here, the handwritten graphic image is an image of a drag operation locus displayed on the display unit 100 by dragging the operation detection unit 110 of the terminal device 10 with a finger or the like. That is, the handwriting sharing function refers to an image P3 of a handwritten graphic displayed on the display unit 100 by dragging the operation detection unit 110 of the terminal device 10 with a finger or the like on the display unit 100 of another terminal device 10. This is a function of sharing an image between the terminal devices 10 by displaying as P4.

  A specific example of the handwriting sharing function will be described. For example, the case where the handwriting tool application is activated in the terminal device 10-1 and the handwriting tool application displays an image of a handwritten graphic (image P3 shown in FIG. 3B) on the display unit 100 will be described. To do. In this case, the inter-terminal communication system 1 uses the image P3 of the handwritten graphic displayed on the display unit 100 of the terminal device 10-1 as the image P4 on the display unit 100 of the other terminal device 10-2 that is the sharing destination. Display. In this way, by displaying the same handwritten graphic image on the display units 100 of the two terminal devices 10, the handwritten graphic image is shared.

[Image layer display]
Note that the display unit 100 of the terminal device 10 displays a photograph (for example, the image P5 in FIG. 3B) displayed by the photo album application and a handwritten graphic image (for example, FIG. 3B) displayed by the handwriting tool application. The image P3) can be displayed in an overlapping manner. That is, the display unit 100 of the terminal device 10 can display a plurality of images stacked. In this case, the display unit 100 displays an image using a layer set for each application. This layer is a logical hierarchy of images displayed in a stacked manner.
For example, the display unit 100 displays the image P5 on a first layer that is a lower layer, and the image P3 on a second layer that is a higher layer than the first layer. Here, the upper layer is a layer that displays an image on the near side (side closer to the user) among the plurality of stacked layers. The lower layer is a layer that displays an image on the back side (the side far from the user) among the plurality of stacked layers. For images displayed on these layers, the opacity can be set between 0% and 100%, for example. When the opacity of the image displayed on the upper layer is 100%, the upper image becomes opaque and the lower layer image is hidden, so the lower layer image is not displayed. When the opacity of the image displayed on the upper layer is 0%, the upper image becomes transparent, and the lower layer image is displayed transparently without being hidden.
When there are a plurality of regions in a certain layer, this opacity can be set for each of these regions. For example, if the layer on which the handwriting tool application displays an image includes an area where an image of a handwritten graphic is displayed and an area where nothing is displayed, the opacity of these areas can be set for each area. it can.

Further, the operation detection unit 110 detects an operation for the highest layer. In this example, a case will be described in which the handwriting tool application displays the handwritten graphic image P3 on the second highest layer. In this case, the operation detection unit 110 outputs an operation (for example, a drag operation) detected by the touch panel to a handwriting tool application displaying an image on the highest layer. Based on the drag operation output from the operation detection unit 110, the handwriting tool application displays an image indicating the locus of the drag operation on the display unit 100 as an image of a handwritten figure.
Here, as another example, a case will be described in which the menu control software displays a shared menu button image in a third layer higher than the second layer. In this case, the operation detection unit 110 detects an operation on the highest layer, that is, the third layer. The operation detection unit 110 detects an operation (for example, a tap operation) with respect to the position where the shared menu button image is displayed by using the touch panel. The operation detection unit 110 outputs the detected operation (for example, a tap operation) to menu control software displaying an image on the highest layer. The menu control software selects a function corresponding to the position of the tap operation based on the operation output from the operation detection unit 110, and provides the selected function.
That is, the operation detection unit 110 detects an operation on the highest layer among a plurality of layers of the image displayed on the display unit 100. Therefore, in the example shown in FIG. 3B, when the image P3 of the handwritten graphic is displayed on the lower layer than the image P5 of the photograph, even if the user operates the touch panel of the display unit 100, The image of the handwritten figure corresponding to this operation is not drawn.

In the handwriting sharing function, the inter-terminal communication system 1 can also share a handwritten graphic image bidirectionally between the plurality of terminal devices 10. Specifically, the inter-terminal communication system 1 displays an image P3 of a handwritten graphic displayed on the display unit 100 of the terminal device 10-1 on the display unit 100 of another terminal device 10-2 that is a sharing destination. Display as P4. In this case, the inter-terminal communication system 1 displays the image P6 of the handwritten graphic displayed on the display unit 100 of the terminal device 10-2 on the display unit 100 of the other terminal device 10-1 that is the sharing destination. Display. In this way, by displaying the image of the handwritten graphic on the respective display units 100 of the two terminal devices 10, the image of the handwritten graphic is shared bidirectionally.
In the handwriting sharing function, the mechanism in which the inter-terminal communication system 1 shares an image and the mechanism in which the inter-terminal communication system 1 shares an image in the display image sharing function described above are different in the following points. That is, in the display image sharing function, the inter-terminal communication system 1 shares an image by sharing data obtained by capturing an image displayed on the display unit 100 between the terminal devices 10. On the other hand, in the handwriting sharing function, the inter-terminal communication system 1 shares an image by sharing data for drawing an image, not data obtained by capturing an image. Specifically, in the handwriting sharing function, the terminal device 10-S on the information transmission side, such as the coordinate data of the handwritten graphic detected by the operation detection unit 110 of the terminal device 10-S, and the color and thickness of the line, etc. Data (that is, data for drawing an image) is transmitted to the terminal device 10-R on the information receiving side. The terminal device 10-R on the information receiving side displays an image on the display unit 100 of the terminal device 10-R based on the received coordinate data of the handwritten figure and data such as line color and thickness.

[Information Sharing Function 3: Location Information Sharing (Location Information Sharing Function)]
Next, among the information sharing functions provided by the inter-terminal communication system 1, sharing of location information (location information sharing function) will be described with reference to FIG.
The inter-terminal communication system 1 provides a position information sharing function for sharing position information among a plurality of terminal devices 10. Here, the position information is information indicating a certain position such as a current position of the terminal device 10 or a position designated by the user. Hereinafter, as an example, a case will be described in which this position information is information indicating the current position of the terminal device 10.
The position information includes information indicating the current position of the terminal device 10. The information indicating the current position includes, for example, longitude, latitude, altitude, and direction / direction of the terminal device 10. When the current position of the terminal device 10 is in a building, for example, the position information includes the name of the building, the number of floors (floor name) of the current position, the name of the room in the building, and the like. It may be. In addition, when the current position of the terminal device 10 is, for example, in a theater, a movie theater, or a sports game venue, the position information includes a seat position, a seat symbol number, and a seat type (for example, Reserved seats and non-reserved seats) may be included.

  A specific example of this position information sharing function will be described. For example, a map application is activated in the terminal device 10-1, and this map application displays a map image (map image P9 shown in FIG. 3C) around the current position of the terminal device 10-1. The case where it is displayed in will be described. In this case, the inter-terminal communication system 1 displays the map image P9 displayed on the display unit 100 of the terminal device 10-1 as the map image P10 on the display unit 100 of the other terminal device 10-2 that is the sharing destination. Let In this way, the same map image is displayed on each of the display units 100 of the two terminal devices 10 so that the map image is shared.

  Here, the terminal device 10-1 displays position information indicating the current position of the terminal device 10-1 together with the map image P9 on the terminal device 10-2. Thus, the position information indicating the current position of the terminal device 10-1 is displayed together with the map image on the display units 100 of the two terminal devices 10, so that the map image and the terminal device 10-1 The current position is shared.

  In the location information sharing function, the inter-terminal communication system 1 can also share location information bidirectionally between a plurality of terminal devices 10. Specifically, the inter-terminal communication system 1 displays the terminal device 10 when the position information indicating the current position of the terminal device 10-1 is displayed together with the map image P9 on the display unit 100 of the terminal device 10-2. -2 is displayed together with the map image P10 on the display unit 100 of the terminal device 10-1. Thus, the position information indicating the current position of the terminal device 10-1 and the position information indicating the current position of the terminal device 10-2 are displayed together with the map image on each display unit 100 of the two terminal devices 10. Is done. Thereby, the current positions of the plurality of terminal devices 10 are shared bidirectionally.

[Information sharing function 4: Camera image sharing (camera image sharing function)]
Next, among the information sharing functions provided by the inter-terminal communication system 1, camera image sharing (camera image sharing function) will be described with reference to FIG.
The inter-terminal communication system 1 provides a camera image sharing function for sharing camera images among a plurality of terminal devices 10. Here, the camera image is an image captured by the imaging unit 120 of the terminal device 10. This camera image includes an image of a landscape around the terminal device 10 and an image of a user who operates the terminal device 10. In addition, the camera image includes a real-time image currently captured by the imaging unit 120 of the terminal device 10. That is, the camera image includes a real-time image indicating the current scenery around the terminal device 10 and a real-time image indicating the current state of the user who operates the terminal device 10.

  A specific example of this camera image sharing function will be described. For example, a camera application is activated in the terminal device 10-1, and the camera application displays a real-time image (the real-time image P11 shown in FIG. 3D) that shows the current scenery around the terminal device 10-1. The case where it is displaying on the part 100 is demonstrated. In this case, the inter-terminal communication system 1 displays the real-time image P11 displayed on the display unit 100 of the terminal device 10-1 as the real-time image P12 on the display unit 100 of the other terminal device 10-2 that is the sharing destination. Let In this way, the same real-time image is displayed on the respective display units 100 of the two terminal devices 10, whereby the real-time image is shared.

[Overview of selecting information sharing function]
Next, an outline of an operation for the user to activate the information sharing function will be described with reference to FIG.
FIG. 4 is a schematic diagram illustrating an example of the selection operation of the information sharing function provided by the inter-terminal communication system 1 of the present embodiment.
Here, a case where user A (Mr. A) and user B (Mr. B) use display screen sharing using the terminal device 10 will be described as an example. In the description of this example, the terminal device 10 used by the user A is the requesting and information transmitting terminal device 10, that is, the terminal device 10-1S. In the description of this example, the terminal device 10-2 is the terminal device 10 on the requested side and the information receiving side, that is, the terminal device 10-2R. Some terminal devices 10 may not support the display screen sharing function. In the description of this example, a case where each terminal device 10 is compatible with the display screen sharing function will be described.

  The user A and the user B use the display screen sharing function by sequentially performing the operations shown in FIGS. 4A to 4E. The user A and the user B are making a voice call via the LTE communication network. FIG. 4A shows an example of an image displayed on each terminal device 10 when the user A and the user B are making a voice call via the LTE communication network.

  At this time, the image PMB of the shared menu button is displayed on both the display unit 100 of the terminal device 10-1S of the user A and the display unit 100 of the user B. The display of the image PMB of the sharing menu button indicates that the terminal device 10 on the communication partner side supports one of the information sharing functions described above. In this example, the display of the shared menu button image PMB indicates that both the terminal device 10-1S and the terminal device 10-2R support the display screen sharing function.

  User A taps the image PMB of the shared menu button displayed on the display unit 100 of the terminal device 10-1S. When the operation detection unit 110 of the terminal device 10-1S detects this tap operation, a launcher image P20 is displayed (see FIG. 4B). The launcher image P20 is an example of the menu image described above. In this example, the launcher image P20 shows icon images of a display screen sharing function, a handwriting sharing function, a position information sharing function, and a camera sharing function. When the user taps the position on the display unit 100 where the icon image is displayed, the function associated with the icon image is activated. Here, a case where the user A taps the icon image P21 of the display screen sharing function among the information sharing functions displayed on the launcher image P20 will be described.

  When the operation detection unit 110 of the terminal device 10-1S detects this tap operation, a function explanation image P22 of the display screen sharing function is displayed (see FIG. 4C). When the operation detection unit 110 of the terminal device 10-1S detects this tap operation, the screen sharing start consent image P23 is displayed on the display unit 100 of the sharing destination terminal device 10-2R. The consent image P23 is an image displayed on the requesting terminal device 10 for information sharing, and prompts the user to perform an operation indicating whether or not to accept the information sharing request by the requesting terminal device 10. It is an image. In this example, the consent image P23 is an image prompting the user B to perform a tap operation indicating whether or not to accept the screen sharing request from the user A.

  Next, the user B taps the image P24 of the consent button of the consent image P23. When the operation detection unit 110 of the terminal device 10-2R detects this tap operation, an image P25 indicating that it is connected is displayed on each display unit 100 of the terminal device 10-2R and the terminal device 10-1S (FIG. 4 ( See D)). At this time, an inter-terminal communication session for display screen sharing is established between the terminal device 10-1S and the terminal device 10-2R.

  Next, when a session for inter-terminal communication for display screen sharing is established between the terminal device 10-1S and the terminal device 10-2R, an image P26 displayed on the display unit 100 of the terminal device 10-1S. Is displayed as an image P27 on the display unit 100 of the terminal device 10-2R (see FIG. 4E). That is, display screen sharing is started between the terminal device 10-1S and the terminal device 10-2R.

[Configuration of inter-terminal communication system]
Next, the configuration of the inter-terminal communication system 1 that provides the above-described information sharing function will be described with reference to FIG.
FIG. 5 is a schematic diagram illustrating an example of the configuration of the inter-terminal communication system 1 of the present embodiment. The inter-terminal communication system 1 includes the following devices in addition to the plurality of terminal devices 10 (in this example, the terminal device 10-1S and the terminal device 10-2R). That is, the inter-terminal communication system 1 includes a signaling server 20, an authentication server 30, a push server 40, and a relay server 50.

  The signaling server 20 manages a session of information sharing communication performed between the terminal devices 10. Specifically, the signaling server 20 can communicate with a plurality of terminal devices 10, the authentication server 30, and the push server 40. When the terminal device 10 supports the information sharing function, the signaling server 20 performs registration (initial registration) of information of the terminal device 10. Further, when there is a request for information sharing from the terminal device 10, the signaling server 20 performs signaling processing for establishing a communication session with the sharing destination terminal device 10. In addition, when there is a request for information sharing from the terminal device 10, the signaling server 20 returns a response as to whether or not the terminal device 10 that is the sharing request destination is compatible with the information sharing function. To do.

The signaling server 20 includes a terminal information reception unit, a suitability determination unit, a determination result transmission unit, and a session construction unit as functional units.
Among these, the terminal information receiving unit receives terminal information from the terminal device 10. The terminal information includes terminal identification information for identifying the terminal device 10 and application identification information for identifying an application operating on the terminal device 10.
The suitability determination unit determines suitability between the first application operating in the terminal device 10-1 and the second application operating in the terminal device 10-2 based on the terminal information.
The determination result transmission unit transmits the determination result by the suitability determination unit to the terminal device 10-1 in response to the determination request transmitted by the first application operating in the terminal device 10-1.
The session construction unit constructs a session between the first application that transmitted the communication start request and the second application in response to the communication start request transmitted by the first application based on the terminal information.

  Further, the signaling server 20 determines whether or not the terminal device 10 is a legitimate device at the start of session construction. Whether or not the terminal device 10 is a legitimate device can be determined by various means. In this example, the signaling server 20 determines whether or not the terminal device 10 is a regular device based on the telephone number and the IP address transmitted from the terminal device 10. More specifically, the signaling server 20 is based on whether or not the telephone number and IP address transmitted from the terminal apparatus 10 match the telephone number and IP address previously assigned to the terminal apparatus 10. Then, it is determined whether or not the terminal device 10 is a regular device. In the following description, the determination performed by the signaling server 20 as to whether or not the terminal device 10 is a regular device is also referred to as secure determination.

  In addition, the signaling server 20 stores registration information. The signaling server 20 uses this registration information to perform session construction and secure determination. Registration information stored in the signaling server 20 will be described with reference to FIG.

  FIG. 6 is a table showing an example of registration information stored in the signaling server 20 of the present embodiment. The signaling server 20 stores the telephone number of the terminal device 10, the terminal model name, the push ID, and the application version as registration information. Here, the push ID is identification information for identifying an application for the information sharing function that operates on the terminal device 10.

  Returning to FIG. 5, after the session is established, the signaling server 20 determines whether or not the terminal device 10 is a regular device at a predetermined frequency. The signaling server 20 establishes a session or maintains an established session only when it is determined that the terminal device 10 is a legitimate device. Specifically, when the signaling server 20 determines that the terminal device 10 is a legitimate device, the signaling server 20 issues a token to the terminal device 10. This token is permission information for the terminal devices 10 to communicate with each other via a high-speed communication line. This token has an expiration date from the time of issue. The terminal device 10 can share screen information with other terminal devices 10 when this valid token is issued. Further, the terminal device 10 cannot share screen information with other terminal devices 10 when a token has not been issued and when the validity period of the issued token has expired. In this way, the signaling server 20 manages a session between the terminal devices 10.

  The authentication server 30 stores the telephone number of the terminal device 10 and the Internet protocol address (IP address) in association with each other. When there is a request for an IP address corresponding to the telephone number from the signaling server 20, the authentication server 30 returns an IP address corresponding to the telephone number of the terminal device 10 to the signaling server 20.

  If the combination of the telephone number and the IP address for a certain terminal device 10 does not match the combination of the telephone number and the IP address stored in the authentication server 30, this terminal device 10 is not a legitimate device. there is a possibility. The signaling server 20 acquires a telephone number and an IP address from a certain terminal device 10, and compares the telephone number and the IP address stored in the authentication server to see if the combination of the telephone number and the IP address matches. Determine. As a result of this comparison, when it is determined that the combination of the telephone number and the IP address matches, the signaling server 20 issues a token to the terminal device 10. Further, as a result of this comparison, when it is determined that the combination of the telephone number and the IP address does not match, the signaling server 20 does not issue a token to the terminal device 10.

  The push server 40 stores a plurality of push IDs. The push ID stored in the push server 40 is associated with the application operating on the terminal device 10 by the signaling server 20. Specifically, when a new downloaded application is activated for the first time in the terminal device 10, the terminal device 10 requests the push server 40 to issue a push ID. The push server 40 issues a push ID for the new application of the terminal device 10 based on this request, and transmits the issued push ID to the terminal device 10. The terminal device 10 transmits information associating the new application and the issued push ID as registration information to the signaling server 20. The signaling server 20 stores the registration information transmitted from the terminal device 10. Thereby, the push ID stored in the push server 40 and the application operating on the terminal device 10 are associated by the signaling server 20.

  Further, when the application is upgraded in the terminal device 10, the push server 40 issues a new push ID along with the upgrade. That is, the push server 40 is updated with the update of the application version of the application running on the terminal device 10.

  Further, when the signaling server 20 requests the requesting terminal device 10 to start the session construction, the push server 40 uses the push technology to obtain the telephone number of the requesting terminal device 10 by the push technique. 10 is transmitted. This push technology is a technology for delivering a communication request to the terminal device 10 from the server device side (in this example, the signaling server 20 and the push server 40 side) using an IP address. In the following description, transmitting information by the push technique is also referred to as simply pushing information.

  The relay server 50 is a relay server that performs information sharing communication between a plurality of terminal devices 10 when peer-to-peer connection is not possible in information sharing communication between the plurality of terminal devices 10. A peer-to-peer connection is also referred to as a P2P connection. When a P2P session of information sharing communication between a plurality of terminal devices 10 cannot be established even after a predetermined time, a session via the relay server 50 is established.

[Operation procedure of inter-terminal communication system]
Next, with reference to FIG.7 and FIG.8, the operation | movement procedure of the communication system 1 between terminals is demonstrated. First, an operation procedure of registration (initial setting) of the terminal device 10 will be described with reference to FIG. Next, with reference to FIG. 8, the operation procedure of session construction by the inter-terminal communication system 1 will be described. Note that the numbers in step S shown in FIG. 5 correspond to the numbers in step S in FIGS. 7 and 8.

[Operation procedure of inter-terminal communication system 1: initial setting]
With reference to FIG. 7, an operation procedure of registration (initial setting) of the terminal device 10 will be described. Here, a case where the terminal device 10-1 and the terminal device 10-2 perform registration in order will be described.

FIG. 7 is a flowchart illustrating an example of an operation procedure of registration according to the present embodiment.
When the application corresponding to the information sharing function is activated in the terminal device 10-1, the terminal device 10-1 transmits a push ID issuance request corresponding to the activated application to the push server 40 ( Step S10).
Upon receiving the push ID issuance request, the push server 40 transmits a push ID corresponding to the activated application to the terminal device 10-1 (step S20). The terminal device 10-1 acquires a push ID from the push server 40 (step S30).

  Next, the terminal device 10 transmits registration information to the signaling server 20 (step S40). Here, the registration information includes the push ID acquired in step S10, the application version information of the application corresponding to the push ID, the phone number of the own device, and the terminal model name of the own device.

  The signaling server 20 stores the registration information transmitted in step S20 (step S50), and ends the registration process for the terminal device 10-1.

  Next, the signaling server 20 transmits a telephone number to the authentication server 30 (step S60). This telephone number is a telephone number included in the registration information transmitted in step S20.

  The authentication server 30 receives the telephone number transmitted in step S60, determines whether this telephone number is a telephone number registered in advance, and transmits this determination result to the signaling server 20 (step). S70). Here, the telephone number registered in advance in the authentication server 30 is information indicating that the terminal device 10 is a legitimate terminal device 10. That is, the authentication server 30 determines whether or not the telephone number included in the registration information transmitted from the terminal device 10 is the regular telephone number of the terminal device 10. Moreover, the regular terminal device 10 here is the terminal device 10 used by a regular user registered in advance. That is, the signaling server 20 determines whether or not the terminal device 10 that has transmitted the registration information is a terminal device 10 that is used by a registered regular user. That is, the signaling server 20 authenticates the user of the terminal device 10 in step S60 and step S70.

  Also, the terminal device 10-2 performs registration through steps S10-2 to S70-2 shown in FIG. Here, Steps S10-2 to S70-2 correspond to Steps S10 to S50 described above. A description of steps S10-2 to S70-2 will be omitted.

[Operation of inter-terminal communication system 2: session construction]
Next, with reference to FIG. 8, the operation procedure of session construction of the terminal device 10 will be described.
FIG. 8 is a flowchart illustrating an example of an operation procedure for session construction according to this embodiment. Here, the case where a session is constructed | assembled between the terminal device 10-1 and the terminal device 10-2 is demonstrated. Here, a case will be described in which the terminal device 10-1 is the information sharing requesting side and the terminal device 10-2 is the information sharing requested side.

The requesting terminal device 10-1 transmits an information sharing request to the signaling server 20 (step S100).
The signaling server 20 receives an information sharing request from the terminal device 10 (step S110). This request for information sharing includes the telephone number of the requested terminal device 10.

Next, the signaling server 20 compares the telephone number received in step S110 with the registration information stored in advance, and determines whether or not the received telephone number is available (step S120). .
The signaling server 20 can also determine the push ID instead of or in addition to the determination of the telephone number. Specifically, the signaling server 20 determines whether or not the push ID is registered in the registration information corresponding to the telephone number received in step S110.

  Next, when the signaling server 20 determines that the telephone number received in step S110 is available (step S120; YES), the information sharing function can be used for the requesting terminal device 10. A notice to that effect is sent (step S130). On the other hand, if the signaling server 20 determines that the telephone number received in step S110 is not usable (step S120; NO), the information sharing function cannot be used for the requesting terminal device 10. This is notified and the process is terminated.

  In the above description, the signaling server 20 indicates that the information sharing function can be used for the requesting terminal device 10 in the process of establishing a session after the signaling server 20 requests information sharing. Although described as notification, it is not limited to this. As an example, the signaling server 20 may notify the requesting terminal device 10 that the information sharing function is available before the information sharing request is made. In this case, the signaling server 20 sends a request to the requesting terminal device 10 before the information sharing request is made by the background processing of the voice call at the start of the voice call between the terminal devices 10 or during the voice call. That the information sharing function is available.

  As another modification, the signaling server 20 may notify that the information sharing function can be used according to the conditions exemplified below instead of or in addition to the determination of the telephone number. Good. As an example, the signaling server 20 indicates that the information sharing function can be used when the information sharing application is installed in both the requesting terminal device 10 and the requested terminal device 10. Notice. As an example, in the signaling server 20, the application version of the information sharing application installed in the requesting terminal device 10 and the application version of the information sharing application installed in the requested terminal device 10 are the same. If it is, it is notified that the information sharing function is available. Further, as an example, the signaling server 20 is compatible with the information sharing application installed in the requesting terminal device 10 and the information sharing application installed in the requested terminal device 10. Notify that the information sharing function is available.

  As another example, the signaling server 20 is a terminal device in which both the requesting terminal device 10 and the requested terminal device 10 support communication via a high-speed data communication line (for example, VoLTE). In such a case, a notification that the information sharing function is available is sent.

Next, when receiving the notification that the information sharing function is available, the requesting terminal device 10 transmits a session construction request to the signaling server 20 (step S140). This request for session construction includes the telephone number and IP address of the terminal device 10 on the transmission request side and the telephone number of the terminal device 10 on the request side.
Note that there is no limitation on the order of processing timing between step S100 and step S140 described above. For example, step S100 may be performed first, step S140 may be performed later, and step S100 and step S140 may be performed simultaneously.

  Next, when the signaling server 20 receives the session construction request transmitted in step S130, the signaling server 20 transmits the session construction information to the push server 40 (step S150). This session construction information includes the telephone number of the requesting terminal device 10 and the push ID. At this time, the signaling server 20 acquires the push ID by searching the registration information using the telephone number of the requested terminal device 10 as a search key. This push ID corresponds to an information sharing application that operates in the requested terminal device 10.

  Upon receiving the session construction information transmitted in step S150, the push server 40 pushes an information sharing application activation request to the requested terminal device 10 based on the push ID included in the session construction information. (Step S160). The information pushed by the push server 40 at this time includes the telephone number of the requesting terminal device 10.

  When the requested terminal device 10 is pushed in step S160, it determines whether the received telephone number of the requesting terminal device 10 matches the telephone number of the other party who is currently talking (step S160). S170). If the requested terminal device 10 determines that the received telephone number of the requesting terminal device 10 matches the telephone number of the other party who is currently talking (step S170; YES), the process proceeds to step S180. Proceed. On the other hand, if the requested terminal device 10 determines that the received telephone number of the requesting terminal device 10 does not match the telephone number of the other party who is currently calling (step S170; NO), information sharing is performed. Is transmitted to the requesting terminal device 10 via the signaling server 20 and the processing is terminated.

  Next, the requested terminal device 10 displays an information sharing approval image and waits for the user's approval operation (step S180). The requested terminal device 10 transmits the session construction approval information to the signaling server 20 when the user performs an operation to approve (step S180; YES) (step S190). The session construction approval information includes the telephone number, IP address, and port number of the requested terminal device 10. On the other hand, if the requested terminal device 10 performs an operation not approved by the user (step S180; NO), the requesting terminal device 10 notifies the requesting terminal device 10 via the signaling server 20 that the information sharing is not approved. To finish the process.

  Next, upon receiving the session construction approval information transmitted in step S190, the signaling server 20 constructs a session between the requesting terminal device 10 and the requested terminal device 10 (step S200). The session construction process is terminated. Specifically, in step S200, the signaling server 20 transmits the IP address and port number of the requested terminal device 10 transmitted in step S190 to the requesting terminal device 10. Next, the requesting terminal device 10 transmits the IP address and port number of the requesting terminal device 10 to the signaling server 20. When the signaling server 20 receives the IP address and port number of the requesting terminal device 10, the signaling server 20 transmits the received IP address and port number to the requesting terminal device 10. As a result, the requesting terminal device 10 acquires the IP address and port number of the requested terminal device 10. Further, the requested terminal device 10 acquires the IP address and port number of the requesting terminal device 10. That is, the plurality of terminal devices 10 acquire the IP address and port number of the information sharing partner terminal device 10 from each other.

  When the session construction process ends, the terminal device 10-1 and the terminal device 10-2 share information with each other (step S210).

[Modification: Operation of communication system between terminals (Modification 1): Switching of communication line]
Next, switching of communication lines by the relay server 50 will be described. In the case of the present embodiment, among the information sharing communication among the plurality of terminal devices 10, the P2P session is constructed using an LTE line. In the case of the present embodiment, of the information sharing communication among the plurality of terminal devices 10, a session via the relay server 50 is established using a wireless LAN line.

  Here, a voice call between a plurality of terminal devices 10 is performed using an LTE line, and information sharing communication is performed by switching between a state using an LTE line and a state using a wireless LAN line. There is. In this case, since the IP address of the terminal device 10 used for information sharing communication changes due to line switching, the inter-terminal communication system 1 reestablishes the session. While re-establishing this session, the terminal device 10 on the transmission side temporarily stores the communication state before switching the line, and after re-establishing the session, based on the stored communication state, Restore information sharing.

In addition, when communication is performed using a LTE line between a plurality of terminal apparatuses 10 that support the information sharing function, the inter-terminal communication system 1 can be controlled as follows. In addition, the case where it communicates in the LTE line between the some terminal devices 10 corresponding to the information sharing function here is the case where the information sharing communication is performed in the some terminal devices 10, or a some terminal This includes the case where a voice call is being made between the devices 10 and both terminal devices 10 are equipped with an application that supports the information sharing function.
In this case, when the communication line between the plurality of terminal apparatuses 10 can select an LTE line and a communication line other than the LTE line, the inter-terminal communication system 1 uses the communication line between the plurality of terminal apparatuses 10 as an LTE line. And control not to switch to a communication line other than the LTE line.

  In addition, for information sharing communication between a plurality of terminal apparatuses 10, there is a case where a state where an LTE line is used and a state where a wireless LAN line is used are switched, or a session once disconnected is reestablished. In this case, the inter-terminal communication system 1 establishes a session by omitting the consent procedure by the requested terminal device 10 (or the requesting terminal device 10). In this case, the inter-terminal communication system 1 selects whether to omit the acceptance procedure based on the time from when the session is switched or disconnected until the session is reestablished. For example, the inter-terminal communication system 1 omits the acceptance procedure if the time from when the session is switched or disconnected to when the session is reestablished is equal to or shorter than a predetermined timeout time. Further, the inter-terminal communication system 1 does not omit the acceptance procedure if the time from when the session is switched or disconnected to when the session is reestablished is longer than a predetermined timeout time. That is, the inter-terminal communication system 1 omits the acceptance procedure when the established session is switched or disconnected, and when the session is switched or disconnected for a relatively short time. Thereby, the communication system 1 between terminals can reduce a user's effort when the session is switched or disconnected.

Here, a specific example of communication line switching by the relay server 50 will be described.
When the session establishment fails, the terminal device 10 transmits error information to the signaling server 20. The error information is information indicating that the session has not been established within a predetermined time. That is, the error information is information indicating that communication for information sharing between the terminal devices 10 is not possible. Here, the predetermined time is a timeout time measured when a connection request for establishing a session is transmitted from the requesting terminal device 10 to the requested terminal device 10, and is, for example, 2 seconds. The error information can be transmitted by both the requesting terminal device 10 and the requested terminal device 10. That is, the signaling server 20 receives the error information from one or both of the requesting terminal device 10 and the requested terminal device 10.
In the following example, a case where the requesting terminal device 10 transmits error information to the signaling server 20 will be described.

When receiving the error information from the requesting terminal device 10, the signaling server 20 executes a procedure for switching the communication line with the relay server 50.
The requesting terminal device 10 transmits a room creation request to the signaling server 20. This room creation request is information requesting the relay server 50 to create a room. This room is a virtual space provided by the relay server 50 so that a plurality of terminal devices 10 can share information. This room is distinguished by, for example, room 1, room 2,. The number assigned to this room is also referred to as a room ID. The terminal device 10 is connected to one of the rooms. Terminal devices 10 connected to rooms with the same room ID can share information with each other. For example, when two terminal devices 10-1 and 10-2 are connected to the room 1, the two terminal devices 10-1 and 10-2 may share information with each other. it can.

This room creation request includes the telephone number of the requesting terminal device 10. That is, the requesting terminal device 10 transmits a room creation request including the telephone number of the requesting terminal device 10 to the signaling server 20.
When the signaling server 20 receives the telephone number of the requesting terminal device 10, the signaling server 20 outputs a request for confirming the free capacity of the relay server 50 to the relay server 50. When the relay server 50 receives a request for confirming the free capacity of the relay server 50, the relay server 50 determines whether or not a new room can be created, and transmits the determination result to the signaling server 20.
If the received determination result indicates that a new room can be created, the signaling server 20 transmits a room creation request to the relay server 50. As described above, this room creation request includes the telephone number of the requesting terminal device 10.
When receiving the room creation request, the relay server 50 issues a new room ID and creates a room with the room ID. Further, the relay server 50 issues an entry key for entering the created room. The relay server 50 transmits a response to the room creation request to the signaling server 20. The response to the room creation request includes the room ID issued by the relay server 50 and the entry key. When receiving a response to the room creation request, the signaling server 20 transmits information including the room ID and the room entry key included in the response to the requesting terminal device 10 as a response to the room creation request.

  The requesting terminal device 10 receives a response to the room creation request from the signaling server 20. As described above, the response to the room creation request includes the room ID issued by the relay server 50 and the room entry key. The requesting terminal device 10 transmits a room entry request to the relay server 50. The room entry request includes the room ID received from the signaling server 20 and the room entry key. That is, the request-side terminal device 10 transmits information including the room ID issued by the relay server 50 and the room entry key to the relay server 50 as a room entry request. When the relay server 50 receives the room entry request, the relay server 50 collates the room ID included in the room entry request with the room entry key. If the combination of the room ID and the entry key is correct as a result of this collation, the relay server 50 causes the requesting terminal device 10 to enter the room.

The requesting terminal device 10 invites the requested terminal device 10 to enter the room. Specifically, the request-side terminal device 10 transmits a request for invitation to enter the room to the signaling server 20. The request to enter the room includes identification information of the requesting terminal device 10, identification information of the requested terminal device 10, a room ID, and an entry key. Here, the identification information of the terminal device 10 is information for identifying the terminal device 10 such as a telephone number or an IP address of the terminal device 10.
The signaling server 20 transmits a push request to the push server 40 when receiving a request for entering the room from the requesting terminal device 10. This push request includes identification information of the requesting terminal device 10, identification information of the requested terminal device 10, a room ID, and an entry key.
When receiving the push request from the signaling server 20, the push server 40 transmits invitation information for entering the room to the requested terminal device 10. The invitation information for entering the room includes identification information of the requesting terminal device 10, identification information of the requested terminal device 10, a room ID, and an entry key. Further, when the push server 40 transmits the invitation information for entering the room, the push server 40 transmits a response indicating that the invitation information for entering the room is transmitted to the signaling server 20. When the signaling server 20 receives the response indicating that the invitation information for entering the room has been transmitted, the signaling server 20 transmits a response to the request for invitation to enter the room to the requesting terminal device 10.

On the other hand, when the requested terminal device 10 receives the invitation information for entering the room from the push server 40, the requested terminal device 10 informs the user of the requested terminal device 10 that the invitation information for entering the room has been received. Notify and wait for the operation to enter the room. When the user of the requested terminal device 10 performs an operation to enter the room, the requested terminal device 10 accepts this operation, and the requesting terminal device 10 enters the room. Send request. When receiving the request for entering the room from the requested terminal device 10, the requesting terminal device 10 transmits a response to the request for entering the room to the requested terminal device 10. The response to the request to enter the room includes information indicating the communication mode via the relay server 50. Here, the communication mode via the relay server 50 is also simply referred to as a relay mode or a relay mode. In addition, a communication mode in which the terminal apparatuses 10 communicate directly without using the relay server 50 is also referred to as a P2P mode or a peer-to-peer mode.
In this example, when the requested terminal device 10 receives an operation of entering the room by the user, the requested terminal device 10 transmits a request to enter the room to the requesting terminal device 10. Although explained, it is not limited to this. The requested terminal device 10 may transmit a request to enter the room to the requesting terminal device 10 without requiring an operation by the user. As a result, the requested terminal device 10 automatically requests the requesting terminal device 10 to enter the room without requiring an operation by the user in the reconstruction (reconnection) of the session. Can be sent.

  Upon receiving a response to the request to enter the room from the requesting terminal device 10, the requested terminal device 10 transmits a room entry request to the relay server 50. The room entry request includes the room ID received from the push server 40 and the room entry key. Here, the room ID received from the push server 40 matches the room ID of the room in which the requesting terminal device 10 has already entered the room. The room entry key received from the push server 40 matches the room entry key of the room in which the requesting terminal device 10 has already entered the room. That is, the requested terminal device 10 transmits to the relay server 50 an entry request for a room in which the requesting terminal device 10 has already entered. When the relay server 50 receives the room entry request, the relay server 50 collates the room ID included in the room entry request with the room entry key. As a result of this collation, when the combination of the room ID and the room entry key is correct, the relay server 50 causes the requested terminal device 10 to enter the room.

  By this procedure, the requesting terminal device 10 and the requested terminal device 10 enter the same room provided by the relay server 50. Thereby, information sharing via the relay server 50 becomes possible between the requesting terminal device 10 and the requested terminal device 10.

[Modification: Operation of communication system between terminals (Modification 2): Periodic authentication operation]
After the session is established, the signaling server 20 determines whether or not the terminal device 10 is a regular device at a predetermined frequency. That is, the signaling server 20 periodically performs an operation of authenticating whether or not the terminal device 10 is a regular device at a predetermined frequency. This predetermined frequency is, for example, every few seconds. The regular terminal device 10 here is a device in which a combination of a telephone number and an IP address matches a combination of a telephone number and an IP address registered in the authentication server 30 in advance.
Thereby, the inter-terminal communication system 1 can exclude the use of the information sharing function by the unauthorized terminal device 10.

[Variation: Variation of session construction procedure]
Next, a modified example of the session construction procedure of the inter-terminal communication system 1 will be described. In this modification, the inter-terminal communication system 1 constructs a session as follows. Here, a case where registration of the terminal apparatus 10 has already been completed will be described. Further, here, a description will be given while comparing with step S100 to step S210 in the procedure of session construction shown in FIG. For this reason, illustration of step S300 to step S370 about the procedure of the modified example of the session construction procedure is omitted.

  The signaling server 20 receives a request for information sharing from the requesting terminal device 10 (step S300). This step S300 corresponds to the above-described steps S100 to S110. This information sharing request includes the telephone number of the requesting terminal device 10 and the telephone number of the requested terminal device 10. That is, this modification differs from step S100 described above in that the request for information sharing includes the telephone number of the requesting terminal device 10.

  Next, the signaling server 20 compares the telephone number received in step S300 with registration information stored in advance, and determines whether or not the received telephone number is available (step S310). . This step S310 corresponds to the above-described step S12. Here, the signaling server 20 determines whether or not the telephone number of the requesting terminal device 10 and the telephone number of the requested terminal device 10 are available. In other words, the present modification is different from step S120 described above in that the phone number of the requesting terminal device 10 is included in the determination target whether or not it can be used.

  Next, when the signaling server 20 determines that the telephone number received in step S310 is available (step S310; YES), the signaling server 20 sets the requested side IP address to the requesting side terminal device 10. Transmit (step S320). In this case (step S310; YES), the signaling server 20 transmits session construction information to the push server 40 (step S330). This step S330 corresponds to the above-described steps S130 to S150. This session construction information includes the IP address of the requesting terminal device 10 and the push ID corresponding to the information sharing application running on the terminal device 10. That is, the present modification is different from Steps S130 to S150 described above in that the procedure for transmitting the request for session establishment by the requesting terminal device 10 is omitted.

  When the push server 40 receives the session construction information transmitted in step S330, based on the push ID included in the session construction information, the push server 40 transmits the IP of the requesting terminal device 10 to the requesting terminal device 10. The address is pushed (step S340). This step S340 corresponds to step S160 described above. That is, the present modification is different from step S160 described above in that the push server 40 pushes the IP address instead of the telephone number of the requesting terminal device 10.

  When the requested terminal device 10 is pushed in step S340, it displays an information sharing approval image and waits for the user's approval operation (step S350). This step S350 corresponds to the above-described steps S170 to S180. That is, the modification is different from step S170 described above in that the telephone number match determination is omitted in the requested terminal device 10.

  The requested terminal device 10 transmits the session construction approval information to the signaling server 20 when the user performs an operation to approve (step S350; YES) (step S360). This step S360 corresponds to the above-described step S190. On the other hand, if the requested terminal device 10 performs an operation not approved by the user (step S350; NO), the requesting terminal device 10 notifies the requesting terminal device 10 via the signaling server 20 that the information sharing is not approved. To finish the process.

  Next, when the signaling server 20 receives the session construction approval information transmitted in step S360, the signaling server 20 constructs a session between the requesting terminal device 10 and the requested terminal device 10 (step S370). The session construction process is terminated. This step S370 corresponds to step S200 described above. That is, according to the session construction procedure of this modification, a session can be constructed by a simpler procedure as compared with the procedure from step S100 to step S200 described above.

[Modified User Interface: Suspend sharing / prohibit sharing of some images]
The information sharing function can be interrupted or stopped by a user operation. For example, the user double-taps the display unit 100 when interrupting the operation while using the information sharing function. The operation detection unit 110 of the terminal device 10 detects this double tap operation. When the operation detection unit 110 detects a double tap operation during the operation of the information sharing function, the terminal device 10 interrupts the provision of image information to the other terminal device 10 of the sharing partner.
The terminal device 10 is configured to resume providing image information to the other terminal device 10 of the sharing partner when the operation detection unit 110 detects a double tap operation while the operation of the information sharing function is interrupted. Also good.

In addition, the terminal device 10 has been described so far as being the entire area of the display unit 100 in the display screen sharing function, but is not limited thereto. In the display screen sharing function, the terminal device 10 may share an image of a partial area instead of the entire area of the display unit 100. For example, when images of a plurality of applications are displayed on the display unit 100, the terminal device 10 may determine whether to share an image for each application or for each type of application. Further, for example, when an image of an e-mail application is displayed, the terminal device 10 may not share the area of the body of the e-mail.
Note that the terminal device 10 may store in advance a target application for sharing an image. In this case, the user performs an operation on the terminal device 10 to preselect an application that shares an image and an application that does not share an image, among applications having an information sharing function. The terminal device 10 stores a target application to share an image based on the selected operation. Further, when the information sharing function is activated, the terminal device 10 determines whether or not the application is a target application for sharing an image based on information stored in advance.

[Modification: Tablet terminal]
In addition, although the case where the terminal device 10 was a mobile phone, a smart phone, etc. was demonstrated as an example until now, it is not restricted to this. For example, the terminal device 10 may be a device such as a tablet. Here, the mobile phone and the smartphone are provided with an ear-facing call speaker 131, and can be talked to the ear. On the other hand, the tablet does not include the earphone speaker 131. That is, the terminal device 10 may be a device that does not include the earphone call speaker 131. When the terminal device 10 is a tablet, a call may be performed in the speaker mode.

[Variation: Information sharing during text communication]
In the above description, the inter-terminal communication system 1 has been described as providing an information sharing function during a voice call. However, the present invention is not limited to this. The inter-terminal communication system 1 may provide an information sharing function during text communication. For example, the inter-terminal communication system 1 may provide an information sharing function during chat provided by a text chat application.

  As mentioned above, although embodiment of this invention and its deformation | transformation were demonstrated, these embodiment and its deformation | transformation were shown as an example and are not intending limiting the range of invention. These embodiments and modifications thereof can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and at the same time, are included in the invention described in the claims and equivalents thereof.

  Each of the above devices has a computer inside. The process of each device described above is stored in a computer-readable recording medium in the form of a program, and the above-described processing is performed by the computer reading and executing the program. Here, the computer-readable recording medium means a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like. Alternatively, the computer program may be distributed to the computer via a communication line, and the computer that has received the distribution may execute the program.

The program may be for realizing a part of the functions described above.
Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, what is called a difference file (difference program) may be sufficient.

DESCRIPTION OF SYMBOLS 1 ... Communication system between terminals, 10 ... Terminal device, 20 ... Signaling server, 30 ... Authentication server, 40 ... Push server, 50 ... Relay server

Claims (7)

A terminal information receiving unit for receiving terminal information including terminal identification information for identifying a terminal device and application identification information for identifying an application operating in the terminal device from the terminal device;
The compatibility between the first application that operates in the first terminal device among the plurality of terminal devices and the second application that operates in the second terminal device different from the first terminal device among the plurality of terminal devices, A suitability determination unit for determining based on the terminal information;
In response to a determination request transmitted by the first application, a determination result transmission unit that transmits a determination result by the suitability determination unit to the first terminal device;
Session construction for constructing a session between the first application that has transmitted the communication start request and the second application in response to a communication start request transmitted by the first application based on the terminal information. And
A communication system between terminals. The inter-terminal communication system according to claim 1, further comprising: a relay unit that relays communication between the first application and the second application based on the session constructed by the session construction unit. The first terminal device and the second terminal device further comprise:
The first terminal device
Based on the communication status between the first application and the second application, whether to communicate with the second application via the relay unit or to communicate with the second application without going through the relay unit The inter-terminal communication system according to claim 2 to be selected. The session construction unit sends a session construction request between the first application and the second application to the second terminal device through communication with the second terminal device via a push server. The terminal-to-terminal communication system according to any one of claims 1 to 3. The compatibility determination unit determines whether the first application and the second application are the same application based on the application identification information, thereby determining whether the first application and the second application are the same. The inter-terminal communication system according to any one of claims 1 to 4, wherein the compatibility is determined. Server device, and the terminal identification information for identifying the terminal device, a terminal information receiving step of receiving the terminal information including the application identification information for identifying the application operating in the terminal device from the terminal device,
A server device includes a first application that operates on a first terminal device among the plurality of terminal devices, and a second application that operates on a second terminal device different from the first terminal device among the plurality of terminal devices. A conformity determination procedure for determining conformity based on the terminal information;
Server device, and a determination result transmission procedure in which the first application in response to a determination request to be transmitted and transmits the determination result by the conformity judging procedure to the first terminal device,
Server device, in response to a request from the communication start of the first application sends, to the first application that sent the request for the communication start, the session between the second application, based on said terminal information The session construction procedure to construct,
A communication method between terminals. In the computer provided in the server device that communicates with the terminal device,
A terminal information receiving step for receiving terminal information including terminal identification information for identifying the terminal device and application identification information for identifying an application operating in the terminal device from the terminal device;
The compatibility between the first application that operates in the first terminal device among the plurality of terminal devices and the second application that operates in the second terminal device different from the first terminal device among the plurality of terminal devices, A suitability determination step for determining based on the terminal information;
A determination result transmission step of transmitting a determination result of the suitability determination step to the first terminal device in response to a determination request transmitted by the first application;
Session construction for constructing a session between the first application that has transmitted the communication start request and the second application in response to a communication start request transmitted by the first application based on the terminal information. Steps,
A terminal-to-terminal communication program for executing

Images