JP2016071723A - Terminal device, operation reception method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve operability of a terminal device that transmits and receives image data.SOLUTION: A terminal device includes: a display part; a first display control part that controls display of a first image shared between the device and another device; a second display control part that controls display of a first operation button image for displaying an operation menu as to whether or not to share the first image; a third display control part that controls display of a second image to be displayed overlapped on the first image that is shared between the device and another device; a fourth display control part that controls display of a second operation button image to be displayed overlapped on the second image or on the same hierarchy as the second image; and an operation receiving part that receives an operation to the display part. The operation receiving part receives an operation to the second operation button image as an operation to the first operation button image.SELECTED DRAWING: Figure 1

Description

  Embodiments described herein relate generally to a terminal device, an operation reception method, and a program.

  Conventionally, data communication by which voice data and image data can be mutually processed in real time between callers using these portable terminal devices by transmitting and receiving voice data and image data to and from each other. A system is known (see, for example, Patent Document 1).

JP 2000-261574 A

  In the data communication system as described above, a plurality of image data displayed by each terminal device may be transmitted and received between portable terminal devices. However, in the data communication system as described above, when a terminal device displays a plurality of image data transmitted and received mutually, it is difficult for the user of the terminal device to determine which image is an operation target. There was a thing. Therefore, the operability of the terminal device may be reduced.

  It is an object of the present invention to provide a terminal device, an operation reception method, and a program that can improve the operability of the terminal device that transmits and receives image data.

  In one embodiment of the present invention, whether or not to share the first image, a display unit, a first display control unit that controls display of a first image shared between the device and another device, and A second display control unit for controlling the display of the first operation button image for displaying the operation menu, and a second display that is superimposed on the first image shared between the own device and the other device. Fourth display control for controlling display of a third display control unit that controls display of an image and a second operation button image that is superimposed on the second image or displayed on the same layer as the second image And an operation receiving unit that receives an operation on the display unit, wherein the operation receiving unit receives an operation on the second operation button image as an operation on the first operation button image. Is a terminal device.

  In the inter-terminal communication system according to the embodiment of the present invention, the fourth display control unit displays the second operation button image by superimposing the first operation button image on the first operation button image. It is characterized by not displaying an image.

  In one embodiment of the present invention, the display unit, the first display control unit that controls the display of the first image shared between the own device and the other device, and the first image sharing are performed. A second display control unit for controlling the display of the first operation button image for displaying an operation menu indicating whether or not, and the first display image that is shared between the own device and the other device. A third display control unit that controls display of the second image; and an operation reception unit that receives an operation on the display unit, wherein the second display control unit converts the first operation button image into the second image. The terminal device is characterized in that it is superimposed or displayed on the same layer as the second image, and the operation accepting unit accepts an operation on the first operation button image.

  In the inter-terminal communication system according to an embodiment of the present invention, the second image is an image drawn according to an operation locus accepted by the operation accepting unit.

  In one embodiment of the present invention, the display unit, the first display control unit that controls the display of the first image shared between the own device and the other device, and the first image sharing are performed. A second display control unit for controlling the display of the first operation button image for displaying an operation menu indicating whether or not, and the first display image that is shared between the own device and the other device. An operation reception method in a terminal device comprising: a third display control unit that controls display of a second image; and an operation reception unit that receives an operation on the display unit, wherein the second display control unit includes the first display control unit. A first step of superimposing the operation button image on the second image or displaying the operation button image on the same layer as the second image; a second step in which the operation reception unit receives an operation on the first operation button image; An operation reception method characterized by including .

  In one embodiment of the present invention, the display unit, the first display control unit that controls the display of the first image shared between the own device and the other device, and the first image sharing are performed. A second display control unit for controlling the display of the first operation button image for displaying an operation menu indicating whether or not, and the first display image that is shared between the own device and the other device. In a terminal device including a third display control unit that controls display of the second image and an operation reception unit that receives an operation on the display unit, the second display control unit displays the first operation button image as the second operation button. A program for executing a first step of superimposing on an image or displaying on the same layer as the second image, and a second step of allowing the operation accepting unit to accept an operation on the first operation button image. .

  ADVANTAGE OF THE INVENTION According to this invention, the inter-terminal communication system which can improve the operativity of the terminal device which transmits / receives image data can be provided.

It is a schematic diagram which shows an example of a structure of the terminal device of this embodiment. It is a schematic diagram which shows an example of the share menu button displayed on the display part of the terminal device of this embodiment. It is a schematic diagram which shows an example of the outline | summary of the information sharing function which the communication system between terminals of this embodiment provides. It is a schematic diagram which shows an example of selection operation of the information sharing function which the communication system between terminals of this embodiment provides. It is a schematic diagram which shows an example of a structure of the communication system between terminals of this embodiment. It is a table | surface which shows an example of the registration information which the signaling server of this embodiment memorize | stores. It is a figure for demonstrating the image which the terminal device of this embodiment displays. It is a 1st schematic diagram which shows the relationship between the several image of this embodiment, and the operation performed with respect to an image. It is a figure which shows an example of the distribution table which shows the distribution rule of operation of this embodiment. It is a 2nd schematic diagram which shows the relationship between the some image of this embodiment, and the operation performed with respect to an image.

[Embodiment]
Hereinafter, an embodiment of the inter-terminal communication system 1 according to the present embodiment will be described with reference to the drawings.
The inter-terminal communication system 1 of the present embodiment provides an information sharing function among a plurality of terminal devices 10. The terminal device 10 here is a communication device that can communicate with each other by voice or text, and is, for example, a mobile phone or a smartphone. The terminal device 10 can be connected to a high-speed data communication line capable of transmitting and receiving voice information and image information through the same line. The high-speed data communication line is, for example, an LTE (Long Term Evolution) communication network. This high-speed data communication line provides a service (VoLTE; Voice over LTE) that enables voice calls in addition to transmission and reception of digital information such as images and characters.

  The information sharing function is a function for sharing image information or audio information among a plurality of terminal devices 10. More specifically, a certain terminal device 10 transmits image information or audio information to another terminal device 10. Accordingly, the inter-terminal communication system 1 displays or reproduces the image displayed on the transmission-side terminal device 10 or the sound being reproduced on the reception-side terminal device 10. The inter-terminal communication system 1 provides not only a one-way information sharing function from one terminal apparatus 10 to another terminal apparatus 10 but also a two-way information sharing function between the terminal apparatuses 10.

  As an example, the inter-terminal communication system 1 provides a plurality of image information sharing functions including a function of sharing an image being displayed (display screen sharing function) and a function of sharing a handwritten image (handwriting sharing function). Details of the display screen sharing function and details of the handwriting sharing function will be described later. Further, the inter-terminal communication system 1 can provide these multiple image information sharing functions simultaneously. In the following, as an example, the terminal device 10 simultaneously displays a plurality of pieces of image information shared by superimposing and displaying an image shared by the handwriting sharing function on the front side of the image shared by the display screen sharing function. The case where it performs is demonstrated.

  In the inter-terminal communication system 1, the terminal device 10 displays a button image for operating the sharing function for allowing the user to control the various information sharing functions described above on the display unit 100 (FIG. 1) provided in the own device. Information sharing function. That is, the terminal device 10 can simultaneously display a button image for sharing function operation in addition to an image shared by the display screen sharing function and an image shared by the handwriting sharing function. In this case, the terminal device 10 can always operate the button image for operating the sharing function while providing the information sharing function. Thereby, the terminal device 10 can enable the user to operate the start, pause, end, etc. of any information sharing function regardless of what sharing function the user uses. .

  The inter-terminal communication system 1 includes a plurality of terminal devices 10. In the following description, when distinguishing each of the plurality of terminal devices 10, for example, they are described as a terminal device 10-1 and a terminal device 10-2. Moreover, in the following description, when not distinguishing each of these several terminal devices 10, it describes as the terminal device 10 only. The configuration of the terminal device 10 will be described with reference to FIG.

[Configuration of terminal device]
FIG. 1 is a schematic diagram illustrating an example of a configuration of the terminal device 10 according to the present embodiment. The terminal device 10 includes a display unit 100, an operation detection unit (operation reception unit) 110, a communication unit 150, and a control unit 160.

  The display unit 100 includes a liquid crystal display and displays images such as characters and photographs. The image displayed by the display unit 100 is for a user to select a standby image displayed when waiting for an incoming call, an application image provided by an application operating on the terminal device, and various functions provided by the terminal device. Menu images and so on.

  This application image includes a dialer image provided by a telephone (voice communication) application, and an address book image provided by an address book application that manages names, telephone numbers, and mail addresses. In addition, the application image includes a moving image provided by the moving image reproduction application, a web image provided by the web browser application, a map image provided by the map application, and a photo image provided by the photo album application. The application image includes various images such as a mail text image provided by the e-mail application and a chat image provided by the text chat application.

  Of the menu images displayed on the display unit 100, the menu image for selecting the information sharing function is particularly referred to as an information sharing menu image. The information sharing menu image is also referred to as a shared menu ball image or a shared menu button image. In the following description, the shared menu ball image is also simply referred to as “shared menu ball”, and the shared menu button image is also simply referred to as “shared menu button”. That is, this shared menu button image is a button image for the above-described sharing function operation, and whether or not to share an image shared between the plurality of terminal devices 10 by a display screen sharing function, a handwriting sharing function, or the like. It is an image for displaying an operation menu. An example of this shared menu button is shown in FIG.

  FIG. 2 is a schematic diagram illustrating an example of a shared menu button displayed on the display unit 100 of the terminal device 10. In this example, the shared menu button image PMB is displayed at an arbitrary position on the display unit 100 so as to overlap the application image PAP.

  Returning to FIG. 1, the operation detection unit 110 includes a transparent touch panel sensor that covers the display unit 100, and detects a user operation. There are various types of user operations. Examples of operation types include a tap operation, a drag operation, and a pinch operation. The tap operation is an operation in which the user releases the finger immediately after touching the finger at a position where the touch panel is located. The drag operation is an operation in which the user moves a finger touching the touch panel in a certain direction while touching the touch panel. The pinch operation is an operation in which the user changes the interval between two fingers that touch the touch panel. The tap operation includes a single tap operation that is touched only once and a double tap operation that repeats the single tap operation twice quickly. Further, the drag operation includes a swipe operation in which the moving speed is faster than that of the drag operation and a faster flick operation. The pinch operation includes a pinch-out operation that increases the interval between two fingers that touch the touch panel, and a pinch-in operation that decreases the interval between two fingers that touch the touch panel.

  Here, the case where the user performs an operation by touching the touch panel sensor with a finger has been described as an example, but the present invention is not limited thereto. For example, the user may operate using an operation indicator bar instead of a finger. That is, the operation detection unit 110 detects an operation with a finger or an object other than the finger (for example, a pointing stick) as a user operation.

  More specifically, the operation detection unit 110 detects a position in contact with a touch panel such as a user's finger or a pointing stick. The position here is a position in the display unit 100. For example, when the display unit 100 has a rectangular display area, this position is parallel to the upper side of the rectangle in an XY two-dimensional orthogonal coordinate system with the upper left point of the display unit 100 as the origin O as shown in FIG. This is expressed by two coordinate values: a coordinate value on the X axis and a coordinate value on the Y axis parallel to the left side of the rectangle.

  The communication unit 150 includes a communication control IC (Integrated Circuit), and performs communication with other devices. The terminal device 10 communicates with other devices by the communication operation by the communication unit 150. In the following description, description of the configuration and operation of the communication unit 150 is omitted.

  The control unit 160 includes a CPU (Central Processing Unit) and controls each unit included in the terminal device 10. The terminal device 10 performs operations such as display on the display unit 100, detection of an operation by the operation detection unit 110, communication with another device by the communication unit 150, and the like by the control of each unit by the control unit 160. In the following description, description of the configuration and operation of the control unit 160 is omitted.

[Overview of information sharing function]
Next, an overview of the information sharing function provided by the inter-terminal communication system 1 will be described with reference to FIG.
FIG. 3 is a schematic diagram illustrating an example of an outline of an information sharing function provided by the inter-terminal communication system 1.
An example of the display image by the function of sharing the image being displayed is shown in FIG. An example of a display image by a function for sharing a handwritten image is shown in FIG.

These information sharing functions are provided by an information sharing function application that operates on the terminal device 10. In the following description, this information sharing function application is also referred to as an information sharing application. The information sharing application provides an information sharing function by operating in cooperation with the basic software in the terminal device 10 and other applications. Here, the basic software in the terminal device 10 with which the information sharing application cooperates includes communication software for the terminal device 10 to communicate with other devices.
The information sharing application includes a menu control application and a shortcut application described later. Other applications with which the information sharing application cooperates include a photo album application and a handwriting tool application.

  Here, in describing the information sharing function, a description method of the terminal device 10 in the description of the present embodiment will be described. The operation state of the terminal device 10 has the following two distinctions.

  The first distinction is a distinction between the terminal device 10 that requests information sharing and the terminal device 10 that requests information sharing. In the following description, the terminal device 10 that requests information sharing among the plurality of terminal devices 10 is also referred to as the requesting terminal device 10, and the terminal device 10 that is requested to share information The terminal device 10 on the side is also described. The requesting terminal device 10 makes a request for information sharing to the requested terminal device 10. When the request-side terminal device 10 receives an information sharing request from the request-side terminal device 10, the requested-side terminal device 10 accepts the request to start information sharing with the request-side terminal device 10. In the following description, of the plurality of terminal devices 10, the requesting terminal device 10 is also referred to as a terminal device 10-1, and the requested terminal device 10 is also referred to as a terminal device 10-2.

The second distinction is a distinction between the terminal device 10 that transmits information to be shared and the terminal device 10 that receives information to be shared. In the following description, the terminal device 10 that transmits information to be shared among the plurality of terminal devices 10 is also referred to as an information transmitting terminal device 10 or a terminal device 10-S. Further, the terminal device 10 on the information receiving target side is also referred to as an information receiving terminal device 10 or a terminal device 10-R.
Note that which of the requesting terminal device 10 and the requested terminal device 10 transmits information to be shared and which receives this information depends on the function between the information sharing functions. It depends on the difference and the operating state of the terminal device 10. That is, in the inter-terminal communication system 1, there are a case where the requesting terminal device 10 transmits information to be shared information and a case where the requested terminal device 10 transmits information to be shared information.

  In the following description, the terminal device 10 may be described by combining the first distinction and the second distinction described above. In this case, the requesting and information transmitting terminal device 10 is also referred to as a terminal device 10-1S. The terminal device 10 on the requesting side and the information receiving side is also referred to as a terminal device 10-1R. The terminal device 10 on the requested side and the information transmission side is also referred to as a terminal device 10-2S. The terminal device 10 on the requested side and the information receiving side is also referred to as a terminal device 10-2R.

[Information sharing function 1: Sharing images being displayed (display screen sharing function)]
Next, an overview of each information sharing function will be described with reference to FIG. Among the information sharing functions provided by the inter-terminal communication system 1, first, sharing of an image being displayed will be described.

  The inter-terminal communication system 1 provides a display screen sharing function. With this display screen sharing function, an image P1 displayed on the display unit 100 of the terminal device 10 is displayed as an image P2 on the display unit 100 of another terminal device 10, whereby an image is displayed between the terminal devices 10. It is a function to share. An example of a screen displayed on the terminal device 10 by this display screen sharing function is shown in FIG. The image displayed on the display unit 100 here includes the above-described standby image, application image, and menu image.

  When the display screen sharing function is selected in a certain terminal device 10-1, the inter-terminal communication system 1 uses the image P1 displayed on the display unit 100 of the terminal device 10-1 as a sharing destination. Is displayed on the display unit 100 of the terminal device 10-2 as an image P2.

  A specific example of this display screen sharing function will be described. For example, a case will be described in which a photo album application is activated in the terminal device 10-1, and this photo album application displays a photo image (image P1 shown in FIG. 3A) on the display unit 100. . In this case, the inter-terminal communication system 1 displays the image P1 of the photograph displayed on the display unit 100 of the terminal device 10-1 as the image P2 on the display unit 100 of the other terminal device 10-2 that is the sharing destination. Let In this way, the image P1 of the same photograph is displayed on the respective display units 100 of the two terminal devices 10, whereby the photograph image P1 is shared.

  Next, another specific example of the display screen sharing function will be described. For example, a case where a moving image application is activated in the terminal device 10-1 and the moving image application displays a moving image with sound on the display unit 100 will be described. In this case, the inter-terminal communication system 1 displays the moving image displayed on the display unit 100 of the terminal device 10-1 on the display unit 100 of the other terminal device 10-2 that is the sharing destination. In this way, the same moving image is displayed on the respective display units 100 of the two terminal devices 10, thereby sharing the moving image. Simultaneously with the image sharing, the inter-terminal communication system 1 reproduces the sound reproduced from the sound reproduction unit 130 of the terminal device 10-1 from the sound reproduction unit 130 of the other terminal device 10-2 that is the sharing destination. Let In this way, the sound attached to the moving image is shared by reproducing the same sound from the sound reproducing units 130 of the two terminal devices 10. In this way, a moving image with sound is shared between the two terminal devices 10. That is, according to the inter-terminal communication system 1, it is possible to share both information of image information and sound information.

[Information sharing function 2: Sharing handwritten images (handwriting sharing function)]
Next, among the information sharing functions provided by the inter-terminal communication system 1, sharing of handwritten images will be described with reference to FIG.
The inter-terminal communication system 1 provides a handwriting sharing function for sharing an image of a handwritten graphic. Here, the handwritten graphic image is an image of a drag operation locus displayed on the display unit 100 by dragging the operation detection unit 110 of the terminal device 10 with a finger or the like. That is, the handwriting sharing function refers to an image P3 of a handwritten graphic displayed on the display unit 100 by dragging the operation detection unit 110 of the terminal device 10 with a finger or the like on the display unit 100 of another terminal device 10. This is a function of sharing an image between the terminal devices 10 by displaying as P4.

  A specific example of the handwriting sharing function will be described. For example, the case where the handwriting tool application is activated in the terminal device 10-1 and the handwriting tool application displays an image of a handwritten graphic (image P3 shown in FIG. 3B) on the display unit 100 will be described. To do. In this case, the inter-terminal communication system 1 uses the image P3 of the handwritten graphic displayed on the display unit 100 of the terminal device 10-1 as the image P4 on the display unit 100 of the other terminal device 10-2 that is the sharing destination. Display. In this way, by displaying the same handwritten graphic image on the display units 100 of the two terminal devices 10, the handwritten graphic image is shared.

[Image layer display]
Note that the display unit 100 of the terminal device 10 displays a photograph (for example, the image P5 in FIG. 3B) displayed by the photo album application and a handwritten graphic image (for example, FIG. 3B) displayed by the handwriting tool application. The image P3) can be displayed in an overlapping manner. That is, the display unit 100 of the terminal device 10 can display a plurality of images stacked. In this case, the display unit 100 displays an image using a layer set for each application. This layer is a logical hierarchy of images displayed in a stacked manner. For example, the display unit 100 displays the image P5 on the first layer, which is a lower layer, and the image P3, on a second layer, which is a higher layer than the first layer. Here, the upper layer is a layer that displays an image on the near side (side closer to the user) among the plurality of stacked layers. The lower layer is a layer that displays an image on the back side (the side far from the user) among the plurality of stacked layers. For images displayed on these layers, the opacity can be set between 0% and 100%, for example. When the opacity of the image displayed on the upper layer is 100%, the upper image becomes opaque and the lower layer image is hidden, so the lower layer image is not displayed. When the opacity of the image displayed on the upper layer is 0%, the upper image becomes transparent, and the lower layer image is displayed transparently without being hidden.
When there are a plurality of regions in a certain layer, this opacity can be set for each of these regions. For example, if the layer on which the handwriting tool application displays an image includes an area where an image of a handwritten graphic is displayed and an area where nothing is displayed, the opacity of these areas can be set for each area. it can.

  Further, the operation detection unit 110 detects an operation for the highest layer. In this example, a case will be described in which the handwriting tool application displays the handwritten graphic image P3 on the second highest layer. In this case, the operation detection unit 110 outputs an operation (for example, a drag operation) detected by the touch panel to a handwriting tool application displaying an image on the highest layer. Based on the drag operation output from the operation detection unit 110, the handwriting tool application displays an image indicating the locus of the drag operation on the display unit 100 as an image of a handwritten figure.

  Here, as another example, a case will be described in which the menu control software displays a menu screen on a third layer higher than the second layer. In this case, the operation detection unit 110 detects an operation on the highest layer, that is, the third layer. The operation detection unit 110 detects an operation (for example, a tap operation) with respect to the position where the shared menu button image is displayed by using the touch panel. The operation detection unit 110 outputs the detected operation (for example, a tap operation) to menu control software displaying an image on the highest layer. The menu control software selects a function corresponding to the position of the tap operation based on the operation output from the operation detection unit 110, and provides the selected function.

  That is, the operation detection unit 110 detects an operation on the highest layer among a plurality of layers of the image displayed on the display unit 100. Therefore, in the example shown in FIG. 3B, when the handwritten graphic image P3 is displayed in a lower layer than the photo image P5, even if the user operates the touch panel of the display unit 100, The image of the handwritten figure corresponding to this operation is not drawn.

  The menu control software is an application that executes processing according to an operation on the shared menu button image. Specifically, the menu control software presents an information sharing function that can be executed by the terminal device 10 in accordance with an operation on the shared menu button image PMB. The menu control software may present functions other than the information sharing function. Specifically, for example, when the menu control software displays images on a plurality of layers, the menu control software may display an image for switching the layer on which each image is displayed. More specifically, the menu control software, for example, when a handwriting tool application and a photo album application are executed, in response to an operation on the shared menu button image PMB, The layers of the images to be displayed may be switchable. Further, the menu control software may change the function to be presented according to the type of application being executed in the terminal device 10, for example.

  In the handwriting sharing function, the inter-terminal communication system 1 can also share a handwritten graphic image bidirectionally between the plurality of terminal devices 10. Specifically, the inter-terminal communication system 1 displays an image P3 of a handwritten graphic displayed on the display unit 100 of the terminal device 10-1 on the display unit 100 of another terminal device 10-2 that is a sharing destination. Display as P4. In this case, the inter-terminal communication system 1 displays the image P6 of the handwritten graphic displayed on the display unit 100 of the terminal device 10-2 on the display unit 100 of the other terminal device 10-1 that is the sharing destination. Display. In this way, by displaying the image of the handwritten graphic on the respective display units 100 of the two terminal devices 10, the image of the handwritten graphic is shared bidirectionally.

  In the handwriting sharing function, the mechanism in which the inter-terminal communication system 1 shares an image and the mechanism in which the inter-terminal communication system 1 shares an image in the display image sharing function described above are different in the following points. That is, in the display image sharing function, the inter-terminal communication system 1 shares an image by sharing data obtained by capturing an image displayed on the display unit 100 between the terminal devices 10. On the other hand, in the handwriting sharing function, the inter-terminal communication system 1 shares an image by sharing data for drawing an image, not data obtained by capturing an image. Specifically, in the handwriting sharing function, the terminal device 10-S on the information transmission side, such as the coordinate data of the handwritten graphic detected by the operation detection unit 110 of the terminal device 10-S, and the color and thickness of the line, etc. Data (that is, data for drawing an image) is transmitted to the terminal device 10-R on the information receiving side. The terminal device 10-R on the information receiving side displays an image on the display unit 100 of the terminal device 10-R based on the received coordinate data of the handwritten figure and data such as line color and thickness.

  Note that the handwriting tool application may display handwritten images on a plurality of layers. In this case, in the execution of the handwriting tool application, the operation detection unit 110 receives input of a plurality of handwritten images from the user, and the control unit 160 displays the received plurality of handwritten images on different layers. The handwritten image may be associated with the application being executed in the terminal device 10. Here, a case where the photo album application and the address book application are executed in the terminal device 10 will be described. For example, when the operation detection unit 110 receives an input of a handwritten image when the photo album application displays an image on a layer one level lower than the handwritten image, the control unit 160 sets the received handwritten image as a photo album application. Store in association with each other. In addition, when the operation detection unit 110 receives an input of a handwritten image when the address book application displays an image on a layer one level lower than the handwritten image, the control unit 160 converts the received handwritten image to the address book application. Store in association with each other. Thereby, the terminal device 10 can store the handwritten image in association with the image displayed on the other layer.

  Here, the control of the allocation of layers for displaying images, which is performed by the control unit 160 of the terminal device 10, will be described. The layer assignment control for displaying the image is that when a plurality of images are displayed in a display area of the display unit 100, which of the plurality of images is displayed on the upper layer and which is displayed. It is to determine whether an image is displayed on a lower layer. As described above, the operation detection unit 110 of the terminal device 10 detects an operation on the highest layer. Specifically, when the images of the plurality of operation buttons are displayed on the upper layer and the lower layer, the operation detection unit 110 performs an operation on the operation button images displayed on the upper layer. To detect. In this case, the operation detection unit 110 does not detect an operation on the image of the operation button displayed on the lower layer. Therefore, the operation button image is preferably displayed on the upper layer. However, since the display area of the display unit 100 is limited, the images of all the operation buttons may not be displayed on the upper layer. In this case, the control unit 160 assigns a layer for displaying the button image as follows.

  Here, a case will be described as an example where all the button images are assigned in advance so as to be displayed on the uppermost layer and the display areas of some button images overlap each other. In this case, the control unit 160 assigns a layer for displaying the button image to the button image based on the priority predetermined for each button image. When the area where the button image is displayed does not overlap with another button image, the control unit 160 assigns the display layer of this button image to the highest layer. In addition, when the area where the button image is displayed overlaps with another button image, the control unit 160 assigns the button image display layer having the highest priority among these button images to the highest layer. . Accordingly, the control unit 160 displays the button image so that the operation detection unit 110 detects an operation on the button image having a high priority and does not detect an operation on the button image having a low priority. it can.

Here, the highest layer is also referred to as an operable layer. A layer lower than the highest layer is also referred to as an inoperable layer.
That is, the control unit 160 displays the image displayed on the operable layer on the inoperable layer by controlling the layer assignment. Further, the control unit 160 displays the image displayed in the inoperable layer on the operable layer by controlling the layer assignment. Here, the button image has been described as an example, but the control unit 160 may execute the same processing for other images.
In this way, the control unit 160 controls allocation of layers for displaying images.

[Overview of selecting information sharing function]
Next, an outline of an operation for the user to activate the information sharing function will be described with reference to FIG.
FIG. 4 is a schematic diagram illustrating an example of the selection operation of the information sharing function provided by the inter-terminal communication system 1 of the present embodiment.
Here, a case where user A (Mr. A) and user B (Mr. B) use display screen sharing using the terminal device 10 will be described as an example. In the description of this example, the terminal device 10 used by the user A is the requesting and information transmitting terminal device 10, that is, the terminal device 10-1S. In the description of this example, the terminal device 10-2 is the terminal device 10 on the requested side and the information receiving side, that is, the terminal device 10-2R. Some terminal devices 10 may not support the display screen sharing function. In the description of this example, a case where each terminal device 10 is compatible with the display screen sharing function will be described.

  The user A and the user B use the display screen sharing function by sequentially performing the operations shown in FIGS. 4A to 4E. The user A and the user B are making a voice call via the LTE communication network. FIG. 4A shows an example of an image displayed on each terminal device 10 when the user A and the user B are making a voice call via the LTE communication network.

  At this time, the image PMB of the shared menu button is displayed on both the display unit 100 of the terminal device 10-1S of the user A and the display unit 100 of the user B. The display of the image PMB of the sharing menu button indicates that the terminal device 10 on the communication partner side supports one of the information sharing functions described above. In this example, the display of the shared menu button image PMB indicates that both the terminal device 10-1S and the terminal device 10-2R support the display screen sharing function.

  User A taps the image PMB of the shared menu button displayed on the display unit 100 of the terminal device 10-1S. When the operation detection unit 110 of the terminal device 10-1S detects this tap operation, a launcher image P20 is displayed (see FIG. 4B). The launcher image P20 is an example of the menu image described above. In this example, the launcher image P20 shows icon images of a display screen sharing function, a handwriting sharing function, a position information sharing function, and a camera sharing function. When the user taps the position on the display unit 100 where the icon image is displayed, the function associated with the icon image is activated. Here, a case where the user A taps the icon image P21 of the display screen sharing function among the information sharing functions displayed on the launcher image P20 will be described.

  When the operation detection unit 110 of the terminal device 10-1S detects this tap operation, a function explanation image P22 of the display screen sharing function is displayed (see FIG. 4C). When the operation detection unit 110 of the terminal device 10-1S detects this tap operation, the screen sharing start consent image P23 is displayed on the display unit 100 of the sharing destination terminal device 10-2R. The consent image P23 is an image displayed on the requesting terminal device 10 for information sharing, and prompts the user to perform an operation indicating whether or not to accept the information sharing request by the requesting terminal device 10. It is an image. In this example, the consent image P23 is an image prompting the user B to perform a tap operation indicating whether or not to accept the screen sharing request from the user A.

  Next, the user B taps the image P24 of the consent button of the consent image P23. When the operation detection unit 110 of the terminal device 10-2R detects this tap operation, an image P25 indicating that it is connected is displayed on each display unit 100 of the terminal device 10-2R and the terminal device 10-1S (FIG. 4 ( See D)). At this time, an inter-terminal communication session for display screen sharing is established between the terminal device 10-1S and the terminal device 10-2R.

  Next, when a session for inter-terminal communication for display screen sharing is established between the terminal device 10-1S and the terminal device 10-2R, an image P26 displayed on the display unit 100 of the terminal device 10-1S. Is displayed as an image P27 on the display unit 100 of the terminal device 10-2R (see FIG. 4E). That is, display screen sharing is started between the terminal device 10-1S and the terminal device 10-2R.

[Configuration of inter-terminal communication system]
Next, the configuration of the inter-terminal communication system 1 that provides the above-described information sharing function will be described with reference to FIG.
FIG. 5 is a schematic diagram illustrating an example of the configuration of the inter-terminal communication system 1 of the present embodiment. The inter-terminal communication system 1 includes the following devices in addition to the plurality of terminal devices 10 (in this example, the terminal device 10-1S and the terminal device 10-2R). That is, the inter-terminal communication system 1 includes a signaling server 20, an authentication server 30, a push server 40, and a relay server 50.

  The signaling server 20 manages a session of information sharing communication performed between the terminal devices 10. Specifically, the signaling server 20 can communicate with a plurality of terminal devices 10, the authentication server 30, and the push server 40. When the terminal device 10 supports the information sharing function, the signaling server 20 performs registration (initial registration) of information of the terminal device 10. Further, when there is a request for information sharing from the terminal device 10, the signaling server 20 performs signaling processing for establishing a communication session with the sharing destination terminal device 10. In addition, when there is a request for information sharing from the terminal device 10, the signaling server 20 returns a response as to whether or not the terminal device 10 that is the sharing request destination is compatible with the information sharing function. To do.

  Further, the signaling server 20 determines whether or not the terminal device 10 is a legitimate device at the start of session construction. Whether or not the terminal device 10 is a legitimate device can be determined by various means. In this example, the signaling server 20 determines whether or not the terminal device 10 is a regular device based on the telephone number and the IP address transmitted from the terminal device 10. More specifically, the signaling server 20 is based on whether or not the telephone number and IP address transmitted from the terminal apparatus 10 match the telephone number and IP address previously assigned to the terminal apparatus 10. Then, it is determined whether or not the terminal device 10 is a regular device. In the following description, the determination performed by the signaling server 20 as to whether or not the terminal device 10 is a regular device is also referred to as secure determination.

  In addition, the signaling server 20 stores registration information. The signaling server 20 uses this registration information to perform session construction and secure determination. Registration information stored in the signaling server 20 will be described with reference to FIG.

  FIG. 6 is a table showing an example of registration information stored in the signaling server 20 of the present embodiment. The signaling server 20 stores the telephone number of the terminal device 10, the terminal model name, the push ID, and the application version as registration information. Here, the push ID is identification information for identifying an application for the information sharing function that operates on the terminal device 10.

  Returning to FIG. 5, after the session is established, the signaling server 20 determines whether or not the terminal device 10 is a regular device at a predetermined frequency. The signaling server 20 establishes a session or maintains an established session only when it is determined that the terminal device 10 is a legitimate device. Specifically, when the signaling server 20 determines that the terminal device 10 is a legitimate device, the signaling server 20 issues a token to the terminal device 10. This token is permission information for the terminal devices 10 to communicate with each other via a high-speed communication line. This token has an expiration date from the time of issue. The terminal device 10 can share screen information with other terminal devices 10 when this valid token is issued. Further, the terminal device 1 cannot share screen information with other terminal devices 10 when a token has not been issued and when the validity period of the issued token has expired. In this way, the signaling server 20 manages a session between the terminal devices 10.

  The authentication server 30 stores the telephone number of the terminal device 10 and the Internet protocol address (IP address) in association with each other. When there is a request for an IP address corresponding to the telephone number from the signaling server 20, the authentication server 30 returns an IP address corresponding to the telephone number of the terminal device 10 to the signaling server 20.

  If the combination of the telephone number and the IP address for a certain terminal device 10 does not match the combination of the telephone number and the IP address stored in the authentication server 30, this terminal device 10 is not a legitimate device. there is a possibility. The signaling server 20 acquires a telephone number and an IP address from a certain terminal device 10, and compares the telephone number and the IP address stored in the authentication server to see if the combination of the telephone number and the IP address matches. Determine. As a result of this comparison, when it is determined that the combination of the telephone number and the IP address matches, the signaling server 20 issues a token to the terminal device 10. Further, as a result of this comparison, when it is determined that the combination of the telephone number and the IP address does not match, the signaling server 20 does not issue a token to the terminal device 10.

  The push server 40 stores a plurality of push IDs. The push ID stored in the push server 40 is associated with the application operating on the terminal device 10 by the signaling server 20. Specifically, when a new downloaded application is activated for the first time in the terminal device 10, the terminal device 10 requests the push server 40 to issue a push ID. The push server 40 issues a push ID for the new application of the terminal device 10 based on this request, and transmits the issued push ID to the terminal device 10. The terminal device 10 transmits information associating the new application and the issued push ID as registration information to the signaling server 20. The signaling server 20 stores the registration information transmitted from the terminal device 10. Thereby, the push ID stored in the push server 40 and the application operating on the terminal device 10 are associated by the signaling server 20.

  Further, when the application is upgraded in the terminal device 10, the push server 40 issues a new push ID along with the upgrade. That is, the push server 40 is updated with the update of the application version of the application running on the terminal device 10.

  Further, when the signaling server 20 requests the requesting terminal device 10 to start the session construction, the push server 40 uses the push technology to obtain the telephone number of the requesting terminal device 10 by the push technique. 10 is transmitted. This push technology is a technology for starting a communication request to the terminal device 10 from the server device side (in this example, the signaling server 20 and the push server 40 side). In the following description, transmitting information by the push technique is also referred to as simply pushing information.

  The relay server 50 is a relay server that performs information sharing communication between a plurality of terminal devices 10 when peer-to-peer connection is not possible in information sharing communication between the plurality of terminal devices 10. A peer-to-peer connection is also referred to as a P2P connection. When a P2P session of information sharing communication between a plurality of terminal devices 10 cannot be established even after a predetermined time, a session via the relay server 50 is established.

[Display multiple images]
In the inter-terminal communication system 1 of the present embodiment, the terminal device 10 can simultaneously share a plurality of images. Here, with reference to FIG. 7, a display mode when the terminal device 10 displays a plurality of images will be described.
7A to 7D are diagrams for explaining images displayed by the terminal device according to the present embodiment. In the example shown in FIGS. 7A to 7D, the terminal device 10 is installed with three applications: a photo album application, menu control software, and a handwriting tool application. Moreover, in one aspect of the example illustrated in FIGS. 7C and 7D, a shortcut application described later is installed in the terminal device 10. The photo album application, the menu control software, and the handwriting tool application each display one or more images. The control unit 160 of the terminal device 10 displays these images on the display unit 100 in a superimposed manner.

  In the example shown in FIGS. 7A to 7D, among the three applications described above, two applications of the menu control software and the handwriting tool application are applications to be operated by the user. The images displayed by the menu control software and the handwriting tool application are operation images that allow the user's operation to be accepted. Below, with reference to FIG. 7 (A) and (B), the problem which may arise when it displays based on several image information is demonstrated first. Then, with reference to FIG.7 (C), (D), the example of the display which the terminal device 10 of this embodiment performs based on several image information is demonstrated.

  FIG. 7A shows an example of display on the terminal device 10 based on three pieces of image information. In FIG. 7A, the terminal device 10 performs display based on the image PAP11, the image PMB, and the image PDA that are displayed by the three applications, respectively. The image PAP11 is a photo image displayed by the photo album application. The image PMB is a shared menu button image displayed by the menu control software. The image PDA is a handwriting tool image displayed by the handwriting tool application. The handwriting tool image PDA includes a handwritten image PD1 and a handwritten palette image PD2. The handwritten image PD1 is an image displayed by the control unit 160 based on the handwritten input received by the operation detection unit 110 from the user. The handwritten palette image PD2 is an image representing buttons for operating the line thickness, color, line type, and the like of the handwritten image. In FIG. 7A, among these images, the photographic image PAP11 and the handwritten image PD1 are shared by the plurality of terminal devices 10 by the information sharing function.

  In FIG. 7A, a photographic image PAP11 is displayed in the first layer, which is the lowest layer. In addition, the shared menu button image PMB is displayed in the second layer, which is an upper layer of the first layer. In addition, the handwriting tool image PDA is displayed in the third layer, which is a higher layer than the second layer. The display unit 100 displays an image PL1 obtained by combining these images. That is, the image PL1 is an image obtained by superimposing the shared function image PMB on the photographic image PAP11 and further superimposing the handwriting tool image PDA thereon. As described above, the operation detection unit 110 detects an operation on the highest layer. In FIG. 7A, since the handwritten tool image PDA is displayed in the highest layer, the input accepted by the operation detection unit 110 is distributed to the handwriting tool application that displays the handwritten tool image PDA. On the other hand, the shared menu button image is not displayed on the highest layer. Accordingly, the display unit 100 displays the shared menu button image PMB. Even when the user performs a tap operation on the shared menu button image PMB, the tap operation is performed on the menu control software. Cannot be sorted. Thus, the user may erroneously operate the handwriting tool application in an attempt to operate the shared menu button image PMB.

  FIG. 7B is a diagram for explaining an image PW displayed by the handwriting tool application. The image PW is a canvas image representing a white canvas with an opacity of 100% in the handwriting function provided by the handwriting tool application. The canvas image PW is displayed on a different layer from the handwriting tool image PDA.

  In FIG. 7B, images displayed on the first layer and the second layer are the same as those in FIG. However, FIG. 7B is different from FIG. 7A in that the canvas image PW is displayed in the third layer, which is a higher layer than the second layer. A handwriting tool image PDA is displayed in the fourth layer, which is a higher layer than the third layer. The display unit 100 displays an image PL2 obtained by combining these images. That is, the image PL2 is an image obtained by superimposing the handwriting tool image PDA on the canvas image PW. Thereby, the terminal device 10 can display a handwritten image in an easy-to-see manner. However, since the image with 100% opacity is displayed on the upper layer of the shared menu button image PMB in this way, the shared menu button image PMB is not displayed on the display unit 100. Therefore, the user cannot operate the shared menu button image PMB.

  FIG. 7C is a diagram illustrating an example of display of a plurality of images by the terminal device 10 according to the present embodiment. The terminal device 10 according to the present embodiment displays images for operating a plurality of applications to be operated on the uppermost layer. Specifically, in FIG. 7C, a photographic image PAP11 is displayed in the lowest first layer. In addition, the shared menu button image PMB1 or PMB2 and the handwriting tool image PDB are displayed in the second layer, which is an upper layer of the first layer. The display unit 100 displays an image PL3 obtained by combining these images. That is, the image PL3 is an image obtained by superimposing the shared menu button image PMB1 or PMB2 and the handwriting tool image PDB on the photographic image PAP11.

  Here, the shared menu button images PMB1 and PMB2 are images corresponding to the menu control software. The shared menu button image PMB1 is an image displayed by the menu control software. The shared menu button image PMB2 is an image representing a shortcut to the shared menu button image PMB. These shared menu button images PMB1 and PMB2 are, for example, shared menu button images PMB (hereinafter referred to as “shared menu button images PMB0”) displayed by the menu control software when the handwriting tool application is not executed. Is different from that of the handwritten palette image PD3. Specifically, the shared menu button images PMB1 and PMB2 are images having outer edges separated by rectangles of the same size as the images of various tools displayed on the handwritten palette image PD3, for example. In this way, the terminal device 10 changes the design of the shared menu button image between when the handwriting tool application that displays an image on the highest layer is executed and when it is not executed. Thereby, the user can know that the handwriting tool application is being executed and that both the menu control software and the handwriting tool application can be operated.

  When displaying the shared menu button image PMB2, the menu control software displays a shared menu button image PMB0 (not shown) in a layer other than the highest layer in addition to the shared menu button image PMB2. In this case, the shared menu button image PMB0 is displayed on the back side of the shared menu button image PMB2. That is, the shared menu button image PMB2 is hidden behind the shared menu button image PMB2 that provides a shortcut to the shared button image PMB0. Then, when the shared menu button image PMB2 moves, the shared menu button image PMB0 moves behind it in conjunction with the movement. When the shared menu button image PMB2 is displayed, the shared function image button PMB0 may be displayed on the lowest layer.

  Further, the shared menu button images PMB1 and PMB2 are images having a smaller display area than the shared menu button image PMB0, for example. Thereby, the terminal device 10 can accept the user's operation on the menu control software without disturbing the user's operation on the handwriting tool application.

  The shared menu button images PMB1 and PMB2 are displayed at predetermined positions. Specifically, in the example illustrated in FIG. 7C, the display unit 100 displays the shared menu button images PMB1 and PMB2 in the upper left area of the display unit 100. Thereby, the user can operate the menu control software without hesitation even when the terminal device 10 is executing the handwriting tool application.

  When the operation detection unit 110 receives an operation for terminating the handwriting tool application, the control unit 160 may display the shared menu button image PMB at the position displayed before the handwriting tool application is activated. Good. In this case, the menu control software stores the display position of the shared menu button image PMB0. When the handwriting tool application is activated, the shared menu button image PMB1 or PMB2 is displayed at a predetermined position on the display unit 100 as described above. When the handwriting tool application is terminated, the menu control software displays the shared menu button image PMB0 at the display position of the shared menu button image PMB0 when the operation detecting unit 110 accepts an operation for starting the handwriting tool application. indicate.

  The handwriting tool image PDB is an image displayed by the handwriting tool application. The handwriting tool image PDB includes a handwritten image PD1 and a handwritten palette image PD3. The handwritten palette image is displayed with different designs when the menu control software is executed and when the menu control software is not executed.

  As described above, the handwriting tool application can display the canvas image PW in addition to the handwriting tool image. When displaying the canvas image PW, the display unit 100 displays the photo image PAP11 in the first layer that is the lower layer, the canvas image PW in the second layer that is the upper layer of the first layer, and the upper layer of the second layer. The shared menu button image PMB1 or PMB2 and the handwriting tool image PDB are displayed on the third layer which is a layer. As a result, the shared menu button images PMB1 and PMB2 and the handwriting tool image PDB are displayed without being hidden by the canvas image. Therefore, the user can recognize the operation method of the shared menu button images PMB1 and PMB2.

FIG. 7D is a diagram illustrating a display example by the display unit 100 when the operation detection unit 110 of the terminal device 10 receives an operation on the shared menu button image PMB1 or PMB2 illustrated in FIG. 7C. is there. In FIG. 7D, a launcher image P20 is displayed on the uppermost layer. Then, display unit 100 displays an image PL4 obtained by combining image PL3 and launcher image P20. That is, the image PL4 is an image obtained by superimposing the launcher image P20 on the image PL3.
The launcher image P20 is an image displayed by the menu control software in response to the operation detection unit 110 detecting an operation on the shared menu button images PMB1 and PMB2.

  Next, with reference to FIGS. 8 to 10, distribution of user operations to the image described with reference to FIG. 7C will be described. In the following, two methods for making a plurality of applications operable will be described.

[First Acceptance Method (First Example)]
The first receiving method is a method in which each application displays an image for acquiring an operation from the operation detection unit 110 and displays the image on the highest layer.
FIG. 8 is a schematic diagram illustrating a relationship between a plurality of images and operations performed on the images in the first receiving method.
In FIG. 8, the control unit 160 executes a photo album application AP11, menu control software AP12, and a handwriting tool application AP13. Here, the photo album application AP11, the menu control software AP12, and the handwriting tool application AP13 are the photo album application, the menu control software, and the handwriting tool application described above, respectively. The control unit 160 displays the photo image PAP11 displayed by the photo album application on the lower first layer. In addition, the control unit 160 displays the canvas image PW displayed by the handwriting tool application AP13 on the second layer that is an upper layer of the first layer. Further, the control unit 160 displays the shared function application image PMB1 displayed by the menu control software AP12 and the handwriting tool image PDB displayed by the handwriting tool application AP13 on the third layer, which is a higher layer than the second layer. To do.

  The operation detection unit 110 detects a user operation on the third layer, which is the highest layer. Specifically, the operation detection unit 110 detects a user operation position on the display unit 100. Next, the operation detection unit 110 distributes the input operation to the application displaying the image displayed at the user operation position on the display unit 100. In the example shown in FIG. 8, a shared menu button PMB1 and a handwriting tool image PDB are displayed on the third layer. Therefore, when the operation detection unit 110 receives a user operation on the area where the shared menu button PMB1 is displayed on the display unit 100, the operation detection unit 110 outputs the received operation to the menu control software AP12 that displays the shared menu button PMB1. . The menu control software AP12 performs processing according to the operation acquired from the operation detection unit 110.

  In addition, when the display unit 100 receives a user operation on the area where the handwriting tool image PDB is displayed, the operation received by the handwriting tool application AP13 that displays the handwriting tool image PDB is output. Then, the handwriting tool application AP13 performs processing according to the operation acquired from the operation detection unit 110. Thereby, the terminal device 10 can accept operations for the two applications of the menu control software AP12 and the handwriting tool application AP13.

Here, with reference to FIG. 9, a method for distributing the user operation detected by the operation detection unit 110 to the application will be described.
FIG. 9 is an example of a distribution table showing the operation distribution rules detected by the operation detection unit 110. This distribution table is stored in a storage unit included in the terminal device 10.
As shown in the drawing, the sorting table is data in a two-dimensional tabular format composed of rows and columns, and includes application identification information (application name), image identification information (image ID), upper left coordinate information (upper left coordinate), and , The column of each item of lower right coordinate information (lower right coordinate) and layer information (layer). Each row of the sorting table exists for each image. Here, as an example, a case where the image handled by the sorting table shown in FIG. 9 is a rectangular image will be described.

The application identification information is identification information that identifies an application. In the distribution table, the application identification information is information indicating an application that displays an image.
Image identification information is identification information for identifying an image.
The upper left coordinate information and the lower right coordinate information are information representing the position of the image on the display unit 100. The upper left coordinate information and the lower right coordinate information are represented by coordinate values in the XY two-dimensional coordinate system of the display unit 100, respectively. The upper left coordinate information represents the coordinate value of the upper left point of the image. The lower right coordinate information represents the coordinate value of the lower right point of the image. That is, the rectangular area specified by the upper left coordinate information and the lower right coordinate information represents the area occupied by the image in the layer.
The layer information is information indicating a layer on which an image is displayed.

  When the operation detection unit 110 detects the position where the user's finger or the pointing stick is touched using the touch panel, the operation detection unit 110 refers to the distribution table and distributes position information indicating the detected position to the application. Specifically, first, the operation detection unit 110 searches for the image of the highest layer based on the layer information of the sorting table. Next, the operation detection unit 110 compares the upper left coordinate information and lower right coordinate information of the searched image with the position information, and searches for image identification information that identifies the image displayed at the detected position. . Next, the operation detection unit 110 acquires application identification information associated with the searched image identification information. In other words, the operation detection unit 110 searches for an application that displays an image displayed at the detected position. And the operation detection part 110 outputs a positional information to the application which the acquired application identification information shows. Thereby, the operation detection part 110 can distribute operation to an application according to an operation position.

  In the above-described example, the operation detection unit 110 has been described with respect to the aspect in which the position information detected by the touch panel is distributed to the application. However, the operation distribution method is not limited thereto. Here, as another mode, a mode will be described in which the application determines whether or not the image displayed by the application itself is displayed on the highest layer at the position indicated by the position information detected by the operation detection unit 110. First, the operation detection unit 110 outputs the detected position information to a plurality of applications being executed in the terminal device 10. Next, the application determines whether the image displayed by the application itself is displayed on the highest layer at the position indicated by the acquired position information. Then, the application executes processing corresponding to the operation when the image displayed by the application is displayed on the highest layer.

[Second acceptance method]
The second receiving method is a method of transferring an operation acquired from the operation detecting unit 110 by an application displaying an image displayed on the uppermost layer to an application displaying an image displayed on a lower layer.
FIG. 10 is a schematic diagram illustrating a relationship between a plurality of images and operations performed on the images in the second receiving method.
In FIG. 10, the control unit 160 executes a photo album application AP11, menu control software AP12, a handwriting tool application AP13, and a shortcut application AP14. Here, the shortcut application AP14 is an application that displays the shared menu button image PMB2. The shared menu button image PMB2 provides a shortcut to the shared menu button image PMB0. In other words, the shortcut application AP14 outputs the operation acquired by the own application to the menu control software.

  The control unit 160 displays the photo image PAP11 displayed by the photo album application on the lower first layer. Further, the control unit 160 displays the shared menu button PMB0 displayed by the menu control software AP12 on the second layer that is an upper layer of the first layer. Further, the canvas image PW displayed by the handwriting tool application AP13 is displayed on the third layer, which is an upper layer of the second layer. Further, the control unit 160 displays the shared function application image PMB2 displayed by the shortcut application AP14 and the handwriting tool image PDB displayed by the handwriting tool application AP13 on the fourth layer, which is a higher layer than the third layer.

  The operation detection unit 110 detects a user operation on the fourth layer, which is the highest layer. Specifically, the operation detection unit 110 detects a user operation position on the display unit 100. Next, the operation detection unit 110 distributes the input operation to the application displaying the image displayed at the user operation position on the display unit 100. In the example shown in FIG. 10, a shared menu button PMB2 and a handwriting tool image PDB are displayed on the fourth layer. Therefore, when the operation detection unit 110 receives a user operation on the area where the shared menu button PMB2 is displayed on the display unit 100, the operation detection unit 110 outputs the received operation to the shortcut application AP14 that displays the shared menu button PMB2. Next, the shortcut application AP14 outputs the operation acquired from the operation detection unit 110 to the menu control software AP12. The menu control software AP12 performs processing according to the operation acquired from the shortcut application AP14. For example, the menu control software AP14 displays the launcher image P20 and displays it on the highest layer.

  Further, when the display unit 100 accepts a user operation on an area where the handwriting tool image PDB is displayed, the operation accepted is output to the handwriting tool application AP12 that displays the handwriting tool image PDB. Then, the handwriting tool application AP13 performs processing according to the operation acquired from the operation detection unit 110. Thereby, the terminal device 10 can accept operations for the two applications of the menu control software AP12 and the handwriting tool application AP13.

[Modification: Tablet terminal]
In addition, although the case where the terminal device 10 was a mobile phone, a smart phone, etc. was demonstrated as an example until now, it is not restricted to this. For example, the terminal device 10 may be a device such as a tablet. Here, the mobile phone and the smartphone are provided with an ear-facing call speaker 131, and can be talked to the ear. On the other hand, the tablet does not include the earphone speaker 131. That is, the terminal device 10 may be a device that does not include the earphone call speaker 131. When the terminal device 10 is a tablet, a call may be performed in the speaker mode.

  As mentioned above, although embodiment of this invention and its deformation | transformation were demonstrated, these embodiment and its deformation | transformation were shown as an example and are not intending limiting the range of invention. These embodiments and modifications thereof can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and at the same time, are included in the invention described in the claims and equivalents thereof.

  Each of the above devices has a computer inside. The process of each device described above is stored in a computer-readable recording medium in the form of a program, and the above-described processing is performed by the computer reading and executing the program. Here, the computer-readable recording medium means a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like. Alternatively, the computer program may be distributed to the computer via a communication line, and the computer that has received the distribution may execute the program.

The program may be for realizing a part of the functions described above.
Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, what is called a difference file (difference program) may be sufficient.

DESCRIPTION OF SYMBOLS 1 ... Communication system between terminals, 10 ... Terminal device, 20 ... Signaling server, 30 ... Authentication server, 40 ... Push server, 50 ... Relay server, 60 ... Relay server

Claims (6)

A display unit;
A first display control unit that controls display of a first image shared between the own device and another device;
A second display control unit for controlling display of a first operation button image for displaying an operation menu for determining whether or not to share the first image;
A third display control unit for controlling the display of the second image displayed superimposed on the first image shared between the own device and the other device;
A fourth display control unit that controls display of the second operation button image that is superimposed on the second image or displayed on the same layer as the second image;
An operation receiving unit that receives an operation on the display unit;
With
The terminal device, wherein the operation accepting unit accepts an operation on the second operation button image as an operation on the first operation button image. The fourth display control unit does not display the first operation button image by displaying the second operation button image superimposed on the first operation button image. Terminal device. A display unit;
A first display control unit that controls display of a first image shared between the own device and another device;
A second display control unit for controlling display of a first operation button image for displaying an operation menu for determining whether or not to share the first image;
A third display control unit for controlling the display of the second image displayed superimposed on the first image shared between the own device and the other device;
An operation receiving unit that receives an operation on the display unit;
With
The second display control unit displays the first operation button image superimposed on the second image or on the same layer as the second image;
The operation reception unit receives an operation on the first operation button image. The terminal device according to any one of claims 1 to 3, wherein the second image is an image drawn according to a trajectory of an operation received by the operation receiving unit. A display unit, a first display control unit that controls display of a first image shared between the own device and another device, and an operation menu for displaying whether or not to share the first image. A second display control unit for controlling display of the first operation button image, and a third for controlling display of the second image displayed superimposed on the first image shared between the own device and the other device. An operation reception method in a terminal device comprising: a display control unit; and an operation reception unit that receives an operation on the display unit,
A first step in which the second display control unit displays the first operation button image superimposed on the second image or on the same layer as the second image;
A second step in which the operation accepting unit accepts an operation on the first operation button image;
An operation reception method comprising: A display unit, a first display control unit that controls display of a first image shared between the own device and another device, and an operation menu for displaying whether or not to share the first image. A second display control unit for controlling display of the first operation button image, and a third for controlling display of the second image displayed superimposed on the first image shared between the own device and the other device. In a terminal device comprising: a display control unit; and an operation reception unit that receives an operation on the display unit.
A first step in which the second display control unit displays the first operation button image superimposed on the second image or on the same layer as the second image;
A second step in which the operation accepting unit accepts an operation on the first operation button image;
A program for running

Images