WO2016052767A1 - Communication terminal, control program for communication terminal, and data output method - Google Patents

Abstract

The present invention makes it possible, when outputting data that is linked between a plurality of terminals, to implement data output that affords a sense of unity between the terminals without subjecting a user to an output delay in the transmission/reception of the data. A smartphone (1) is provided with: an application execution unit (12) that receives a preparation instruction for transmission of actual data (412); a prior data transmission/reception unit (131) that, when the preparation instruction is received, transmits prior data (411), which represents at least a portion of the actual data (412), to a smartphone (2); and a display control unit (14) that outputs the prior data (411) in coordination with the smartphone (2).

Description

Communication terminal, communication terminal control program, and data output method

The present invention relates to a communication terminal capable of transmitting and receiving information between the own terminal and the other communication terminal by establishing communication with the other communication terminal.

In recent years, a technology for operating a plurality of devices in conjunction with each other has been developed. As an example of such a technique, there is a technique for realizing a multi-display that displays an image by interlocking a plurality of display devices. For example, in Patent Document 1, information related to inputs to a plurality of display devices is transmitted to a server via an access point, and the server determines whether or not the inputs to the plurality of display devices are continuous inputs. When it is determined that the input is continuous, a technique for interlocking the plurality of display devices (for example, displaying one image over a plurality of display devices) is disclosed.

Japanese Published Patent Publication “Japanese Patent Laid-Open No. 2013-210730 (Publication Date: October 10, 2013)”

However, in the conventional technology such as Patent Document 1, for example, when the communication speed between a plurality of display devices that display an image is slow, there is a possibility that an image display delay occurs.

The present invention has been made in view of the above problems, and its object is to output data in cooperation with a plurality of terminals without causing the user to feel an output delay related to transmission / reception of the data. Is to realize data output with a sense of unity.

In order to solve the above problems, a communication terminal according to an aspect of the present invention includes a preparation instruction receiving unit that receives a preparation instruction for transmission of first data to another communication terminal, and the preparation instruction receiving unit receives the preparation instruction. When the second data transmission unit transmits the second data, the second data transmission unit transmits the second data indicating at least a part of the first data to the other communication terminal, and the second data transmission unit transmits the second data. And an output control unit that outputs the second data to the output unit of the terminal in cooperation with the other communication terminal.

According to one aspect of the present invention, when data is output in cooperation with a plurality of terminals, data output with a sense of unity is realized in the plurality of terminals without causing the user to feel an output delay related to transmission / reception of the data. There is an effect that can be done.

It is a block diagram which shows an example of the principal part structure of the smart phone which concerns on Embodiment 1 of this invention. It is a screen transition diagram which shows the operation | movement outline | summary of the smart phone shown in FIG. It is a flowchart which shows an example of the flow of the process which the smart phone shown in FIG. 1 performs. 4A to 4F show specific examples of the screen display of the smartphone in the data transfer process. It is a flowchart which shows the whole structure of a data transfer process. FIG. 6A is a flowchart showing details of the flow of the transmission side process. FIG. 6B is a flowchart showing details of the flow of the reception side process. FIG. 7A is a flowchart showing details of the flow of the transmission side touch event monitoring process. FIG. 7B is a flowchart showing details of the flow of the reception side touch event monitoring process. FIG. 8A is a flowchart showing details of the flow of the transmission side reproduction process. FIG. 8B is a flowchart showing details of the flow of reception side reproduction processing. FIG. 9A is a flowchart showing details of the flow of data transmission processing. FIG. 9B is a flowchart showing details of the flow of data reception processing.

[Embodiment 1]
Hereinafter, Embodiment 1 of the present invention will be described with reference to FIGS. In addition, below, the case where the communication terminal which concerns on this invention is implement | achieved with a smart phone (the smart phone 1 and the smart phone 2) as an example is demonstrated. However, the communication terminal according to the present invention is not limited to a smartphone, and can be applied to any electronic device capable of data communication with other communication terminals such as a personal computer (PC) and a tablet PC.

≪Smartphone functions≫
First, the smartphone 1 and the smartphone 2 according to the present embodiment will be outlined. The smartphone 1 and the smartphone 2 are communication terminals that pair with a terminal other than their own terminal and output data in cooperation with a pairing partner terminal. In the present embodiment, “pairing” means that the smartphone 1 or the smartphone 2 and another communication terminal identify and link each other in order to perform one-to-one communication.

In the following description, unless otherwise specified, the smartphone 1 and the smartphone 2 perform pairing and perform data output in cooperation. However, the smartphone 1 and the smartphone 2 may be paired with an electronic device other than the smartphone and perform data output in cooperation.

In the following description, the smartphone 1 and the smartphone 2 are described as performing communication using Bluetooth (registered trademark), but the communication method of the smartphone 1 and the smartphone 2 is not limited to this example. For example, the smartphone 1 and the smartphone 2 may perform communication by Wi-Fi (registered trademark), or may perform communication by short-range wireless communication (NFC, Near Field Communication). Hereinafter, when “communication” is simply written without particularly indicating a communication method, communication by Bluetooth is indicated. A plurality of smartphones 2 to be paired may exist.

≪Pair app≫
Each of the smartphone 1 and the smartphone 2 is preinstalled with application software responsible for a series of processes for outputting data in cooperation with other communication terminals. Hereinafter, the application software is referred to as “pair application”. Specifically, the pair application is a function related to pairing of the smartphone 1 and the smartphone 2, a function for transmitting / receiving data between the smartphone 1 and the smartphone 2 after the pairing is established, and outputting the data in cooperation with each other It has functions related to various adjustments. Details of the processing performed by the pair application will be described later.

≪Process flow related to linked output of data≫
Next, the operation | movement outline | summary of the smart phone which concerns on this embodiment is demonstrated using FIG. 2 and FIG. (A) to (g) of FIG. 2 show an outline of operations of the smartphone 1 and the smartphone 2 according to the present embodiment. FIG. 3 shows the flow of processing in each of the smartphones 1 and 2 when the smartphone 1 is operated as shown in (a) to (g) of FIG.

In the following, as an example in which the smartphone 1 and the smartphone 2 output data in cooperation with each other using FIG. 2 and FIG. 3, the smartphone 1 and the smartphone 2 display one image, and the respective terminals are adjacent to each other. An example of displaying so as to be connected is described. However, the data is not limited to images, and may be audio data or moving image data, for example.

When the user performs an operation for instructing activation of the pair application, such as when the icon α of the pair application is touched on the smartphone 1, the smartphone 1 activates the pair application. Similarly, the smartphone 2 activates the pair application according to the user's instruction operation ((a) in FIG. 2 and S1 in FIG. 3).

When the pair application is activated, the smartphone 1 and the smartphone 2 perform a pairing process by executing a function related to pairing of the pair application (S3 in FIG. 3). At this time, the smartphone 1 and the smartphone 2 may indicate to the user that they are searching for a communication partner device ((b) of FIG. 2).

When the pairing process is completed, that is, when the pairing between the smartphone 1 and the smartphone 2 is established (YES in S5 in FIG. 3), the smartphone 1 and the smartphone 2 execute the pairing partner confirmation process (S7 in FIG. 3). ).

Here, the pairing partner confirmation process is one of processes executed in the pair application, and is performed in the smartphone 1 and the smartphone 2 in order to make the user of each terminal confirm the partner terminal with which pairing has been established. Indicates processing. In other words, the pairing partner confirmation process is a process for allowing the user to confirm whether the terminal (smart phone 1 or smartphone 2) that the user owns is paired with an appropriate partner terminal.

Specifically, when the pairing is established between the smartphone 1 and the smartphone 2 (YES in S5 in FIG. 3), an image of the same color is displayed on each display screen, so that the user can communicate with the terminal and the communication partner. It is notified that the terminal is paired ((c) in FIG. 2). In addition, you may show that the smart phone 1 and the smart phone 2 paired by methods other than the image display mentioned above. The pairing notification method will be described in detail later.

Then, the smartphone 1 and the smartphone 2 allow the user of each terminal to input a confirmation result as to whether or not the pairing partner terminal is appropriate. Specifically, for example, as shown in FIG. 2C, when the pairing is appropriate and data communication is permitted, a “connection OK” button is displayed. When the pairing is inappropriate, “cancel” is displayed. Touch the button.

In the smart phone 1 and the smart phone 2, when the “connection OK” button is pressed, that is, when the user permits data transfer (S9 in FIG. 3), the smart phone 1 and the smart phone 2 next to the user of each terminal, Images to be displayed on both terminals are selected (S11 in FIG. 3). Note that the smartphone 1 and the smartphone 2 are desirably arranged side by side as shown in the drawing because of the subsequent input operations.

More specifically, for example, the user of the smartphone 1 selects the image by touching the smartphone 1 with a desired image for a predetermined time or longer (long-pressing touch) ((d) in FIG. 2).

Hereinafter, an example in which an image is selected in the smartphone 1 and data is transferred from the smartphone 1 to the smartphone 2 will be described. However, an image may be selected in the smartphone 2 and data may be transferred from the smartphone 2 to the smartphone 1. . In this case, the smartphone 2 may perform the same operation as the smartphone 1 described below.

When an image (image β) is selected on the smartphone 1, the smartphone 1 and the smartphone 2 start data transfer processing (S13 in FIG. 3). Here, the data transfer process is one of the processes executed in the pair application, and the data related to the selected image β and the data of the image β are stored in a terminal (smartphone in the figure). The process of transmitting from 1) to the transfer destination terminal (smart phone 2 in the figure) is shown.

In the data transfer process, data related to the image β is transmitted before the image β itself, and then the data of the image β itself is transmitted. Hereinafter, data relating to the selected image transmitted in advance is referred to as “preceding data”. The data of the selected image itself is referred to as “actual data”. Details of the preceding data, actual data, and data transfer processing will be described later.

The smartphone 1 displays the preceding data in cooperation with the own terminal and the smartphone 2 at least when an operation (start operation) indicating the start of data display is performed on the own terminal after the start of the data transfer process. Even when the smartphone 1 receives a start operation after the data transfer process is completed, the smartphone 1 may first display the preceding data in cooperation with the smartphone 2 and then display the actual data.

For example, as shown in FIG. 2D, the smartphone 1 slides the finger touched while the user continues to press and hold (touched) so as to straddle the smartphone 1 and the smartphone 2. When the finger is released (the image β is selected and dragged and dropped) ((e) in FIG. 2), the operation is recognized as a start operation.

Then, the smartphone 1 receives the start operation and displays the preceding data of the image β in cooperation with the display screens of the smartphone 1 and the smartphone 2. Specifically, for example, when the preceding data is a thumbnail image of the image β, the smartphone 1 cooperates with the smartphone 2 so that the images are connected on the display screens of the smartphone 1 and the smartphone 2 (so as to be continuous images). Then, the thumbnail image β1 of the image β is displayed ((f) in FIG. 2).

More preferably, the smartphone 1 acquires the time when the touching finger leaves the input surface of the smartphone 1 and the time when the finger touches the end of the input surface of the smartphone 2 to obtain these times. By specifying the adjacent relationship between the smartphone 1 and the smartphone 2 (in which direction the smartphone 2 is positioned when viewed from the smartphone 1), the preceding data of the image β is displayed according to the adjacent relationship. It is desirable to do.

Furthermore, when the data transfer process is completed, the smartphone 1 and the smartphone 2 cooperate with each other to display the actual data β2 of the image β so that the images are connected on the display screens of the smartphone 1 and the smartphone 2 ((g) in FIG. 2). ).

In summary, the smartphone 1 and the smartphone 2 perform pairing with each other ((a) to (b) in FIG. 2) and allow the user to confirm whether the pairing is appropriate ((c) in FIG. 2). . Thereafter, the smartphone 1 transfers the image data selected by one of the terminals to the other terminal ((d) to (e) in FIG. 2).

At this time, the smartphone 1 (or the smartphone 2) can display the preceding data of the image in cooperation during the transfer, and can display the actual data in cooperation after the transfer of the actual data is completed (see FIG. 2 (f) to (g)).

In addition, when the pairing process has failed in the smartphone 1 or the smartphone 2, that is, the pairing has not been established (NO in S5 in FIG. 3), the smartphone 1 and the smartphone 2 notify the user that the pairing has failed. (S17 in FIG. 3). And the smart phone 1 and the smart phone 2 perform a pairing process again (S3 of FIG. 3).

Moreover, when at least one of the users of the smartphone 1 and the smartphone 2 does not permit data transfer between the smartphone 1 and the smartphone 2 (S9 in FIG. 3), the smartphone 1 and the smartphone 2 cancel each other's pairing ( 3 (S19 in FIG. 3), the user is notified that the pairing has failed (S17 in FIG. 3), and a pairing process is performed in order to try to pair with another terminal again (S3 in FIG. 3).

≪Main part composition≫
Next, it will be as follows if the principal part structure of the smart phone 1 which concerns on this embodiment, and the smart phone 2 is demonstrated with reference to FIG. FIG. 1 is a block diagram illustrating a main configuration of the smartphone 1 and the smartphone 2 according to the present embodiment.

First, the smartphone 1 will be described. The smartphone 1 includes a control unit 10, a touch panel 20, a RAM 30, a storage unit 40, and a communication unit 50.

The touch panel 20 is an input and display panel formed by superimposing an input unit 21 that receives a user's touch input and a display unit (output unit) 22 that displays an image.

The communication unit 50 is a communication device that transmits and receives information to and from another terminal (for example, the smartphone 2).

A RAM (random-access memory) 30 is a storage device that temporarily stores various data used in the smartphone 1. The RAM 30 stores own terminal information 31, application name 32, time 33, and partner terminal information 34.

The own terminal information 31 is various pieces of information related to the smartphone 1, and is information (terminal name of the smartphone 1) including at least one of a character string and a symbol for identifying the smartphone 1, for example. Note that the own terminal information 31 is not limited to the terminal name alone, and may include, for example, an image quality mode and brightness setting in the smartphone 1. The application name 32 is information including a character string or a symbol for identifying an application that is executed by the smartphone 1 and establishes communication with the smartphone 2. The application name 32 is included in the changed terminal name (changed terminal name) when the smartphone 1 executes the application. The time 33 is information including numbers (or numbers and symbols) indicating the time when the smartphone 1 executes the application. More precisely, the time 33 is information composed of numbers indicating a time after a predetermined time after the smartphone 1 executes the application. Similarly to the application name 32, the time 33 is included in the changed terminal name when the smartphone 1 executes the application. The partner terminal information 34 is various information related to the terminal (smartphone 2) that has been paired with the smartphone 1, for example, information including a character string or a symbol for identifying the terminal (for example, the terminal name of the smartphone 2) ). The partner terminal information 34 is not limited to only the terminal name, and may include, for example, an image quality mode and brightness setting in the smartphone 2.

The storage unit 40 is a storage device that stores various data used in the smartphone 1. The storage unit 40 stores presentation information 35 and image data 41.

The presentation information 35 is information used to present to the user that the pairing between the smartphone 1 and the smartphone 2 has been established. In the present embodiment, the presentation information 35 is a plurality of pieces of information (color information) indicating different colors. The smartphone 1 selects one of the plurality of color information, sets the background color of the screen displayed on the display unit 22 to the color indicated by the selected color information, and establishes pairing with the terminal itself. Send to the terminal. The presentation information 35 is not limited to color information. For example, it may be a plurality of pieces of information indicating sounds or animations of the same pattern or different patterns.

The image data 41 is information related to images (for example, photographs) that can be displayed on the smartphone 1. Moreover, when the pairing with the smart phone 1 and the smart phone 2 is established, the smart phone 1 and the smart phone 2 can display the image which the image data 41 shows over two smart phones. The image data 41 includes preceding data 411 (second data) and actual data 412 (first data). The preceding data 411 is data that is transmitted before the actual data 412 and smaller in size than the actual data 412 when the image data 41 is transmitted from the smartphone 1 to the smartphone 2. For example, the thumbnail data of the image data 41 It is. The actual data 412 is an actual image of the image data 41.

The preceding data 411 may be any data as long as it is information indicating at least a part of the actual data. However, the preceding data 411 is data having a smaller capacity than the actual data or data obtained by reducing the capacity of the actual data. It is desirable to be. For example, when the actual data 412 is image data, the preceding data may be thumbnail data or data obtained by converting the image of the actual data 412 into a monochrome image. For example, when the actual data 412 is audio data, the preceding data may be data obtained by extracting a part of the audio data.

The control unit 10 performs overall control of each unit included in the smartphone 1. The control unit 10 includes a touch acquisition unit 11, an application execution unit (a preparation instruction reception unit, an output instruction transmission unit, a data deletion instruction unit, a response reception unit, an input determination unit) 12, a display control unit 14 (output control unit), and A communication control unit 15 is included.

The touch acquisition unit 11 acquires an electrical signal indicating a touch from the input unit 21 and calculates touch coordinates of the touch. In the present invention, “touch coordinates” refers to the touch coordinates (coordinates at the detection resolution of the touch panel) on the input surface of the input unit 21 on the coordinate display surface on the display surface of the display unit 22 in the vertical and horizontal pixels. Indicates a value converted to. The touch acquisition unit 11 supplies the calculated touch coordinates to the application execution unit 12 or the data transfer control unit 13. Further, the touch acquisition unit 11 can hold the touch coordinates in time series. Then, touch information as a locus of a touch operation (such as a drag operation or a long press operation) continuously input over a certain period of time is supplied to the application execution unit 12 or the data transfer control unit 13.

The application execution unit 12 executes various applications on the smartphone 1. Specifically, the application execution unit 12 executes processing according to various information supplied from the touch acquisition unit 11 or the communication control unit 15. As an example, the display control unit 14 is instructed to display a screen corresponding to various types of supplied information. In the present embodiment, the application execution unit 12 describes an example of executing a pair application, but the application executed by the application execution unit 12 is not limited to this example. The application execution unit 12 includes a pairing control unit 121, a time acquisition unit 122, a device name change unit 123, a presentation information determination unit 124, a presentation information adjustment unit 125, a preceding data transmission / reception unit 131 (second data transmission unit), and a real A data transmission / reception unit 132 (first data transmission unit) is included.

The pairing control unit 121 controls pairing between the smartphone 1 and the smartphone 2. Specifically, the pairing control unit 121 instructs the communication control unit 15 to start pairing with another terminal according to the touch coordinates supplied from the touch acquisition unit 11 (enable the Bluetooth setting). To instruct). Further, the pairing control unit 121 instructs the communication control unit 15 to end pairing with another terminal according to the supplied touch coordinates (instructs to invalidate the Bluetooth setting).

The time acquisition unit 122 acquires a time after a predetermined time after the application is executed (started). The time acquisition unit 122 supplies the acquired time to the device name change unit 123.

The device name changing unit 123 changes the device name (terminal name) of the smartphone 1. When the device name changing unit 123 obtains the time from the time obtaining unit 122, the device name changing unit 123 stores the application name of the application being executed (for example, “pair application”) in the RAM 30 together with the obtained time. Further, the device name changing unit 123 changes the terminal name to “<application name> _ <acquired time>” and supplies it to the communication control unit 15.

The presentation information determination unit 124 determines the presentation information to be presented to the user when the pairing between the smartphone 1 and the smartphone 2 is established. Specifically, the presentation information determination unit 124 selects one from a plurality of color information, and supplies the selected color information to the presentation information adjustment unit 125.

The presentation information adjustment unit 125 adjusts the presentation information (color information) determined by the presentation information determination unit 124. Specifically, the presentation information adjustment unit 125 has selected the background color of the screen on its own terminal in accordance with the information related to the screen display settings such as the image quality mode and brightness setting included in the counterpart terminal information 34 The color information is adjusted so that the appearance of the color indicated by the color information is the same as the appearance of the color indicated by the color information selected by the smartphone 2. Then, the adjusted color information is supplied to the communication control unit 15. Note that the presentation information adjustment unit 125 may adjust the selected color information as the background color of the screen in the terminal itself. In this case, the presentation information adjustment unit 125 further adjusts the adjusted color information according to information such as the image quality mode and the brightness setting included in the counterpart terminal information 34, and the further adjusted color information is transmitted to the communication control unit. 15 may be supplied.

The preceding data transmission / reception unit 131 transmits the preceding data 411 to the smartphone 2 and receives the preceding data 411 from the smartphone 2. Specifically, when a specific touch coordinate (for example, a touch coordinate indicating a long press operation) is supplied from the touch acquisition unit 11, the previous data transmission / reception unit 131 reads the previous data 411 from the storage unit 40 and performs communication control. To the unit 15. Further, when the transmission of the preceding data 411 is completed, the preceding data transmitting / receiving unit 131 notifies the actual data transmitting / receiving unit 132 to that effect. Furthermore, the preceding data transmission / reception unit 131 acquires the preceding data 411 transmitted from the smartphone 2 via the communication unit 50 and the communication control unit 15, and obtains the preceding data 411 from the display control unit 14 (specifically, the preceding data To display control unit 141).

The actual data transmitting / receiving unit 132 transmits actual data 412 to the smartphone 2 and receives actual data 412 from the smartphone 2. Specifically, when notified from the preceding data transmitting / receiving unit 131 that the transmission of the preceding data 411 is completed, the actual data transmitting / receiving unit 132 reads the actual data 412 from the storage unit 40 and supplies it to the communication control unit 15. . Further, the actual data transmission / reception unit 132 acquires the actual data 412 transmitted from the smartphone 2 via the communication unit 50 and the communication control unit 15 and supplies the actual data 412 to the display control unit 14.

The display control unit 14 displays a screen (image) on the display unit 22. For example, the display control unit 14 generates a screen in response to an instruction from the application execution unit 12 and causes the display unit 22 to display the screen. The display control unit 14 includes a preceding data display control unit 141 and a presentation information display control unit 142.

The preceding data display control unit 141 displays an image corresponding to the preceding data 411 on the display unit 22. Specifically, when the preceding data display control unit 141 is supplied with the preceding data 411 (specifically, the preceding data 411 transmitted from the smartphone 2) from the application executing unit 12, the preceding data 411 is displayed on the display unit 22. The image corresponding to is displayed.

The presentation information display control unit 142 causes the display unit 22 to display a screen whose background color is the color indicated by the determined presentation information (color information). Specifically, when the presentation information display control unit 142 is supplied with the color information determined by the presentation information determination unit 124 (or the color information transmitted from the smartphone 2), the presentation information display control unit 142 displays the background color corresponding to the color information. A screen is generated and displayed on the display unit 22.

The communication control unit 15 controls communication via the communication unit 50. The communication control unit 15 transmits information supplied from each unit of the smartphone 1 to the smartphone 2 via the communication unit 50. In the present embodiment, as described above, transmission is performed to the smartphone 2 by executing communication using Bluetooth. The communication control unit 15 includes a counterpart terminal specifying unit 151 and a pairing setting unit 152.

The counterpart terminal identification unit 151 identifies a terminal that establishes pairing with the smartphone 1. Specifically, the counterpart terminal specifying unit 151 refers to the changed terminal name supplied from the device name changing unit 123, and among the terminals existing in the communicable range with the smartphone 1, the terminal name Identify a device that has the same app name as the changed device name. Then, one terminal that satisfies a predetermined condition is specified with reference to the time included in the terminal name (changed terminal name) of the specified terminal. The counterpart terminal specifying unit 151 supplies the terminal name of the specified terminal to the pairing setting unit 152.

The pairing setting unit 152 sets the terminal specified by the counterpart terminal specifying unit 151 as a terminal that establishes pairing with the smartphone 1. Specifically, the pairing setting unit 152 transmits a pairing request for establishing pairing to the terminal specified by the counterpart terminal specifying unit 151. When the pairing permission is received as a response to the pairing request, the partner terminal information 34 received together with the pairing permission is stored in the RAM 30. Further, the application execution unit 12 is notified that the pairing permission has been received. Furthermore, when notified that the communication control unit 15 has received the pairing request, the pairing setting unit 152 transmits a pairing permission to the terminal that has transmitted the pairing request.

Next, the smartphone 2 will be described. The smartphone 2 includes a communication unit 70, a control unit 80 (data reception unit, reception side output control unit), a touch panel 90, a RAM 100, and a storage unit 110. Since each part of the smartphone 2 has the same function as the member having the same member name in the smartphone 1, the description thereof is omitted here. That is, the smartphone 1 and the smartphone 2 in the present embodiment are two smartphones having the same function. Therefore, the smartphone 2 may specify the smartphone 1 as a terminal (a partner terminal) for establishing pairing, or image data (preceding data 411 and actual data 412) is transmitted from the smartphone 2 to the smartphone 1. Also good. Note that the smartphone 1 and the smartphone 2 have the same function as an example, and the smartphone 1 and the smartphone 2 may have different functions.

≪Details of data transfer process≫
Next, the flow of data transfer processing (S13 in FIG. 3), which is the main feature of the present invention, will be described in detail with reference to FIGS. In addition, although it demonstrates as transferring data from the smart phone 1 to the smart phone 2 for convenience of explanation below, the same processing may be performed also when transferring data from the smart phone 2 to the smart phone 1.

The smartphone 1 receives a preparation instruction for transmission of image data 41 (more specifically, actual data 412) (preparation instruction for transmission of first data) at the application execution unit 12, and the preceding data transmission / reception unit 131 of the application execution unit 12. Transmits the preceding data to the smartphone 2 in response to the preparation instruction. Then, after transmission of the preceding data (after transmission of the preceding data or during transmission of the preceding data), the actual data transmitting / receiving unit 132 transmits the actual data to the smartphone 2.

When the application execution unit 12 receives an instruction to output the preceding data during the transmission of the preceding data and the actual data or after the transmission is completed, the application executing unit 12 instructs the display control unit 14 to display the preceding data (preceding data output instruction, second data Data output instruction). Then, the preceding data display control unit 141 of the display control unit 14 displays the preceding data on the display unit 22 in cooperation with the smartphone 2. At this time, the application execution unit 12 also transmits a preceding data output instruction to the smartphone 2. By transmitting the preceding data output instruction in this way, the application execution unit 12 can display the preceding data in synchronization with the control unit 80 of the smartphone 2. As a result, the preceding data is displayed in synchronism with the smartphone 1 and the smartphone 2.

The application execution unit 12 instructs the display control unit 14 to display actual data during transmission of actual data or after transmission of actual data (actual data output instruction, first data output instruction), and the display control unit. 14 displays the actual data on the display unit 22 in cooperation with the smartphone 2. When the actual data is still being transmitted, the display control unit 14 displays the actual data in cooperation with the smartphone 2 after the transmission of the actual data is completed. At this time, the application execution unit 12 also transmits an actual data output instruction to the smartphone 2. By transmitting the actual data output instruction in this way, the application execution unit 12 can display actual data in synchronization with the control unit 80 of the smartphone 2. As a result, the actual data is displayed in coordination between the smartphone 1 and the smartphone 2.

Hereinafter, as an example in the present embodiment, the smartphone 1 determines the preparation instruction and the preceding data output instruction from the user's predetermined input operation received by the input unit 21 and acquired by the touch acquisition unit 11. More specifically, in the present embodiment, when the user makes a long press touch on the image displayed on the display unit 22, the smartphone 1 determines that the preparation instruction has been received according to the input operation of the long press touch. .

In addition, the smartphone 1 is dragged onto the touch panel 90 of the smartphone 2 by sliding the finger touching the smartphone 1 and the smartphone 2 while keeping the long press touch (while touching), and dragging it onto the touch panel 90 of the smartphone 2 (input). When a preceding data output instruction is received at a timing when touch-up is detected again (image is dropped) after a touch-down occurs at the end of the input unit 91 within a predetermined time from the touch-up from the end of the unit 21) to decide.

Furthermore, after the drop, the smartphone 1 issues an actual data output instruction when the transmission of the actual data to the smartphone 2 is completed.

Subsequently, a specific example of screen display of the smartphone 1 and the smartphone 2 in the data transfer process will be described with reference to FIG. In addition, as above-mentioned, in this embodiment, it demonstrates as transferring image data from the smart phone 1 to the smart phone 2. FIG.

4 (a) to 4 (f) show specific examples of screen display of the smartphone 1 and the smartphone 2 in the data transfer process. As shown in FIG. 4A, when the user performs an operation indicating permission of data transfer (S9 in FIG. 3), the smartphone 1 and the smartphone 2 display a list of image data stored in their own terminals. Further, as shown in FIG. 4B, the smartphone 1 and the smartphone 2 are arranged adjacent to each other for subsequent user image selection operations.

Here, it is assumed that the user selects one image among the images displayed on the smartphone 1. In this case, as shown in (c) of FIG. 4, the user selects the image by long pressing and touching the image to be transferred to the smartphone 2. The touch is received by the touch panel 20 (input unit 21), the touch coordinates are specified by the touch acquisition unit 11, and transmitted to the application execution unit 12. The application execution unit 12 determines that a data transmission preparation instruction has been received from the long press touch, and the preceding data transmission / reception unit 131 of the application execution unit 12 transmits the preceding data to the smartphone 2 that is the pairing partner terminal. Start. When the transmission of the preceding data is completed, the actual data transmission / reception unit 132 transmits the actual data to the smartphone 2 next. In addition, when communication with the smart phone 1 and the smart phone 2 is high-speed, you may transmit preceding data and real data in parallel.

Subsequently, as shown in FIG. 4D, the user touches the smartphone 1 and the smartphone 2 so as to straddle the touching finger while continuing the long press touch (while touching the input unit 21). The application execution unit 12 determines that the preceding data output instruction has been received from the input operation at the timing of dragging on the touch panel 90 of the smartphone 2 and touched up, and causes the preceding data display control unit 141 to display the preceding data. Instruct. In response to the instruction, the preceding data display control unit 141 reads the preceding data 411 and causes the display unit 22 to display it. As a result, as shown in FIG. 4E, the preceding data 411 (β1) is displayed on the display unit 22 and the display unit 92 almost simultaneously. At this time, the smartphone 1 and the smartphone 2 do not simply display the preceding data 411 on each terminal, but cooperate with each other so that the preceding data 411 is connected on one screen including the display unit 22 and the display unit 92 (display). It is desirable to display (so that sections 22 and 92 implement a multi-display).

Finally, after the transmission of the actual data is completed, the smartphone 1 and the smartphone 2 display the actual data on the display units 22 and 92 in cooperation with each other as shown in (f) of FIG. Note that the display of the actual data is also preferably a multi-display display. Further, when the transmission of actual data from the smartphone 1 to the smartphone 2 is not completed during the touch-up, the preceding data may be displayed and the actual data may be displayed after the transmission / reception of the actual data is completed.

If the long press touch or drag and drop operation is canceled before the preceding data is reproduced (output), the preceding data transmission / reception unit 131 cancels the transmission of the preceding data and has already transmitted it. The preceding data (a part) of the minute may be deleted by the smartphone 2.

In addition, the actual data transmission / reception unit 132 may cancel the transmission of the actual data when the actual data is being transmitted and the drag and drop operation is canceled before the actual data is reproduced. The actual data transmission / reception unit 132 may cancel the transmission of the preceding data when the operation is canceled before the reproduction of the actual data is performed and the transmission of the preceding data is not completed. Then, the actual data transmission / reception unit 132 may instruct the smartphone 2 to delete the preceding data and the actual data (a part thereof) that have already been transmitted.

Next, the detailed flow of the data transfer process will be described with reference to FIGS. FIG. 5 is a flowchart showing the overall configuration of the data transfer process. In addition, although the process of FIG. 5 is demonstrated taking the smart phone 1 as an example below, the smart phone 2 performs the same process.

As shown in the figure, the data transfer process is roughly divided into a transmission side process (S104) and a reception side process (S106). The smartphone 1 monitors whether or not a reception request event has occurred in the control unit 10 after transitioning to the image selection screen (S100). Here, when a reception request event occurs (YES in S100), the smartphone 1 performs a receiving process (S106). Note that “a reception request event occurs” indicates, for example, a case where a reception request for the preceding data 411 is received from another terminal.

On the other hand, if the reception request event has not occurred in the control unit 10 (NO in S100), the smartphone 1 also checks whether a long press event has occurred (S102, preparation instruction reception step). The long press event is a touch event indicating that the user has touched and pressed the image. When the long press event occurs (YES in S102), the smartphone 1 performs a transmission side process (S104).

Subsequently, the transmission side process (S104) and the reception side process (S106) will be described in detail with reference to FIG. In the following, in accordance with the example of FIG. 4, the smartphone 1 is a terminal that transmits an image (a terminal that performs transmission-side processing), and the smartphone 2 is a terminal that receives an image (a terminal that performs reception-side processing). Explain the case.

(A) of FIG. 6 is a flowchart showing details of the flow of the transmission side processing shown in S104 of FIG. FIG. 6B is a flowchart showing details of the flow of the receiving side process shown in S106 of FIG.

As shown in (a) of FIG. 6, the smartphone 1 performs the transmission side reproduction process (S204) after performing the transmission side touch event monitoring process (S202). The smartphone 1 performs a data transmission process (S206, second data transmission step) in parallel with the processes of S202 to 204.

The transmission side touch event monitoring process is a process for monitoring a touch event in a terminal (transmission side terminal) that transmits an image. In the transmission-side touch event monitoring process, various determinations are made based on information acquired from the touch acquisition unit 11 by the application execution unit 12 after the long press event that occurred in S102 (that is, reception of a long press touch (preparation instruction)). Do.

Also, the transmission side reproduction process indicates a process related to output of preceding data or actual data in the transmission side terminal. Further, the data transmission process indicates a process related to transmission of preceding data or actual data in the transmission side terminal. Details of the transmission-side touch event monitoring process, the transmission-side reproduction process, and the data transmission process will be described later.

On the other hand, as shown in FIG. 6B, the smartphone 2 performs the reception side reproduction process (S212) after performing the reception side touch event monitoring process (S210). The smartphone 1 performs a data reception process (S214) in parallel with the processes of S202 to S204.

The reception-side touch event monitoring process is a process for monitoring a touch event in a terminal (receiving-side terminal) that receives an image. The reception side reproduction process indicates a process related to output of preceding data or actual data in the reception side terminal. Further, the data reception process indicates a process related to reception of preceding data or actual data at the receiving terminal. Details of the reception side touch event monitoring process, the reception side reproduction process, and the data reception process will be described later.

FIG. 7A is a flowchart showing details of the flow of the transmission side touch event monitoring process shown in S202 of FIG. FIG. 7B is a flowchart showing details of the flow of the reception-side touch event monitoring process shown in S210 of FIG.

7A, the application execution unit 12 of the smartphone 1 monitors whether or not there is a touch-up after the long press event that occurred in S102 (S300). Specifically, the application execution unit 12 determines that the touch-up has been performed when the touch coordinates are not transmitted from the touch acquisition unit 11 for a predetermined time or more.

If it is determined that the application execution unit 12 has been touched up (YES in S300), the app execution unit 12 further confirms the touch coordinates acquired last from the touch acquisition unit 11 (that is, the coordinates indicating the touched-up position), thereby It is determined whether or not the touch-up is a touch-up at the end of the input unit 21 (that is, the screen end of the display unit 22). When the touch-up is a touch-up at the edge of the screen (YES in S302), the application execution unit 12 prepares to transmit information related to the touch-up to the smartphone 2 and processes related to the transmission (transmission of touch-up information) Preparation process) is performed (S304). And the application execution part 12 confirms whether the reproduction | regeneration instruction | indication event generate | occur | produced (S306). Here, the reproduction instruction event is an event related to output of preceding data. When the reproduction instruction event occurs, the application execution unit 12 proceeds to the transmission side reproduction process (S204). If the touch-up is not a touch-up at the screen edge (NO in S302), the application execution unit 12 ends the process without performing the processes after S306. Therefore, the transmission side reproduction process (S204) is not performed.

On the other hand, as shown in FIG. 7B, the smartphone 2 performs reception-side touch event monitoring processing. The control unit 80 of the smartphone 2 monitors whether or not there is a touchdown on the input unit 91 (S350), and when there is a touchdown (YES in S350), the control unit 80 acquires the coordinates of the touchdown, thereby touching. It is determined whether the down is a touch-down at the screen edge (S352). When the touchdown is a touchdown at the screen edge (YES in S352), the control unit 80 further receives touchup information (information transmitted by the process of S304) from the smartphone 1 (transmission side). Is determined (S354). If the touch-up information has been received (YES in S354), and the touch-up, that is, the image drop has been performed on the input unit 91 (YES in S356), the control unit 80 performs reception-side reproduction processing (S212). )

On the other hand, when the touch-up information on the transmission side has not been received (NO in S354), the control unit 80 performs the wait process for a predetermined wait period (S358) and then receives the touch-up information on the transmission side again. It is determined whether or not (S360). When the touch-up information is received here (YES in S360), the control unit 80 performs the processing after S356. On the other hand, when the touch-up information is not received (NO in S360), the control unit 80 ends the process.

FIG. 8A is a flowchart showing details of the flow of the transmission side reproduction process shown in S204 of FIG. FIG. 8B is a flowchart showing details of the flow of the reception side reproduction process shown in S212 of FIG.

As shown in FIG. 8A, the application execution unit 12 of the smartphone 1 monitors whether or not a playback instruction has been received (whether or not a playback instruction has been given in a playback instruction event) (S400). Here, when a reproduction instruction is received (YES in S400), the application execution unit 12 determines the type of reproduction instruction (S402). Specifically, whether the reproduction instruction instructs the output of the preceding data (thumbnail), the instruction to output the actual data reproduction instruction (actual data output instruction), or the reproduction instruction when data is not transmitted. judge.

Here, when the reproduction instruction is a reproduction instruction when data is not transmitted, the application execution unit 12 instructs the display control unit 14 to display a black screen (a predetermined screen that is not the selected image) (S404). When the reproduction instruction is a thumbnail reproduction instruction, the application execution unit 12 instructs the display control unit 14 to reproduce (display) the preceding data (S406, output control step). If the reproduction instruction is an instruction to reproduce actual data, the application execution unit 12 instructs the display control unit 14 to reproduce (display) the actual data (S408). Note that when the processes of S404 and S406 are performed, the control unit 80 thereafter repeats the processes after S400 again, but when the process of S408 is performed, the transmission side reproduction process is terminated.

On the other hand, as shown in FIG. 8B, the control unit 80 of the smartphone 2 first determines whether or not the preceding data (thumbnail) has been received from the smartphone 1 (S450). When the thumbnail has been received (YES in S450), the control unit 80 instructs the display unit 92 to reproduce the thumbnail (S452), and the display unit 92 displays the thumbnail according to the instruction (S454).

Subsequently, the control unit 80 waits until reception of actual data is completed (it has been received) (S456). When the actual data has been received (YES in S456), the control unit 80 instructs the display unit 92 to reproduce the actual data in the same manner as the thumbnail (S458), and the display unit 92 displays the thumbnail according to the instruction (S458). S460).

On the other hand, when the thumbnail has not been received in S450 (NO in S450), the control unit 80 instructs the display unit 92 to display a black screen (a predetermined screen that is not the selected image) (S462). A black screen is displayed (S464). Thereafter, the control unit 80 stands by until a thumbnail is received from the smartphone 1 (S466). When the thumbnail is received (YES in S466), the processing from S452 described above is performed.

FIG. 9A is a flowchart showing details of the data transmission process shown in S206 of FIG. FIG. 9B is a flowchart showing details of the flow of the data reception process shown in S214 of FIG.

As shown in FIG. 9A, the application execution unit 12 of the smartphone 1 determines whether or not the touch-up information of the terminal itself has been transmitted to the smartphone 2 (S500). When the touch-up information of the terminal itself has been transmitted to the smartphone 2 (YES in S500), the application execution unit 12 determines whether there is untransmitted data among the preceding data and the actual data (S502). When there is untransmitted data (YES in S502), the preceding data transmitting / receiving unit 131 or the actual data transmitting / receiving unit 132 of the application executing unit 12 continuously transmits the untransmitted data (S504), and then the application executing unit 12 Repeats the process from S500. If the application execution unit 12 determines that there is no untransmitted data (NO in S502), the application execution unit 12 determines whether the touch-up information of the terminal itself has been transmitted to the smartphone 2 (S506). If the touch-up information has also been transmitted (YES in S506), the smartphone 1 ends the data transmission process. On the other hand, when the touch-up information of the terminal itself has not been transmitted to the smartphone 2 (NO in S506), the application execution unit 12 repeats the process from S500.

On the other hand, when the application execution unit 12 has not transmitted the touch-up information of the own terminal to the smartphone 2 (NO in S500), the application execution unit 12 has received the touch-up information (touch from the touch acquisition unit 11). (Whether the coordinates related to up have been acquired) are checked (S508). Here, when the touch-up information is received, the application execution unit 12 transmits the touch-up information to the opposite device, that is, the smartphone 2 that is the receiving side terminal (S510), and then performs the process of S502. If the application execution unit 12 itself has not received the touch-up information (NO in S508), the application execution unit 12 performs the determination of S502 without performing the process of S510.

Summarizing the above processes, the smartphone 1 repeats the various determinations and processes of the data transmission process described above until the touch-up information of the terminal itself, the preceding data, and the actual data are all transmitted.

On the other hand, as shown in FIG. 9B, the control unit 80 of the smartphone 2 determines whether the received information is the preceding data or the actual data (S550). Here, when it is preceding data or actual data (YES in S550), that is, when preceding data or actual data is transmitted from the smartphone 1, the control unit 80 receives the preceding data or actual data (S552).

If the received information is not preceding data or actual data (NO in S550), that is, if it is touch-up information of the terminal itself, the control unit 80 receives the touch-up information (S556). After the process of S552 or S556, the control unit 80 determines whether or not the preceding data or actual data and the touch-up information of the terminal itself, that is, the information indicating the image drop have been received (S554). If both pieces of information have been received (YES in S554), the control unit 80 ends the process. If any of these pieces of information has not been received (NO in S554), the control unit 80 repeats the processing from S550 onward.

Through the above processing, the preceding data and the actual data are transmitted from the smartphone 1 to the smartphone 2, and the data transfer process is completed.

[Embodiment 2]
Further, as shown in FIG. 2D, the smartphone 1 and the smartphone 2 display image candidates to be displayed across both terminals on the display unit 22, and the candidates are determined according to preset category information. May be. Specifically, the application execution unit 12 presets category information corresponding to the user operation. The category information is, for example, “Latest day” or “September 22 Hokkaido travel photo”, and the application execution unit 12 specifies the image data 41 according to the set category information. Information indicating the image data 41 is supplied to the display control unit 14. The display control unit 14 causes the display unit 22 to display image candidates based on the supplied information.

More specifically, the application execution unit 12 specifies the image data 41 according to the set category information by referring to the date and time information and the position information added to the image data 41. In addition, the application execution unit 12 may add various types of information to the image data 41. For example, when the image data 41, which is a plurality of photographs, is graphed by taking the shooting date and time on the horizontal axis and the number of images on the vertical axis, the portion where many photographs are displayed at the same position on the horizontal axis is traveled. It can be specified that it is a photograph at the time. If the location information can be acquired from the additional information of the photo included in this part, the category information such as the above-mentioned “photo of Hokkaido trip on 9/22” can be added to the photo included in this part.

[Embodiment 3]
In the first to third embodiments described above, the smartphone 1 and the smartphone 2 may transmit the resolution on the touch panel 20 and the size of the display area to the counterpart terminal when pairing is established. Thereby, since the smart phone 1 can acquire the resolution of the other party terminal (smart phone 2) and the size of the display area, as shown in (e) of FIG. 2, the touch when the image β is selected and dragged and dropped. Based on the coordinate trajectory, how the smartphone 1 and the smartphone 2 are arranged, more specifically, two smartphones adjacent to each other forming the rectangular smartphone 1 and the smartphone 2 are adjacent to each other. Thus, it is possible to specify from where to where the contact is in contact.

That is, when the user performs a drag and drop operation, the touch acquisition unit 11 identifies the touch coordinates on the contact side of the smartphone 1 and the touch coordinates on the contact side of the smartphone 2. Also, the coordinates of the start point and end point of the operation are specified. And the application execution part 12 can pinpoint the direction of the said operation from these coordinates. In addition, the application execution unit 12 can determine which of the smartphone 1 and the smartphone 2 is using the resolution of the own device and the size of the display area, the resolution of the counterpart terminal and the size of the display area, and the specified touch coordinates and operation direction. In other words, it is possible to specify the shape of the connected display area composed of the display areas of the two smartphones. And the application execution part 12 of the smart phone 1 is the part displayed on the display area of the smart phone 1 among the image data 41 to display according to the arrangement | positioning relationship (shape of a connection display area) of the smart phone 1 and the smart phone 2 which were specified. And the part displayed on the display area of the smart phone 2 is each specified.

Thereby, even if it is a case where the smart phone 1 and the smart phone 2 are arrange | positioned and shifted (there is a part which is not in contact with the other party terminal in a contact side), the image data 41 displayed over two smart phones, It is possible to display without any deviation. For example, even if the display areas of the smartphone 1 and the smartphone 2 are different in size, the image data 41 displayed over the two smartphones can be displayed without any deviation.

[Modification]
Note that the application execution unit 12 of the smartphone 1 may transmit file information of the actual data 412 to the smartphone 2 further prior to transmission of the preceding data 411. Then, a response is received from the smartphone 2 as to whether or not the actual data 412 corresponding to the file information is held. If the smartphone 2 already holds the actual data 412, the preceding data 411 and the actual data 412 are updated. The preceding data 411 or the actual data 412 may be displayed at the stage of accepting the user's drag operation or drop operation (or at the stage of touching and holding an image on the smartphone 1) without transmitting at least one of them. Thereby, when the smart phone 2 has already held the actual data 412, the preceding data 411 or the actual data 412 can be displayed without redundantly transmitting the actual data.

Further, when using high-speed communication such as Wi-Fi as a communication method between the smartphone 1 and the smartphone 2, the transmission-side terminal selects, for example, the smartphone 1 before selecting data to be transferred by the user (S11 in FIG. 3). It may be considered that a preparation instruction has been accepted at the time when communication of the smartphone 2 is established (at time S5 or S9 in FIG. 3), and transmission of preceding data and actual data that is expected to be selected by the user in advance may be started. . Here, “data expected to be selected by the user” is, for example, data whose data creation date and time is within a predetermined period (that is, new data), data having a large number of user accesses, and the like.

On the other hand, when using a low-speed communication method for communication between the smartphone 1 and the smartphone 2 or when communication cannot be performed at high speed due to the performance of the smartphone 1 or the smartphone 2, the capacity of the preceding data is reduced (for example, the preceding data). If is a thumbnail, the size of the thumbnail may be reduced or the image may be a black and white image). Thereby, since the capacity of data transmitted / received between the smartphone 1 and the smartphone 2 is reduced, the delay in communication between the smartphone 1 and the smartphone 2 is reduced, and as a result, the output delay of the transmitted / received data (preceding data) is also reduced. It can be hard to happen.

Also, the resolution of the terminal itself and the other terminal (example: both are 1920 pixels long × 1080 horizontal pixels), and the actual data is less than the combined resolution of both terminals (example: pixel number is 1920 vertical × 2160 horizontal or less) The resized or compressed data may be used as actual data.

[Example of software implementation]
The control blocks (particularly the application execution unit 12 and the display control unit 14) of the smartphones 1 and 2 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or a CPU (Central Processing) Unit) and may be realized by software.

In the latter case, the smartphones 1 and 2 include a CPU that executes instructions of a program that is software that realizes each function, and a ROM (Read Only Memory) in which the program and various data are recorded so as to be readable by the computer (or CPU). Alternatively, a storage device (these are referred to as “recording media”), a RAM (Random Access Memory) for expanding the program, and the like are provided. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
A communication terminal (smart phone 1) according to aspect 1 of the present invention includes a preparation instruction receiving unit (application executing unit 12) that receives a preparation instruction for transmission of first data (actual data 412) to another communication terminal (smart phone 2). When the preparation instruction receiving unit receives the preparation instruction, a second data transmission unit (preceding data) that transmits second data (preceding data 411) indicating at least a part of the first data to the other communication terminal. After the data transmission / reception unit 131) and the second data transmission unit transmit the second data, the second data is transmitted to the output unit (display unit 22) of the own terminal together with the other communication terminals. An output control unit (display control unit 14) for output.

According to the above configuration, the second data transmission unit transmits the second data to another communication terminal in response to reception of the preparation instruction from the preparation instruction reception unit. Then, the output control unit causes the output unit to output the second data after the transmission. At this time, the output of the second data by the output unit is performed in synchronism with the output of the second data in other communication terminals.

Therefore, when the communication terminal outputs data in cooperation with another communication terminal, the user does not feel the output delay related to the transmission / reception of the data, and the data having a sense of unity between the own terminal and the other communication terminal Output can be realized.

In the communication terminal according to aspect 2 of the present invention, in the aspect 1, the output control unit may cause the output unit of the terminal to output the second data substantially simultaneously with the other communication terminals.

According to the above configuration, the communication terminal can output the second data with a sense of unity with other communication terminals with respect to the second data.

The communication terminal according to aspect 3 of the present invention is the communication terminal according to aspect 1 or 2, wherein the first data is transmitted to the other communication terminal after the second data transmission unit starts transmitting the second data. A data transmission unit (actual data transmission / reception unit 132), and the output control unit sends the first data to the output unit of the terminal when the first data transmission unit completes transmission of the first data. It may be output together with the communication terminal.

According to the above configuration, the communication terminal can output the first data with a sense of unity with other communication terminals.

A communication terminal according to Aspect 4 of the present invention is the communication terminal according to any one of Aspects 1 to 3, wherein the second data transmission unit completes the transmission of the second data with respect to the other communication terminal. An output instruction transmission unit (application execution unit 12) for transmitting a second data output instruction for instructing output of second data is provided, and the output control unit transmits the second data to the output unit. The second data may be output at the timing when the output instruction is transmitted.

According to the above configuration, the output control unit can output the second data in precise synchronization with other communication terminals. Therefore, it is possible to output the second data with a sense of unity between the communication terminal and another communication terminal.

In the communication terminal according to aspect 5 of the present invention, in the aspect 3, when the first data transmission unit completes transmission of the first data, the communication terminal instructs the other communication terminal to output the first data. An output instruction transmission unit (application execution unit 12) that transmits a first data output instruction to be transmitted, and the output control unit transmits the first data output instruction to the output unit when the output instruction transmission unit transmits the first data output instruction. The first data may be output.

According to the above configuration, the output control unit can output the first data accurately in synchronization with other communication terminals. Therefore, it is possible to output the first data with a sense of unity between the communication terminal and another communication terminal.

The communication terminal according to Aspect 6 of the present invention is the communication terminal according to Aspect 4, in which, when the preparation instruction is canceled before the output instruction transmission unit transmits the second data output instruction, You may provide the data deletion instruction | indication part (application execution part 12) which deletes the said 2nd data which the 2nd data transmission part transmitted.

According to the above configuration, when the preparation instruction is canceled before the second data is output, the deletion instruction unit can cause the other communication terminal to delete the second data. Thereby, the communication terminal can delete the second data that has already been transmitted to the other communication terminal when the output of the second data in cooperation with the other communication terminal is canceled. .

Thus, the above cancellation can be performed without leaving the data transmitted from the own terminal in other communication terminals.

In the communication terminal according to aspect 7 of the present invention, in the aspect 5, the second data transmission unit transmits the file information of the first data to the other communication terminal prior to transmission of the second data. , Receiving, from the other communication terminal, whether or not the other communication terminal holds the first data corresponding to the file information as a response to the transmission of the file information by the second data transmission unit. A response receiving unit (application executing unit 12), wherein the output instruction transmitting unit indicates that the response receiving unit holds that the other communication terminal holds the first data corresponding to the file information. The first data output instruction is transmitted, and the output control unit causes the output unit to output the first data at the timing when the first data output instruction is transmitted. It may be.

According to the above configuration, the second data transmission unit transmits the file information of the first data prior to the transmission of the second data. Thereby, the response receiving unit can receive a response indicating whether or not the first data is held in another communication terminal. The output instruction transmission unit transmits a first data output instruction when another communication terminal already holds the first data.

Thereby, when the other communication terminal already holds the first data, the communication terminal can output the first data in cooperation with both terminals without performing transmission / reception of the first data.

The communication terminal according to aspect 8 of the present invention is the communication terminal according to any one of the aspects 1 to 7, wherein the preparation instruction receiving unit issues the preparation instruction when communication between the own terminal and the other communication terminal is established. You may consider it accepted.

According to the above configuration, the preparation instruction accepting unit regards that the preparation instruction has been made when communication between the own terminal and another communication terminal is established without waiting for the preparation instruction. Thereby, the 2nd data transmission part can start transmission of 2nd data, when communication with an own terminal and another communication terminal is established. Thereby, the communication terminal can reduce the output delay that occurs when the second data is displayed in cooperation with the other communication terminals.

The communication terminal according to Aspect 9 of the present invention is the communication terminal according to any one of Aspects 1 to 8, wherein the preparation instruction receiving unit receives the preparation instruction, the input to the input unit of the own terminal, and the other When the input to the input unit of the communication terminal is continuously performed, the time between the input to the input unit (input unit 21) of the own terminal and the input to the input unit (input unit 91) of the other communication terminal An input determination unit (application execution unit 12) that determines whether or not the interval is within a predetermined time is provided, and the second data transmission unit transmits the second data in parallel with the determination of the input determination unit. You may go.

According to the above configuration, after the communication terminal accepts the preparation instruction in the input determination unit, the determination process of the operation input across the communication terminal and other communication terminals, and the second data transmission unit in the second data transmission unit Sending can be processed in parallel. Therefore, since the processing related to the input operation related to the first data output instruction or the second data output instruction by the user and the transmission of the second data can be processed in real time, the second data can be shared with other communication terminals. It is possible to reduce the output delay that occurs when adjusting and displaying.

When the communication terminal (smart phone 2) according to the tenth aspect of the present invention receives an instruction to prepare for transmission of the first data (actual data 412) with respect to the own terminal at the other communication terminal (smart phone 1), the first A data receiving unit (control unit 80) that receives second data (preceding data 411) indicating at least part of one data from the other communication terminal; and after the data receiving unit receives the second data, A reception-side output control unit (control unit 80) that outputs the second data to the terminal output unit (display unit 92) in cooperation with the other communication terminals.

According to said structure, there exists an effect similar to the communication terminal shown in any one aspect of the said aspects 1-9.

The data output method which concerns on aspect 11 of this invention is a data output method for outputting 1st data (actual data 412) with a communication terminal (smart phone 1) and another communication terminal (smart phone 2), A preparation instruction reception step (S102) for receiving a preparation instruction for transmission of the first data to the communication terminal, and a second instruction indicating at least a part of the first data when the preparation instruction is received in the preparation instruction reception step. A second data transmission step (S206) for transmitting two data (preceding data 411) to the other communication terminal, and after transmitting the second data in the second data transmission step, And an output control step (S406) for causing the unit 22) to output the second data in cooperation with the other communication terminals.

According to said structure, there exists an effect similar to the communication terminal shown in any one aspect of the said aspects 1-9.

The communication terminal according to each aspect of the present invention may be realized by a computer. In this case, the communication terminal control program for realizing the communication terminal by the computer by causing the computer to operate as each unit included in the communication terminal. And a computer-readable recording medium on which it is recorded also fall within the scope of the present invention.

The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

The present invention can be used for a communication terminal that enables transmission and reception of information between its own terminal and another terminal by establishing communication with another terminal.

1, 2 Smartphone (communication terminal, other communication terminal)
12 application execution unit (preparation instruction reception unit, output instruction transmission unit, data deletion instruction unit, response reception unit, input determination unit)
21, 91 Input unit 22, 92 Display unit (output unit)
80 control unit (data receiving unit, receiving side output control unit)
131 Preceding data transmitter / receiver (second data transmitter)
132 Actual data transmitter / receiver (first data transmitter)
411 Preceding data (second data)
412 Actual data (first data)
14 Display controller (output controller)

Claims (12)

1. A preparation instruction receiving unit for receiving a preparation instruction for transmitting the first data to another communication terminal;
   A second data transmission unit that transmits second data indicating at least a part of the first data to the other communication terminal when the preparation instruction reception unit receives the preparation instruction;
   An output control unit that causes the output unit of the terminal to output the second data in cooperation with the other communication terminal after the second data transmission unit transmits the second data; Communication terminal.
2. The communication terminal according to claim 1, wherein the output control unit causes the output unit of its own terminal to output the second data substantially simultaneously with the other communication terminal.
3. A first data transmission unit for transmitting the first data to the other communication terminal after the start of transmission of the second data in the second data transmission unit;
   The output control unit causes the output unit of the terminal to output the first data in cooperation with the other communication terminals when the first data transmission unit completes transmission of the first data. The communication terminal according to claim 1 or 2.
4. An output instruction transmission unit that transmits a second data output instruction that instructs the other communication terminal to output the second data when the second data transmission unit completes the transmission of the second data;
   The output control unit causes the output unit to output the second data at a timing when the output instruction transmission unit transmits the second data output instruction to the output unit. The communication terminal according to item.
5. An output instruction transmission unit that transmits a first data output instruction to instruct the other communication terminal to output the first data when the first data transmission unit completes the transmission of the first data;
   The communication terminal according to claim 3, wherein the output control unit causes the output unit to output the first data at a timing when the output instruction transmission unit transmits the first data output instruction to the output unit.
6. Data that causes the other communication terminal to delete the second data transmitted by the second data transmission unit when the preparation instruction is canceled before the output instruction transmission unit transmits the second data output instruction. The communication terminal according to claim 4, further comprising a deletion instruction unit.
7. The second data transmission unit transmits the file information of the first data to the other communication terminal prior to the transmission of the second data,
   A response received from the other communication terminal as a response to the transmission of the file information by the second data transmission unit, whether or not the other communication terminal holds the first data corresponding to the file information. With a receiver
   The output instruction transmitting unit receives the first data output instruction when the response receiving unit receives, as the response, that the other communication terminal holds the first data corresponding to the file information. Send
   The communication terminal according to claim 5, wherein the output control unit causes the output unit to output the first data at a timing at which the first data output instruction is transmitted.
8. The communication according to any one of claims 1 to 7, wherein the preparation instruction receiving unit considers that the preparation instruction is received when communication between the terminal and the other communication terminal is established. Terminal.
9. When the preparation instruction accepting unit accepts the preparation instruction and the input to the input unit of the own terminal and the input to the input unit of the other communication terminal are continuously performed, the input unit of the own terminal An input determination unit that determines whether or not the time interval between the input to and the input to the input unit of the other communication terminal is within a predetermined time,
   The communication terminal according to any one of claims 1 to 8, wherein the second data transmission unit transmits the second data in parallel with the determination of the input determination unit.
10. A data receiving unit for receiving, from another communication terminal, second data indicating at least a part of the first data when an instruction to prepare for transmission of the first data to the own terminal is received by another communication terminal; ,
    A reception-side output control unit that causes the output unit of the terminal itself to output the second data in cooperation with the other communication terminal after the data reception unit receives the second data; Communication terminal.
11. A control program for causing a computer to function as the communication terminal according to any one of claims 1 to 9, wherein the control program causes the computer to function as each of the above-described units.
12. A data output method for outputting first data between a communication terminal and another communication terminal,
    A preparation instruction receiving step for receiving a preparation instruction for transmission of the first data to another communication terminal;
    A second data transmission step of transmitting second data indicating at least a part of the first data to the other communication terminal when the preparation instruction is received in the preparation instruction reception step;
    An output control step of causing the output unit of the terminal itself to output the second data in cooperation with the other communication terminals after transmitting the second data in the second data transmission step. Characteristic data output method.

Images