JP6983835B2 - Display device, cooperation system, control method and program - Google Patents

Description

The present invention relates to a display device and the like.

Conventionally, for data transfer between a mobile terminal and an information processing device, identification information of another device is acquired by proximity communication (first communication method) such as an RF tag, and the acquired identification information is used for Bluetooth (registration). There was a technique of establishing another communication method (second communication method) such as (trademark) and performing data transfer (see, for example, Patent Document 1).

On the other hand, as a method for easily logging in, for example, a technique is disclosed in which when a mobile terminal is logged in to a cloud service and brought close to the MFP, the MFP also logs in to the same service as the mobile terminal (for example, Patent Document 2). reference).

Japanese Patent No. 4868195 Japanese Unexamined Patent Publication No. 2013-109616

Since the method of Patent Document 1 described above does not consider security, there is a risk that confidential information stored in the information processing apparatus may be leaked. That is, there is a problem that the file in the terminal is leaked in an unintended state.

Further, in the description of Patent Document 2, the exchange of information between the mobile terminal and the MFP is limited to the user login information to the service, and the measures for exchanging information such as document data used by the user are described. No. Therefore, there is a problem that the mechanism of linking files cannot be realized.

In view of the above-mentioned problems, an object of the present invention is to provide a display device and the like for facilitating file linkage between a display device and a terminal of another display device.

In order to solve the above-mentioned problems, the display device of the present invention is used.
A display device that can be connected to a mobile terminal device by a first wireless communication means and a second communication means different from the first wireless communication means.
When the connection with the mobile terminal device is detected by the first wireless communication means, the connection information to the server device in which the file displayed in the mobile terminal device is stored and the file link to the file. Information is acquired from the mobile terminal device via the second wireless communication means, and the information is obtained from the mobile terminal device.
By connecting to the server device based on the connection information to the server device,
It is characterized in that a file based on the file link information is received from the server device and displayed.

The cooperation system of the present invention is a cooperation system including a display device, a mobile terminal device, and a server.
The display device is
When the connection with the mobile terminal device is detected by the first wireless communication means, the connection information to the server device in which the file displayed in the mobile terminal device is stored and the file link to the file. Information is obtained from the mobile terminal device via the second wireless communication means, and the information is obtained from the mobile terminal device.
By connecting to the server device based on the connection information to the server device,
It is characterized in that a file based on the file link information is received from the server device and displayed.

The control method of the present invention is a control method in a display device that can be connected to a mobile terminal device by a first wireless communication means and a second communication means different from the first wireless communication means.
When the connection with the mobile terminal device is detected by the first wireless communication means, the connection information to the server device in which the file displayed in the mobile terminal device is stored and the file link to the file. A step of acquiring information from the mobile terminal device via a second wireless communication means, and
A step of connecting to the server device based on the connection information to the server device,
A step of receiving and displaying a file based on the file link information from the server device, and
It is characterized by including.

In the display device of the present invention, the connection between the other display device and the display control device is first detected by the first communication means that realizes communication in a short distance, and then the file is transmitted by the second communication means. As a result, the display device and the other display device can realize the file linkage by a simple method without being particularly conscious of it.

It is a figure which shows the whole of a file linkage system. It is a figure for demonstrating the functional structure of a display device. It is a figure for demonstrating the functional configuration of a mobile terminal apparatus. It is a figure for demonstrating account information. It is a figure for demonstrating the file information. It is a figure for demonstrating the process managed by a process management part. This is an example of the operation flow related to the main processing. This is an example of the operation flow in the first embodiment. It is a figure for demonstrating the operation example (screen example) in 1st Embodiment. It is a figure for demonstrating the operation example (screen example) in 1st Embodiment. This is an example of the operation flow in the second embodiment. This is an example of the operation flow in the third embodiment. It is a figure for demonstrating the operation example (screen example) in 3rd Embodiment. It is a figure for demonstrating the operation example (screen example) in 3rd Embodiment. This is an example of the operation flow in the fourth embodiment. It is a figure for demonstrating the operation example (screen example) in 4th Embodiment. It is a figure for demonstrating the operation example (screen example) in 4th Embodiment. This is an example of the operation flow in the fifth embodiment. It is a figure for demonstrating the operation example (screen example) in 5th Embodiment. It is a figure for demonstrating the operation example (screen example) in 5th Embodiment. This is an example of the operation flow in the sixth embodiment. It is a figure for demonstrating the operation example (screen example) in 6th Embodiment. This is an example of the operation flow in the seventh embodiment. It is a figure for demonstrating the operation example (screen example) in 7th Embodiment. It is an example of the operation flow in the eighth embodiment. It is a figure for demonstrating the operation example (screen example) in 8th Embodiment. This is an example of the operation flow in the ninth embodiment. It is a figure for demonstrating the operation example (screen example) in 9th Embodiment. It is a figure for demonstrating the operation example (screen example) in 9th Embodiment. It is a figure for demonstrating the functional structure of the display device in 10th Embodiment. It is an example of the operation flow in the eleventh embodiment. It is an example of the operation flow in the twelfth embodiment.

Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings. The display device 10 to which the display control device of the present invention is applied and the mobile terminal device 20 to which the mobile terminal device of the present invention is applied are described as examples, but this is an example for explaining the features of the present invention.

[1. overall structure]
FIG. 1 shows a diagram schematically showing the file linkage system 1 of the present invention. In the present embodiment, the display device 10 to which the display control device of the present invention is applied is connected to the network NW. Further, the mobile terminal device 20 is included as the terminal device, and is connected to the network NW via a wireless LAN or a 3G line (second communication method). Further, the mobile terminal device 20 is connected to the display device 10 via the network NW, and can also be connected via NFC communication (first communication method).

A cloud storage server 30 (hereinafter, the cloud storage is referred to as "CS") is further connected via the network NW. The CS server 30 is a server that provides a file management service and uses a known cloud storage service.

The network NW is a concept including LAN and WAN. That is, the mobile terminal device 20 may be connected via an access point via a wireless LAN using a standard such as IEEE802.11a / b / g, or may be connected using a 3G line. The display device 10 may be connected regardless of whether it is a wired LAN or a wireless LAN. Further, the CS server 30 may be assumed to be a cloud storage service via the Internet, or a file management server or NAS provided in the premises LAN.

[2. Function configuration]
Subsequently, the functional configuration of the display device 10 and the mobile terminal device 20 in the present embodiment will be described with reference to the drawings.

[2.1 Display device]
The functional configuration of the display device 10 will be described with reference to FIG. The display device 10 includes a control unit 100, a display unit 110, an operation unit 120, an NFC communication unit 130, a wireless communication unit 140, a LAN communication unit 150, a storage unit 160, and an application management unit 170. It is composed of.

The control unit 100 is a functional unit for controlling the entire display device 10. The control unit 100 realizes various functions by reading and executing various programs stored in the storage unit 160, and is configured by, for example, a CPU (Central Process Unit) or the like.

The display unit 110 is a functional unit for displaying various information, data, and the like. For example, it is composed of a liquid crystal display (LCD), an organic EL display, and the like. Although the present embodiment will be described by taking a configuration in which the display device 10 has the display unit 110 as an example, the device may be connected to, for example, an external display. That is, it may be configured as a display control device and may be a device that controls display on an external display device connected by HDMI (registered trademark) or the like.

The operation unit 120 is a functional unit for the user to perform various operations. In the present embodiment, a touch panel provided on the display unit 110 will be described as an example. Of course, various operating devices such as a mouse and a keyboard can be used. Further, the touch panel is also a device capable of detecting a plurality of touches, for example, an electrostatic induction method or a pressure sensitive method.

The NFC communication unit 130 is a functional unit for performing short-range wireless communication (first communication). The NFC communication unit 130 communicates with the NFC communication unit 230 of the mobile terminal device 20, which will be described later. As a result, various data (information) and files can be communicated via NFC (Near Field Communication).

The wireless communication unit 140 is a functional unit that performs communication (second communication) using a wireless LAN or the like. For example, it becomes possible to communicate with the mobile terminal device 20 by using a wireless LAN standard such as IEEE802.11a / b / g / n.

Here, the display device 10 and the mobile terminal device 20 may be directly connected using the ad hoc mode, or may be connected via the access point using the infrastructure mode. Is also good.

The LAN communication unit 150 is a functional unit for connecting to a wired LAN and performing communication (second communication). It becomes possible to connect to the CS server 30 by disconnecting a wired LAN and disconnecting another network (for example, the Internet).

For convenience of explanation, the wireless communication unit 140 and the LAN communication unit 150 will be described separately, but it goes without saying that communication can be performed using only one of them.

The storage unit 160 is a functional unit that stores various programs and various data necessary for the operation of the display device 10. The storage unit 160 is composed of, for example, a semiconductor memory, an HDD (Hard Disk Drive), or the like.

Further, the storage unit 160 can store the account information 162 for the user to connect to the CS server 30 (CS service realized in the CS server 30) and the file information 164 for the linked file. The account information 162 is information common to the account information 262 described later and the file information 164 is the information common to the file information 264 described later, and the details will be described later.

The application management unit 170 is a functional unit that manages an application executed by the display device 10. In this embodiment, at least a cloud storage application (hereinafter referred to as "CS application") 172 for using the CS service and a browser application 174 for displaying HTML and the like are stored. The managed application may be stored in the storage unit 160.

[2.2 Mobile terminal device]
Subsequently, the functional configuration of the mobile terminal device 20 will be described with reference to FIG. The mobile terminal device 20 includes a control unit 200, a display unit 210, an operation unit 220, an NFC communication unit 230, a wireless communication unit 240, a call processing unit 250, a storage unit 260, an application management unit 270, and the like. It is configured to include a process management unit 280.

The control unit 200 is a functional unit for controlling the entire mobile terminal device 20. The control unit 200 realizes various functions by reading and executing various programs stored in the storage unit 260, and is configured by, for example, a CPU (Central Process Unit) or the like.

The display unit 210 is a functional unit for displaying various information, data, and the like. For example, it is composed of a liquid crystal display (LCD), an organic EL display, and the like. In this embodiment, the configuration in which the mobile terminal device 20 has the display unit 210 will be described as an example, but the device may be connected to, for example, an external display. That is, even if it is configured as a display control device and controls to display on an external display device connected by HDMI or the like (for example, a liquid crystal television connected to a large display device by wireless HDMI). good.

The operation unit 220 is a functional unit for the user to perform various operations. In the present embodiment, a touch panel provided on the display unit 210 will be described as an example. Of course, various operating devices such as hardware keys and voice input can be used. Further, the touch panel is also a device capable of detecting a plurality of touches, for example, an electrostatic induction method or a pressure sensitive method.

The NFC communication unit 230 is a functional unit for performing short-range wireless communication (first communication). The NFC communication unit 230 communicates with the NFC communication unit 130 of the display device 10 described above. As a result, various data (information) and files can be communicated via NFC (Near Field Communication).

The wireless communication unit 240 is a functional unit that performs communication (second communication) using a wireless LAN or the like. For example, it is possible to communicate with the display device 10 by using a wireless LAN standard such as IEEE802.11a / b / g / n.

The call processing unit 250 is a functional unit for the mobile terminal device 20 to realize as a mobile phone function. For example, a voice processing unit is included, and a call function can be realized by using a voice input / output device.

Further, communication (second communication) can be performed by using an external line. That is, by using the 3G line or LTE line prepared by the mobile carrier, it is possible to perform data communication or the like. As a result, for example, in the wireless communication unit 240, even in an environment where the wireless LAN cannot be connected, it is possible to solve the call processing unit 250 and use the 3G line or the LTE line to perform data communication.

The storage unit 260 is a functional unit that stores various programs and various data necessary for the operation of the mobile terminal device 20. The storage unit 260 is composed of, for example, a built-in semiconductor memory, a detachable memory called an SD card (registered trademark), and the like.

Further, the storage unit 260 can store the account information 262 for the user to connect to the CS service and the file information 264 for the linked file.

Here, the account information 262 (162) will be described with reference to FIG. The account information is information for connecting to the CS service, for example, information on the connection service destination (for example, "XXX cloud service"), a connection ID (for example, "ABC001"), and a connection password (for example, "Lk9bNg"). ") And is remembered. Here, as the information of the connection service destination, for example, a URL or an IP address may be stored together.

FIG. 5 is a diagram for explaining file information 264 (164). The file information is the file name of the linked file (for example, "S001.JPG"), the file size (for example, "965 kHz"), and the hash function method used for confirming the integrity of the data (for example, "965 kHz"). For example, "SHA256") is stored.

The application management unit 270 is a functional unit that manages an application executed by the display device 10. In this embodiment, a home application 272, a file management application 274, a CS application 276, and a browser application 278 are stored as examples.

The home application 272 generally refers to an application that is first displayed (becomes operable) when the mobile terminal device 20 is activated. For example, an icon or gadget for displaying a clock or email notification may be displayed, or an icon for starting various applications may be displayed. The home application 272 may be pre-installed by the manufacturer of the mobile terminal device 20 or may be pre-installed by a common home application by the mobile carrier. Users can also install and use their own home apps.

The file management application 274 is an application used for selecting and manipulating files. It may be realized in advance by the OS executed in the mobile terminal device 20, or another file management application may be installed and executed. In many cases, the normal file management application can display a file (local file) in the mobile terminal device 20 and a file on the network. However, in the present embodiment, for convenience of explanation with the CS application 276, the file in the mobile terminal device 20 will be managed.

The CS application 276 is an application used for displaying and operating a file on the CS server 30.

The browser application 278 is an application for displaying a hypertext document such as HTML. Usually, it is an application used to use a homepage on the Internet.

The managed application described above may be stored in the storage unit 160. This embodiment is described as an example for explaining the cooperation with the display device 10, the mobile terminal device 20, and the CS server 30, and the functions of each application are not limited to the description of the embodiment. No, and sometimes it can be achieved by using other apps.

The process management unit 280 is a functional unit that manages processes and services being executed in the mobile terminal device 20. The process management unit 280 can manage whether or not the currently executed process (application) is mainly executed (whether it is started in the foreground).

For example, as shown in FIG. 6, management is performed based on a list of running processes. Specifically, it manages the process ID (PID) of the currently executing process, the process name, the CPU occupancy rate, the memory usage amount, the current state (Status), and the like.

Here, as the current state, for example, "Foreground" indicating that it is started in the main (it is in a state where the user can operate it), it is executed but cannot be directly operated, that is, it is being executed in the background. It manages the state such as "Background" indicating that it is, "Sleep" whose execution level is lowered because it is not used, and the like. Such management is performed by the process management unit 280 in the present specification, but may be performed by the control unit 200.

For convenience of explanation, a process (app) running in the "Foreground" state is referred to as a "running app", and a process (app) running in the "Background" state is referred to as a "waiting app".

[3. Processing flow]
Hereinafter, the flow of processing when the present invention is applied will be described. FIG. 7 is a process executed when the mobile terminal device 20 is connected to the display device 10 when an NFC connection is detected or connected. That is, when the NFC communication unit 230 of the mobile terminal device 20 and the NFC communication unit 130 of the display device 10 each detect a connection, a plurality of processes are performed according to the state of the mobile terminal device 20.

First, when the NFC communication unit 230 detects the connection by the mobile terminal device 20 (step S102; Yes), the IP address of the display device 10 is received (step S104). Here, the IP address of the display device 10 is received via the NFC communication unit 230.

If the display device 10 and the mobile terminal device 20 cannot be connected via the same LAN, the IP address of the CS server 30 (the destination that provides the CS service) is notified. In this case, direct communication between the display device 10 and the mobile terminal device 20 cannot be performed via the wireless communication unit, and data is transmitted / received via the CS server.

Subsequently, it is determined whether or not the CS application 276 is being displayed on the mobile terminal device 20 (step S106). Here, "the application is being displayed" means that the application is being executed by the foreground, the running application is displayed in the foreground (or superimposed in a sub-window), and the user can operate the application. To tell. The process management unit 280 can detect the state.

Here, when the CS application 276 is being displayed, it is determined whether or not the CS application 172 is being executed by the display device 10 (step S108). If the CS application 172 is not executed, the CS application activation process (FIG. 11) is executed (step S110). On the other hand, if the CS application 172 is being executed, the cloud information transmission process (FIG. 12) is executed (step S112).

Here, in the display device 10, whether or not the CS application 172 is being executed may be determined by the control unit 100 whether or not the program is running. For example, when connected (or after being connected) by the NFC communication unit 130, the information may be transmitted / received by communication by the NFC communication unit 130 or LAN (wireless communication unit 140; LAN communication unit 150). It may be confirmed by performing activation confirmation or the like from the mobile terminal device 20 to the display device 10.

When the CS application 276 is not being displayed (not being executed) in the mobile terminal device 20, it is determined whether or not the file management application 274 is being displayed (executed) (step S114). Here, when the file management application 274 is being displayed, the file transmission process (FIG. 15) is executed (step S116).

On the other hand, when the file management application 274 is not being displayed and the browser application is being displayed (executed) (step S114; No → step S118; Yes), the browser display request process (FIG. 18) is executed (FIG. 18). Step S122).

Further, when the above-mentioned application is not displayed, for example, when the home application 272 is displayed, the file transmission request process (FIG. 8) is executed (step S118; No → step S120).

Here, in the present embodiment, step S120 is described as displaying the home application 272 (standby state), but for example, when another application (mail application or the like) is being executed, a file transmission request is made. It may be done.

[3.1 First Embodiment]
First, as the first embodiment, the file transmission request process executed when the mobile terminal device 20 is the home application 272 being executed will be described with reference to FIG.

It should be noted that these file linkages are processes executed by the CS application 276 in the mobile terminal device 20. So it's not shown, but it needs to be running in the background.

Further, the following processing is performed after the connection is detected by NFC communication. Therefore, the subsequent processing is performed between the wireless communication unit 240 and the wireless communication unit 140. Of course, when the mobile terminal device 20 is connected via the access point, the display device 10 may use the LAN communication unit 150 for communication.

First, when the connection request is transmitted from the mobile terminal device 20 to the display device 10 (S152), the connection response is transmitted from the display device 10 to the mobile terminal device 20 (S154). Upon receiving the connection response (S156; Yes), the mobile terminal device 20 transmits a file information transmission request (S158) to the display device 10.

Here, when the display device 10 receives the file information transmission request (S160; Yes), the display device 10 generates the file information 164 to be transmitted (S162). Then, the generated file information 164 is transmitted to the mobile terminal device 20 (S164).

Here, the generated file information 164 generates information about the file to be processed by the display device 10. For example, if it is an image file, it is a displayed file, if it is a video file, it is a generated file, if it is a music file, it is a played file, and if it is a PDF (Portable Document Format) file, it is a displayed file. It is a file that is currently being processed.

Further, the file currently being processed is, for example, a file selected as an active window (current window) in the case of a Windows system.

When the mobile terminal device 20 receives the file information, it stores the file information in the storage unit 260 as the file information 264. Then, a file transmission request is transmitted based on the stored file information 264 (S168).

The display device 10 that has received the file transmission request (S170; Yes) transmits a file based on the file transmission request to the mobile terminal device 20 (S172). Here, when the mobile terminal device completes the reception of the file (S174; Yes), the file is displayed (S176).

In each step, in the standby state (S156; No, S160; No, S166; No, S170; No), if the processing is not completed within a predetermined time, a retransmission signal is transmitted or processing is performed as a timeout. I will cancel it. Further, also in S174, if the file cannot be correctly received within the predetermined time (S174; No), the retransmission signal is transmitted or the processing is stopped.

Further, although the mobile terminal device 20 describes that the received file is displayed, for example, if it is a moving image file, a moving image is played, or if it is a music file, a process of playing music is executed. Is also good.

Subsequently, an embodiment of the first embodiment will be described with reference to FIGS. 9 and 10. FIG. 9A is an example of the display screen W110 in the display device 10. An image P110 based on an image file is displayed on the display screen W110 and is an operation target (active).

At this time, FIG. 9B shows the state of the mobile terminal device 20. The home application 272 is displayed on the mobile terminal device 20. At this time, when the mobile terminal device 20 is connected to the display device 10 by NFC communication (connection by NFC communication is detected), the file transmission request processing according to the first embodiment is executed.

FIG. 10 shows after the file transmission request processing is executed. FIG. 10A shows the display screen W112 in the display device 10, and FIG. 10B shows the display screen W212 in the mobile terminal device 20.

As shown in FIG. 10, the image P110 displayed on the display device 10 and the same image P210 are displayed on the display screen W212. In this way, the file displayed on the display device 10 (the image file that was active) is transferred to the mobile terminal device 20 and displayed on the mobile terminal device 20.

[3.2 Second Embodiment]
Subsequently, the CS application activation process of the second embodiment will be described with reference to FIG. The CS application activation process of the second embodiment is an embodiment in the case where the CS application 172 is not activated in the display device 10 even though the CS application 276 is activated in the mobile terminal device 20.

First, a connection request is transmitted from the mobile terminal device 20 to the display device 10 (S202). In response to this connection request, a connection response including the current state of the display device is transmitted to the mobile terminal device 20 (S204).

When the connection response is received (S206; Yes), the mobile terminal device 20 determines the state of the display device 10 based on the connection response. That is, when the CS application is not activated in the display device 10, the mobile terminal device 20 transmits the activation request of the CS application to the display device 10 (S208).

When the display device 10 receives the CS application activation request from the mobile terminal device 20 (S210; Yes), the display device 10 executes a process of activating the CS application (S212).

As described above, according to the present embodiment, even if the CS application is not started on the display device 10, the user can easily start it. In the present embodiment, the state of the display device 10 is confirmed by the connection request / response, but other methods may be used.

For example, it may be confirmed at the NFC communication stage before that, or it may be managed on the CS server side. Further, in FIG. 8, when the file information transmission request (S158 in FIG. 8) is received, the process of starting the CS application may be executed if it is not started.

[3.3 Third Embodiment]
Subsequently, the cloud information transmission process of the third embodiment will be described with reference to FIG. The cloud information transmission process of the third embodiment is an embodiment when the file on the CS server is displayed by the CS application 276 in the mobile terminal device 20.

When the connection request is transmitted from the mobile terminal device 20 to the display device 10 (S302), the display device 10 transmits a connection response (S304). Upon receiving the connection response (S306; Yes), the mobile terminal device 20 transmits CS connection information for connecting to the CS server (CS service) (S308). The CS connection information includes the account information 262 stored in the mobile terminal device 20 and the file link information currently displayed (active) in the mobile terminal device 20. The file link information is information indicating where the file is located on the CS server.

When the display device 10 receives the CS connection information (S310; Yes), the display device 10 extracts the account information 162 from the CS connection information and transmits the account information to the CS server 30 (S312). That is, by transmitting the account information to the CS server 30, a connection request is made to the CS server (CS service).

If the login to the CS service is possible based on this account information (S314; Yes), a login completion notification is transmitted to the display device 10 (S316). Subsequently, the display device 10 transmits a download request based on the file link information included in the CS connection information (S318).

The CS server 30 extracts the file based on the download request (S320), and the file is transmitted to the display device 10 (S322).

When the file reception is completed (S324; Yes), the display device 10 displays the file (S326). Here, when the mobile terminal device 20 and the NFC communication are disconnected (S328; Yes), it is determined whether or not the file has been updated (S330).

If the file is not updated, no particular processing is performed (S330; No), but if the file is updated, the updated file is transmitted to the CS server 30 (S332). It should be noted that the fact that the file has been updated may be transmitted to the mobile terminal device 20 as a file update notification (S334), and the file update process may also be executed in the mobile terminal device 20 (S336).

Examples of the third embodiment will be described with reference to FIGS. 13 and 14. FIG. 13 shows the display screen W130 (FIG. 13 (a)) of the display device 10 and the display screen W230 (FIG. 13 (b)) of the mobile terminal device 20 before the NFC communication connection.

The image P230 is displayed on the display screen W230. Further, in this image P230, a file on the CS server is displayed.

FIG. 14 is a diagram after NFC communication is performed. FIG. 14 shows the display screen W132 (FIG. 14 (a)) of the display device 10 and the display screen W232 (FIG. 14 (b)) of the mobile terminal device 20 after the NFC communication connection.

The same image as the image P230 displayed on the mobile terminal device 20 is displayed as the image P130 on the display screen W132.

As described above, according to the present embodiment, the file linkage between the display device 10 and the mobile terminal device 20 can be realized via the CS service.

[3.4 Fourth Embodiment]
Subsequently, the file transmission process of the fourth embodiment will be described with reference to FIG. The file transmission process of the fourth embodiment is an embodiment in the case where the file of the mobile terminal device 20 is displayed by the file management application 274 in the mobile terminal device 20.

First, the mobile terminal device 20 transmits a connection request to the display device 10 (S402). The display device 10 transmits the connection response to the mobile terminal device 20 (S404). Then, when the mobile terminal device 20 receives the connection response (S406; Yes), it generates the file information 264 to be transmitted (S408).

Subsequently, the file information 264 is transmitted to the display device 10 (S410). The display device 10 that has received the file information (S412; Yes) transmits a file transmission request to the mobile terminal device 20 (S414) if there is no problem.

When the mobile terminal device 20 receives the file transmission request (S416; Yes), the mobile terminal device 20 transmits a file corresponding to the file transmission request (usually a file specified by the file information 264) to the display device 10 (S418).

When the display device 10 completes the reception of the file from the mobile terminal device 20 (S420; Yes), the display device 10 displays the file (S422).

As described above, according to the fourth embodiment, the file active in the mobile terminal device 20 can be easily transmitted to the display device 10. Although described as displaying a file in S422, for example, the file may be output from the display device 10 to a connected printing device for printing, or if it is a music file, the file may be played back. All you have to do is execute the processing.

Examples of the fourth embodiment will be described with reference to FIGS. 16 and 17. FIG. 16 shows the display screen W140 (FIG. 16 (a)) of the display device 10 and the display screen W240 (FIG. 16 (b)) of the mobile terminal device 20 before the NFC communication connection.

On the display screen W240, the file in the mobile terminal device 20 is selected in the area R240, and the image P240 is displayed.

FIG. 17 is a diagram after NFC communication is performed. FIG. 17 shows the display screen W142 (FIG. 17 (a)) of the display device 10 and the display screen W242 (FIG. 17 (b)) of the mobile terminal device 20 after the NFC communication connection.

The image P240 displayed on the mobile terminal device 20 is transferred to the display device 10, and the image P140 is displayed. Further, as shown in FIG. 17 (b), the message M242 "sent" may be notified after the transfer so that the user can visually recognize that the file has been transmitted.

[3.5 Fifth Embodiment]
Subsequently, the browser display request processing of the fifth embodiment will be described with reference to FIG. The browser display request processing of the fifth embodiment is an embodiment in the case where the HTML (home page) on the Internet is displayed by the browser application 278 in the mobile terminal device 20.

First, the mobile terminal device 20 transmits a connection request to the display device 10 (S502). The display device 10 transmits the connection response to the mobile terminal device 20 (S504). Then, when the mobile terminal device 20 receives the connection response (S506; Yes), the browser application 278 is currently activated and displayed (operating in the foreground), so that the browser display request is displayed by the display device 10. (S508).

When the display device 10 receives the browser display request (S510; Yes), the display device 10 starts the browser application according to the browser display request (S512). At this time, the home page is displayed based on the URL information included in the browser display request.

As described above, according to the fifth embodiment, when the user using the mobile terminal device 20 wants to check the homepage on a large display screen, he / she simply detects the connection with the display device 10 by NFC communication. The home page can be displayed in cooperation with the display device 10.

Examples of the fifth embodiment will be described with reference to FIGS. 19 and 20. FIG. 19 shows the display screen W150 (FIG. 19 (a)) of the display device 10 and the display screen W250 (FIG. 19 (b)) of the mobile terminal device 20 before the NFC communication connection.

In the mobile terminal device 20, the home page is displayed by the browser application 278.

FIG. 20 is a diagram after NFC communication is performed. FIG. 20 shows the display screen W152 (FIG. 20 (a)) of the display device 10 and the display screen W252 (FIG. 20 (b)) of the mobile terminal device 20 after the NFC communication connection.

The home page displayed on the mobile terminal device 20 is displayed on the display device 10 based on the URL.

[3.6 Sixth Embodiment]
Subsequently, the sixth embodiment will be described with reference to FIG. A sixth embodiment describes an embodiment in which, for example, when the mobile terminal device 20 receives a file from the display device 10, the file is not received if the file information cannot be appropriately processed.

First, the mobile terminal device 20 transmits a connection request to the display device 10 (S602). The display device 10 transmits the connection response to the mobile terminal device 20 (S604). Then, when the mobile terminal device 20 receives the connection response (S606; Yes), it transmits a file information transmission request which is information of the file to be received (S608).

Here, the display device 10 that has received the file information transmission request (S610; Yes) generates the file information 164 regarding the file to be transmitted (S612) and transmits it to the mobile terminal device 20 (S614).

The mobile terminal device 20 that has received the file information (S616; Yes) stores the file information as the file information 264. Then, it is determined whether or not the file can be appropriately processed based on the file information 264 (S618). When it is determined that the processing cannot be performed properly, that is, the display or the execution cannot be performed, the processing is executed with the file reception disabled (S620). As the file non-receivable processing, for example, the display device 10 is transmitted to the display device 10 that the processing cannot be appropriately performed. As a result, the display device 10 stops the file transmission or executes a process of converting the file into an appropriate file and transmitting the file.

The determination of whether or not the file cannot be processed appropriately is determined by, for example, the file size, and it is determined whether or not the file size is equal to or less than the specified size. That is, if the file size is larger than necessary, the memory capacity may be insufficient or the processing may be slowed down. Further, since the resolution of the display unit 210 of the mobile terminal device 20 is limited, there is a problem that even if an unnecessarily large size is received, the resolution exceeds the displayable resolution or the file transfer takes time. This is because For example, if the file size is less than 1 megabyte, it is determined to be less than or equal to the specified size.

In addition, for example, it is determined from the extension whether or not the file can be opened by the mobile terminal device 20. For example, if the PDF file can be displayed on the display device 10 but cannot be displayed on the mobile terminal device 20, the file is not received. In addition, even if the video file is in a non-reproducible video format, it is not received.

If the file can be processed appropriately, the file transmission request is transmitted to the display device 10 (S622). When the display device 10 receives the file transmission request (S624; Yes), the display device 10 transmits the file corresponding to the file transmission request to the mobile terminal device 20 (S626).

When the mobile terminal device 20 completes the reception of the file (S628), the mobile terminal device 20 appropriately executes the process based on the received file (S630). For example, if it is an image file, the file is displayed.

An embodiment of the sixth embodiment will be described with reference to FIG. FIG. 22 shows the display screen W160 (FIG. 22 (a)) of the display device 10 and the display screen W260 (FIG. 20 (b)) of the mobile terminal device 20 after the NFC communication connection.

The image P160 is displayed on the display screen W160. Since this image P160 has a large image size, it cannot be properly displayed on the mobile terminal device 20. Therefore, as shown on the display screen W260, the message M260 is displayed to notify the user that the image is too large.
As described above, according to the present embodiment, when the file displayed / executed on the display device 10 is transmitted to the mobile terminal device 20, only the file that can be appropriately processed is transmitted.

[3.7 Seventh Embodiment]
Subsequently, the seventh embodiment will be described. A seventh embodiment describes, in the sixth embodiment, a process of reducing the file size and transmitting the file on the display device 10 side when the received file size is too large.

FIG. 23 is a diagram for explaining the processing of the seventh embodiment. The seventh embodiment is a diagram illustrating a process in the case of determining by the size of the file size in S618 among the processes of FIG. 21 of the sixth embodiment. The processing of FIG. 21 and the processing of the common portion are designated by the same reference numerals, and detailed description thereof will be omitted, and the processing of the portion related to the processing of the present embodiment (the portion surrounded by the dotted line in FIG. 23) will be mainly processed. Explain to.

That is, when the mobile terminal device 20 receives the file information (S616; Yes), it is determined whether or not the file size is equal to or less than the specified size (S700). If the file size is equal to or less than the specified size, there is no particular problem, so the same process as in the sixth embodiment (that is, the process of receiving the file) is executed (S700; Yes).

On the other hand, when the file size is larger than the specified size (S700; No), it is reduced and it is confirmed whether or not the file is further received (S702). Here, if the file is reduced and the file is not received, the process is terminated (S702; No), and if the file is reduced and the file is received (S702; Yes), the file reduction request is transmitted (S704).

Upon receiving the file reduction request, the display device 10 (S706; Yes) reduces the file to a specified size or less (S708). Then, the reduced file is transmitted (S626).

That is, in S702, confirmation of use is confirmed as shown in FIG. For example, FIG. 24 is a display screen W270 in the mobile terminal device 20. The message M270 is displayed on the display screen W270, and the user is allowed to select the message M270 to determine whether or not to reduce the file.

Further, even if such a confirmation message is not displayed, it may be automatically reduced by setting in advance.

In the above-described embodiment, the file size is described as an example, but for example, it can be changed to a displayable video codec or converted to a displayable file format (for example, if it is a non-compliant document file, it is converted to a PDF file). It is also good to do).

Further, in the above-described embodiment, the conversion process is performed by the display device 10, but when the CS server 30 is used, the same process may be performed on the CS server 30.

As described above, according to the present embodiment, it is possible to appropriately display (process) a file without imposing a processing load on the mobile terminal device 20.

[3.8 Eighth Embodiment]
Subsequently, the eighth embodiment will be described. An eighth embodiment describes, in the sixth embodiment, a process of storing a file in the CS server 30 when the received file cannot be processed appropriately.

FIG. 25 is a diagram for explaining the processing of the eighth embodiment. The eighth embodiment is a diagram for explaining a process in the case where the file cannot be appropriately processed in S618 among the processes of FIG. 21 of the sixth embodiment. The processing of FIG. 21 and the processing of the common portion are designated by the same reference numerals, and detailed description thereof will be omitted, and the processing of the portion related to the processing of the present embodiment (the portion surrounded by the dotted line in FIG. 25) will be mainly processed. Explain to.

That is, when the mobile terminal device 20 cannot properly process the file (S618; No), it is confirmed whether or not the file is saved in the CS server 30 (S802). Here, if the file is not saved in the CS server 30, the process ends (S802; No), and if the file is saved in the CS server 30, a file transfer request is transmitted to the display device 10 (S802; Yes → Yes →. S804).

When the display device 10 receives the file transfer request (S806; Yes), the display device 10 saves the file in the CS server 30 (S808). After that, the fact that the file is saved in the CS server 30 is transmitted to the mobile terminal device 20 as a save completion notification (S810).

When the mobile terminal device 20 receives the save completion notification (S812; Yes), the mobile terminal device 20 notifies the user that the save has been completed (S814). The processing of S810 to S814 may not be performed by setting, for example.

FIG. 26 is a diagram showing an example of a notification screen when a file is saved in the CS server 30. The message M280 is displayed on the display screen W280 of the mobile terminal device 20. As a result, the user knows that the file was not transferred to the mobile terminal device 20 but was transferred (saved) to the CS server 30.

According to the present embodiment, in the case of a file that cannot be properly processed by the mobile terminal device 20, it is possible to perform processing such as saving it in the CS server 30. This makes it possible, for example, to receive at different terminals that can be appropriately processed. Specifically, it is effective when it can be displayed on a tablet terminal even when it cannot be displayed on a small terminal device such as a mobile phone (smartphone), or when it can be displayed on Windows even if it cannot be displayed on Android. It will be a means.

[3.9 9th Embodiment]
Subsequently, the ninth embodiment will be described with reference to FIG. 27. A ninth embodiment describes, for example, an embodiment in which when the display device 10 receives a file from the mobile terminal device 20, the file size is too small to properly receive the file.

First, the mobile terminal device 20 transmits a connection request to the display device 10 (S902). The display device 10 transmits the connection response to the mobile terminal device 20 (S904). Then, when the mobile terminal device 20 receives the connection response (S906; Yes), it generates file information which is information of the file to be transmitted (S908), and transmits the generated file information (S909).

When the display device 10 receives the file information (S910; Yes), the display device 10 determines whether or not the file size is equal to or larger than the specified size (S912). Here, if the file size is less than the specified size, it is determined that the display unit 110 of the display device 10 cannot properly display the file. That is, the image may be displayed too small due to the resolution, or the image quality may be deteriorated due to enlargement (deterioration due to the occurrence of jaggies or the like).

Therefore, if the size is less than the specified size, a process of rejecting file reception is executed (S912; No → S914). For example, the transmission of the file is stopped by transmitting a file transmission stop request or the like to the mobile terminal device 20.

On the other hand, when the file size is equal to or larger than a specified size (for example, the file size is 500 kbytes or more or the number of vertical dots is a predetermined number or more) (S912; Yes), the file transmission request is transmitted to the mobile terminal device 20 (S916).

When the mobile terminal device 20 receives the file transmission request (S918; Yes), the mobile terminal device 20 transmits the file (S920). When the file reception is completed (S922; Yes), the display device 10 displays the file (S924).

An embodiment of the ninth embodiment will be described with reference to FIG. 28. 28 (a) is an example of the display screen W190 of the display device 10, and FIG. 29 (b) is an example of the display screen W290 of the mobile terminal device 20. In the mobile terminal device 20, the file is selected by the area R290 and the image P290 is displayed. When NFC communication is connected at this stage, the file is transferred to the display device 10.

Here, since the image size of the image P290 selected in the area R290 is small, it cannot be properly displayed on the display device 10. Therefore, the message M190 is displayed on the display screen W190, and the image is not transferred.

Even in this case, it may be confirmed and displayed by the user as shown in the display screen W192 of FIG. That is, the message M192 is displayed and the user is urged to confirm. Then, when the user selects "display", the image is displayed.

Even if it is not displayed properly, it can be displayed if the user wants it to be displayed. In addition, even if the user knows that the size of the image file is the cause and displays the image, even if it is not displayed properly, the system malfunction etc. can be caused by understanding and displaying it. You don't have to think about it.

[3.10 10th Embodiment]
Subsequently, the tenth embodiment will be described. A tenth embodiment is an embodiment in which a wireless LAN access point is built in the display device 10.

Here, the functional configuration of the display device 12 of the tenth embodiment is shown in FIG. The display device 12 is configured to include the AP base station unit 180 in the display device 10 described above.

The AP base station unit 180 is a functional unit for providing a wireless LAN access point. When connecting wireless communication by the wireless communication unit 240, the mobile terminal device 20 can be connected to the wireless communication unit 140 via the AP base station unit 180.

As a result, for example, even if the wireless LAN cannot be connected to an external terminal as security due to an in-house LAN or the like, it can be locally connected via the AP base station unit 180.

[3.11 11th Embodiment]
Subsequently, the eleventh embodiment will be described. The eleventh embodiment is an embodiment in which the mobile terminal device 20 exchanges connection information when connecting to a wireless LAN via the wireless communication unit 240 by NFC communication. The connection destination may be an external access point or an access point built in the display device 12 described in the tenth embodiment.

The connection will be described with reference to FIG. 31. First, NFC communication is connected between the mobile terminal device 20 and the display device 10 (S1002). This is realized by connecting the NFC communication unit 130 and the NFC communication unit 230.

Subsequently, AP information is transmitted from the display device 10 to the mobile terminal device 20 via NFC communication (S1004). Specifically, as AP information, information necessary for connecting to the access point, such as SSID, connection ID, password, authentication method, communication method, etc., is transmitted.

After the AP information is transmitted, the NFC communication is disconnected (S1006). After that, the mobile terminal device 20 transmits a connection request from the wireless communication unit 240 to the access point (AP) based on the AP information (S1008).

If the connection request is received (S1010; Yes) and the authentication is OK (S1012; Yes), the AP sends a connection permission response (S1016). As a result, the mobile terminal device 20 and the AP are connected and wireless communication is connected. As a result, wireless communication is connected to the mobile terminal device 20, the AP, and the display device 10, so that each can communicate (S1018).

On the other hand, if the authentication fails (S1012; No), a connection refusal response is transmitted (S1014). In this case, the wireless communication connection will not be established.

As described above, according to the present embodiment, it is possible to appropriately disconnect the wireless communication connection by using the NFC communication as a trigger. In the present embodiment, the display device 10 is connected by the wireless communication unit 140, but since it may be connected by LAN, the AP-display device 10 is connected to the wired LAN via the LAN communication unit 150. May be connected.

[3.12 12th Embodiment]
Subsequently, the twelfth embodiment will be described with reference to FIG. 32. The twelfth embodiment clarifies the procedure for transmitting a file from the display device 10 to the mobile terminal device 20 via the CS server 30. That is, in the process of FIG. 8, the operation when the CS service is used is clarified, and the reverse of the operation in FIG. 12, that is, in FIG. 12, the image displayed on the mobile terminal device 20 is displayed on the display device 10. However, this embodiment is an embodiment in which the image displayed on the display device 10 is displayed on the mobile terminal device 20.

First, the connection request is transmitted from the mobile terminal device 20 to the display device 10 (S1102), and the connection response is transmitted from the display device 10 to the mobile terminal device 20 (S1104). Upon receiving the connection response (S1106; Yes), the mobile terminal device 20 transmits a file transmission request to the display device (S1108).

The display device 10 that has received the file transmission request (S1110; Yes) performs a login process for the CS server 30 based on the account information 162. Specifically, the account information is transmitted to the CS server 30 (S1112), and if the login by the account information is OK (S1114; Yes), the login completion notification is transmitted (S1116).

Upon receiving the login completion notification, the display device 10 transmits a file (S1118). When the file is transmitted (uploaded), the file link information is transmitted to the display device as the information in which the file is saved (S1120). The file link information is also transmitted to the mobile terminal device 20 (S1122).

Since the file link information may be acquired by the mobile terminal device 20, it does not have to be transmitted to the display device 10, for example. Further, it may be transmitted from the display device 10 to the mobile terminal device 20 instead of from the CS server 30.

The mobile terminal device 20 that has received the file link information transmits a download request based on the file link information (S1124). The CS server 30 extracts the file based on the download request (S1126) and transmits the file to the mobile terminal device 20 (S1128).

When the mobile terminal device 20 completes receiving the file (S1130; Yes), the mobile terminal device 20 displays the file (S1132).

As described above, according to the present embodiment, the file linkage between the mobile terminal device 20 and the display device 10 can be performed via the CS server 30. Thereby, for example, the mobile terminal device 20 can link the file with the display device 10 even when a different line such as a mobile communication line is used instead of the wireless LAN.

As described in the present specification, by implementing each of the above-described embodiments, file linkage between the display device 10 and the mobile terminal device 20 can be facilitated.

For example, in a mobile terminal and an information processing device having a proximity communication means such as NFC, by bringing each other close to each other, the user ID information of the mobile terminal, the URL information of the cloud service used by the user, and the file to be transmitted are transmitted by the proximity communication. Information such as a name is transmitted to the information processing apparatus side. The information processing device connects to the cloud service based on the received information, acquires desired data from the cloud service, registers the updated data in the cloud service again, and then detects disconnection of proximity communication. Have the mobile terminal acquire the updated data. This also makes it possible to transfer data between the mobile terminal and the information processing device.

Further, in the file linkage between the mobile terminal device and the display control device, the file linkage can be performed via the connected server device. As a result, file linkage can be performed even when the mobile terminal device and the display control device cannot be directly connected.

[4. Modification example]
Although the embodiment of the present invention has been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and the design and the like within a range not deviating from the gist of the present invention are also within the scope of claims. include.

In each of the above-described embodiments, an example of using NFC as an example of short-range wireless communication has been described. Surprisingly, for example, Bluetooth (registered trademark), ZigBee, and, if only detection, a mechanism using a general RFID (Radio Frequency IDentification) can be realized.

Further, the program that operates in each device in the embodiment is a program that controls a CPU or the like (a program that causes a computer to function) so as to realize the functions of the above-described embodiment. Then, the information handled by these devices is temporarily stored in a temporary storage device (for example, RAM) at the time of processing, and then stored in various ROM or HDD storage devices, and is read and corrected by the CPU as necessary. -Writing is performed.

Here, as the recording medium for storing the program, a semiconductor medium (for example, ROM, a non-volatile memory card, etc.), an optical recording medium / magneto-optical recording medium (for example, a CD (Digital Versatile Disc), MO (Magneto Optical), etc.) It may be any of Disc), MD (Mini Disc), CD (Compact Disc), BD, etc.), magnetic recording medium (for example, magnetic tape, flexible disk, etc.) and the like. In addition, by executing the loaded program, not only the functions of the above-described embodiment are realized, but also by processing in collaboration with the operating system or other application programs based on the instructions of the program, the present invention In some cases, the function of the invention is realized.

Further, in the case of distribution to the market, the program can be stored and distributed in a portable recording medium, or transferred to a server computer connected via a network such as the Internet. In this case, it goes without saying that the storage device of the server computer is also included in the present invention.

Further, a part or all of each device in the above-described embodiment may be realized as an LSI (Large Scale Integration) which is typically an integrated circuit. Each functional block of each device may be individually chipped, or a part or all of them may be integrated into a chip. Further, the method of making an integrated circuit is not limited to the LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to advances in semiconductor technology, it is of course possible to use an integrated circuit based on this technology.

1 File linkage system 10 Display device 100 Control unit 110 Display unit 120 Operation unit 130 NFC communication unit 140 Wireless communication unit 150 LAN communication unit 160 Storage unit 162 Account information 164 File information 170 Application management unit 172 CS application 174 Management application 20 Mobile terminal Device 200 Control unit 210 Display unit 220 Operation unit 230 NFC communication unit 240 Wireless communication unit 250 Call processing unit 260 Storage unit 262 Account information 264 File information 270 Application management unit 272 Home application 274 File management application 276 CS application 278 Browser application 280 Process Management Department

Claims (7)

A display device that can be connected to a mobile terminal device by a first wireless communication means and a second wireless communication means different from the first wireless communication means.
When the connection with the mobile terminal device is detected by the first wireless communication means, the account information to the server device in which the file displayed in the mobile terminal device is stored and the file link to the file. Information is acquired from the mobile terminal device via the second wireless communication means.
By the account information to the server device, connected to the server apparatus,
A file based on the file link information is received from the server device and displayed .
When the communication by the first wireless communication means is disconnected, it is determined whether or not the displayed file has been updated, and when the file has been updated, the updated file is transmitted to the server device. A display device characterized by that. The display device according to claim 1, wherein the file link information includes link information of a file currently displayed on the mobile terminal device. The display device according to claim 1, wherein when the file is updated, the fact that the file is updated is transmitted to the mobile terminal device as a file update notification. The first wireless communication means includes a short-range wireless communication means that realizes short-range wireless communication.
The display device according to any one of claims 1 to 3, wherein the display device communicates with the short-distance wireless communication means of the mobile terminal device. A collaborative system that includes a display device, a mobile terminal device, and a server device.
The display device is
When the connection with the mobile terminal device is detected by the first wireless communication means, the account information to the server device in which the file displayed in the mobile terminal device is stored and the file link to the file. Information is obtained from the mobile terminal device via the second wireless communication means, and the information is obtained from the mobile terminal device.
By connecting to the server device by the account information to the server device,
A file based on the file link information is received from the server device and displayed.
When the communication by the first wireless communication means is disconnected, it is determined whether or not the displayed file is updated, and when the file is updated, the updated file is transmitted to the server device. A file linkage system featuring that. It is a control method in a display device that can be connected to a mobile terminal device by a first wireless communication means and a second wireless communication means different from the first wireless communication means.
When the connection with the mobile terminal device is detected by the first wireless communication means, the account information to the server device in which the file displayed in the mobile terminal device is stored and the file link to the file. A step of acquiring information from the mobile terminal device via the second wireless communication means, and
A step of connecting to the server device by the account information to the server device, and
A step of receiving and displaying a file based on the file link information from the server device, and
When the communication by the first wireless communication means is disconnected, it is determined whether or not the displayed file is updated, and when the file is updated, the updated file is transmitted to the server device. Steps and
A control method in a display device comprising. A program for causing a computer to execute each step of the control method in the display device of claim 6.

Images