JP2018159984A - Screen data relay server, screen data relay program and screen data relay method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a screen data relay server, a screen data relay program and a screen data relay method capable of providing a remote desktop environment that is easy to watch and operate even when a mobile communication device such as a table or a smart phone is used as a remote terminal.SOLUTION: A screen data relay server 100 includes: a screen configuration recognizing unit 110 that recognizes an active window on a desk top screen of a connection destination terminal 20; a screen size acquisition unit 125 that acquires a screen size of a remote terminal 30; a window control unit 130 that instructs the connection destination terminal 20 to change a size of the active window on the basis of the screen size acquired by the screen size acquisition unit 125; and a partial screen trimming unit 120 and a partial screen relay unit 140 that acquire screen data of the active window after change of the size from the connection destination terminal 20 and relay the acquired screen data to the remote terminal 30.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a screen data relay server, a screen data relay program, and a screen data relay method that relay screen data constituting a desktop screen of a connection destination terminal to a remote terminal and display the desktop screen on the remote terminal.

  Conventionally, a personal computer (PC) or a mobile communication device (hereinafter referred to as a remote terminal) displays a desktop screen of a connection destination PC or the like (hereinafter referred to as a connection destination terminal), and the remote terminal can remotely display the desktop screen of the connection destination terminal. Remote desktop method to operate is widely used.

  A remote desktop method is also known in which a relay server (hereinafter referred to as a screen data relay server) is interposed between a connection destination terminal and a remote terminal, and a remote desktop environment is provided via the screen data relay server. According to such a remote desktop method, it is possible to provide a remote desktop environment while realizing security and user management.

  In recent years, a method of displaying only an active window on a desktop screen of a connection destination terminal on a remote terminal has also been realized (for example, Non-Patent Document 1).

“Remote desktop operation software“ Undine ”for transferring only active windows is released”, [online], [Search February 16, 2017], Internet <URL: http://forest.watch.impress.co.jp /docs/news/722595.html>

  By the way, in recent years, portable communication devices such as tablets and smartphones are widely spread, and cases of using portable communication devices as remote desktop remote terminals are increasing.

  However, since the screen size of the mobile communication device is smaller than that of the PC, if the desktop screen of the connected terminal is transferred as it is, it is displayed in a reduced state on the screen of the mobile communication device, so it is very difficult to see and operate. It becomes difficult.

  Further, as described in Non-Patent Document 1, even if only the active window is displayed on the remote terminal, if the size of the active window is large, it is still displayed in a reduced state on the screen of the mobile communication device. Therefore, there is a similar problem.

  Therefore, the present invention has been made in view of such a situation, and even when a portable communication device such as a tablet or a smartphone is used as a remote terminal, a screen data relay server that can provide a remote desktop environment that is easy to see and operate. An object of the present invention is to provide a screen data relay program and a screen data relay method.

  One aspect of the present invention is a screen data relay server that relays screen data constituting a desktop screen of a connection destination terminal to a remote terminal and displays the desktop screen on the remote terminal, the desktop screen of the connection destination terminal An active window recognizing unit that recognizes the active window above, a screen size obtaining unit that obtains a screen size of the remote terminal, and a change in the size of the active window based on the screen size obtained by the screen size obtaining unit. A window control unit that instructs the connection destination terminal; and a screen data relay unit that acquires screen data of the active window after the size change from the connection destination terminal and relays the acquired screen data to the remote terminal. .

  One aspect of the present invention is a screen data relay program that relays screen data constituting a desktop screen of a connection destination terminal to a remote terminal, and displays the desktop screen on the remote terminal. An active window recognition process for recognizing an active window on the desktop screen, a screen size acquisition process for acquiring a screen size of the remote terminal, and a size change of the active window based on the acquired screen size. A window control process instructing the terminal and a screen data relay process for acquiring the screen data of the active window after the size change from the connection destination terminal and relaying the obtained screen data to the remote terminal are executed.

One aspect of the present invention is a screen data relay method for relaying screen data constituting a desktop screen of a connection destination terminal to a remote terminal and displaying the desktop screen on the remote terminal, wherein the screen size of the remote terminal is set. Based on the step of instructing the connection destination terminal to change the size of the active window on the desktop screen of the connection destination terminal, acquiring the screen data of the active window after the size change from the connection destination terminal, and acquiring the acquired Relaying screen data to the remote terminal.

  The screen data relay server, the screen data relay program, and the screen data relay method according to the present invention can provide a remote desktop environment that is easy to see and operate even when a mobile communication device such as a tablet or a smartphone is used as a remote terminal. .

FIG. 1 is an overall schematic configuration diagram of a remote connection system 10. FIG. 2 is a functional block configuration diagram of the screen data relay server 100. FIG. 3 is a functional block configuration diagram of the connection destination terminal 20. FIG. 4 is a functional block configuration diagram of the remote terminal 30. FIG. 5 is a diagram showing a control sequence for displaying the active window of the connection destination terminal 20 on the remote terminal 30. 6A and 6B are diagrams showing examples of desktop screens of the connection destination terminal 20. FIG. FIGS. 7A and 7B are diagrams showing screen examples of the remote terminal 30. FIG.

  Hereinafter, embodiments will be described with reference to the drawings. The same functions and configurations are denoted by the same or similar reference numerals, and description thereof is omitted as appropriate.

(1) Overall Schematic Configuration of Remote Connection System FIG. 1 is an overall schematic configuration diagram of a remote connection system 10 according to the present embodiment. As shown in FIG. 1, the remote connection system 10 includes a connection destination terminal 20, a remote terminal 30, and a screen data relay server 100. The connection destination terminal 20 and the screen data relay server 100 are connected via the communication network 40A. The remote terminal 30 and the screen data relay server 100 are connected via the communication network 40B.

  The communication network 40A and the communication network 40B may be a dedicated network such as a VPN or a public network such as the Internet. The communication between the connection destination terminal 20 and the screen data relay server 100 and the communication between the remote terminal 30 and the screen data relay server 100 can be encrypted.

  The connection destination terminal 20 is a terminal that is remotely controlled by the remote terminal 30 via the screen data relay server 100. The connection destination terminal 20 is typically a personal computer (PC) in which an operating system such as Windows (registered trademark) is installed.

  The remote terminal 30 displays the desktop screen of the connection destination terminal 20 via the screen data relay server 100, or executes a remote operation on the desktop screen displayed on the remote terminal 30. That is, the remote terminal 30 provides a remote desktop environment via the screen data relay server 100. In the present embodiment, it is assumed that the remote terminal 30 uses a mobile communication device such as a tablet or a smartphone.

  The screen data relay server 100 relays the screen data constituting the desktop screen of the connection destination terminal 20 to the remote terminal 30, and displays the desktop screen on the remote terminal 30. Further, the screen data relay server 100 acquires operation data (input data using a pointer or a keyboard) for the desktop screen acquired from the remote terminal 30 and transmits it to the connection destination terminal 20.

(2) Functional Block Configuration of Remote Connection System Next, a functional block configuration of the remote connection system 10 will be described. Specifically, functional block configurations of the connection destination terminal 20, the remote terminal 30, and the screen data relay server 100 will be described.

(2.1) Screen data relay server 100
FIG. 2 is a functional block configuration diagram of the screen data relay server 100. As shown in FIG. 2, the screen data relay server 100 includes a screen configuration recognition unit 110, a partial screen cutout unit 120, a screen size acquisition unit 125, a window control unit 130, a window switching instruction acquisition unit 135, and a partial screen relay unit 140. The operation data acquisition unit 150 and the coordinate conversion instruction unit 160 are provided.

  Note that the screen data relay server 100 has hardware such as a CPU and a memory, and each functional unit described above is realized by executing a computer program (software) on the hardware.

  The screen configuration recognition unit 110 recognizes the configuration of the desktop screen of the connection destination terminal 20. Specifically, the screen configuration recognition unit 110 recognizes an active window on the desktop screen of the connection destination terminal 20. In the present embodiment, the screen configuration recognition unit 110 constitutes an active window recognition unit described in the claims.

  More specifically, the screen configuration recognition unit 110 identifies the window displayed in the foreground where input and other operations are possible from the screen data of the desktop screen transmitted from the connection destination terminal 20. Recognizes the active window on the desktop screen.

  The partial screen cutout unit 120 cuts out the active window recognized by the screen configuration recognition unit 110 from the desktop screen. That is, the partial screen cutout unit 120 cuts out only the active window among the plurality of windows constituting the desktop screen.

  Further, the partial screen cutout unit 120 outputs the screen data of the active window whose size has been changed by an instruction from the window control unit 130 to the partial screen relay unit 140. That is, the partial screen cutout unit 120 acquires the screen data of the active window after the size change from the connection destination terminal 20 via the screen configuration recognition unit 110, and outputs the acquired screen data to the partial screen relay unit 140. .

  The screen size acquisition unit 125 acquires the screen size of the remote terminal 30. Specifically, the screen size acquisition unit 125 transmits an inquiry command for inquiring about the screen size of the remote terminal 30 to the remote terminal 30. Further, the screen size acquisition unit 125 acquires the screen size by a screen size response from the remote terminal 30 to the inquiry command. For example, when the screen size of the remote terminal 30 is 8 inches, the screen size acquisition unit 125 may acquire a screen size response indicating that the screen size is 8 inches, or a specific size (for example, vertical: 17.2cm, width: 10.8cm) may be obtained directly.

  Further, the screen size acquisition unit 125 may store the screen size of the remote terminal 30. That is, the screen size acquisition unit 125 determines the model of the remote terminal 30 and acquires the screen size when a session with the remote terminal 30 is established without transmitting an inquiry command to the remote terminal 30. May be.

  The window control unit 130 performs control on the window on the desktop screen of the connection destination terminal 20. Specifically, the window control unit 130 instructs the connection destination terminal 20 to change the size of the active window based on the screen size of the remote terminal 30 acquired by the screen size acquisition unit 125.

  For example, when the screen size of the remote terminal 30 is 8 inches (vertical: 17.2 cm, horizontal: about 10.8 cm), and the active window size is vertical: 25 cm, horizontal: 40 cm, the window control unit 130 An instruction to reduce the size of the active window is transmitted to the connection destination terminal 20 so as to match the size of 8 inches.

  The window control unit 130 may change the size of the active window according to the number of pixels of the remote terminal 30. For example, when the number of pixels of the remote terminal 30 is 800 pixels vertically and 600 pixels horizontally, the size of the active window can be enlarged or reduced according to the number of pixels. Further, the window control unit 130 can change the size of the active window to a portrait or landscape orientation according to the screen orientation (vertical orientation, landscape orientation) of the remote terminal 30.

  The window control unit 130 can store the size of the active window before the size change. When the session with the remote terminal 30 is disconnected, the window control unit 130 instructs the connection destination terminal 20 to return the active window to the size before the size change. Thereby, when the operation is resumed at the connection destination terminal 20, the size of the active window can be set according to the screen size of the connection destination terminal 20.

  Note that if the size of the active window is not necessary due to the relationship between the screen size of the remote terminal 30 and the active window size of the connection destination terminal 20, the window control unit 130 omits the size changing process.

  Further, the window control unit 130 can instruct the connection destination terminal 20 to switch the active window based on the switching instruction of the active window acquired by the window switching instruction acquisition unit 135. Thereby, an active window (that is, an application) to be operated can be freely selected from the remote terminal 30.

  The window switching instruction acquisition unit 135 acquires an active window switching instruction from the remote terminal 30. Specifically, the window switching instruction acquisition unit 135 displays a launcher 300 (not shown in FIG. 2, see FIG. 6A) that displays an icon for selecting an application frequently used by the user of the remote terminal 30. An active window switching instruction is acquired from the remote terminal 30 by displaying it on a part of the screen of the remote terminal 30.

  Alternatively, when the window switching instruction acquisition unit 135 acquires the active window switching instruction, not only the active window but also the entire desktop screen of the connection destination terminal 20 is relayed to the partial screen relay unit 140 so that the remote terminal An active window switching instruction may be acquired from 30. That is, the window switching instruction acquisition unit 135 acquires a switching instruction indicating that a window other than the active window has been selected.

  The partial screen relay unit 140 relays the screen data of the active window output from the partial screen cutout unit 120 to the remote terminal 30. In the present embodiment, the screen data relay unit described in the claims is configured by the partial screen cutout unit 120 and the partial screen relay unit 140. Specifically, the partial screen relay unit 140 transmits a packet addressed to the remote terminal 30 including the screen data to the communication network 40B.

  The operation data acquisition unit 150 acquires operation data indicating an operation on a predetermined coordinate on the active window of the connection destination terminal 20 displayed on the screen of the remote terminal 30 from the remote terminal 30. Specifically, the operation data acquisition unit 150 acquires the operation data via the input function (pointer, keyboard, mouse, etc.) of the remote terminal 30.

  The operation data typically includes a click on a predetermined coordinate (pressing the left button), dragging, and menu display (pressing the right button).

  The coordinate conversion instructing unit 160 converts the coordinates on the active window of the desktop screen of the connection destination terminal 20 based on the operation data acquired by the operation data acquiring unit 150. Further, the coordinate conversion instruction unit 160 transmits the converted operation data to the connection destination terminal 20.

  For example, when the coordinates on the active window displayed on the remote terminal 30 are (x1, y1), the coordinate conversion instruction unit 160 displays the coordinates (x2, y2) of the active window on the desktop screen of the connection destination terminal 20. x2).

  That is, the coordinate conversion instruction unit 160 calculates the coordinates (x2, x2) corresponding to the coordinates on the desktop screen based on the coordinates (x1, y1), and sends the operation data for the coordinates (x2, x2) to the connection destination terminal. Sent to 20.

(2.2) Connected terminal 20
FIG. 3 is a functional block configuration diagram of the connection destination terminal 20. As shown in FIG. 3, the connection destination terminal 20 includes a screen data transfer unit 21, a window operation execution unit 23, and a display 25.

  The connection destination terminal 20 has hardware such as a CPU and a memory, and the screen data transfer unit 21 and the window operation execution unit 23 are realized by executing a computer program (software) on the hardware. Is done.

  The screen data transfer unit 21 transfers the screen data of the desktop screen of the connection destination terminal 20 to the screen data relay server 100. Specifically, the screen data transfer unit 21 transmits a packet addressed to the screen data relay server 100 including the screen data to the communication network 40A.

  Based on an instruction from the screen data relay server 100, the window operation execution unit 23 executes an operation on the window on the desktop screen. Specifically, the window operation execution unit 23 changes the size of the active window based on an instruction to change the size of the active window.

  Further, the window operation executing unit 23 executes switching of the active window based on an instruction to switch the active window.

  The display 25 displays a desktop screen or the like. The size of the display 25 depends on the performance of the connection destination terminal 20, but is about 21 to 27 inches for the desktop type and about 12 to 17 inches for the notebook type. The resolution is typically 1920 × 1080, 1366 × 768, 1024 × 768, or the like. However, it is not limited to such a value.

(2.3) Remote terminal 30
FIG. 4 is a functional block configuration diagram of the remote terminal 30. As shown in FIG. 4, the remote terminal 30 includes a display 31, an input function unit 33, a screen display processing unit 35, and an operation input processing unit 37.

  The remote terminal 30 includes hardware such as a CPU and a memory, and the input function unit 33 (in the case of software), the screen display processing unit 35, and the operation input processing unit 37 are computer programs on the hardware. This is realized by executing (software).

  The display 31 displays an active window of the connection destination terminal 20 or the like. The size of the display 31 depends on the type of the remote terminal 30, but is about 7 to 12 inches for a tablet and about 4 to 5.5 inches for a smartphone. However, it is not limited to such a value.

  The input function unit 33 acquires an input operation by the user of the remote terminal 30. Specifically, the input function unit 33 is a pointer, a keyboard, a mouse, or the like. Note that the keyboard and mouse may be realized by hardware, or may be realized by software that is virtually displayed on the screen of the display 31.

  The input function unit 33 outputs the acquired operation data to the operation input processing unit 37.

  The screen display processing unit 35 processes the screen data of the active window transferred from the screen data relay server 100. Specifically, the screen display processing unit 35 executes processing for displaying an active window on the display 31 based on the screen data.

  The operation input processing unit 37 executes processing associated with the input operation acquired by the input function unit 33. Specifically, the operation input processing unit 37 outputs data used for the screen display processing to the screen display processing unit 35 based on the operation data acquired by the input function unit 33.

  In addition, the operation input processing unit 37 transmits operation data for the active window to the screen data relay server 100 based on the operation data acquired by the input function unit 33.

(3) Operation of Remote Connection System Next, the operation of the remote connection system 10 described above will be described. Specifically, the display and control operation of the active window of the connection destination terminal 20 via the screen data relay server 100 will be described.

  FIG. 5 shows a control sequence for displaying the active window of the connection destination terminal 20 on the remote terminal 30. 6A and 6B show examples of the desktop screen of the connection destination terminal 20. FIG. 7A and 7B show screen examples of the remote terminal 30. FIG.

  As shown in FIG. 5, in order to perform remote connection to the connection destination terminal 20, the connection destination terminal 20 and the remote terminal 30 each establish a session with the screen data relay server 100 (S10 and S20). As a result, the remote connection state changes from the standby state to the connection state.

  After the session is established, the screen data relay server 100 requests the connection destination terminal 20 to transmit screen data of the desktop screen (S30). Here, as shown in FIG. 6A, the connection destination terminal 20 includes three windows (windows 200A (window A), 200B (window B), and 200C (window C)) on the screen 25A of the display 25 ( Application) is displayed, and the window 200A is the active window.

  In addition, a launcher 300 for selecting a specific application is displayed on the desktop screen of the connection destination terminal 20. As described above, the screen data relay server 100 may display the portion of the launcher 300 together with the active window on the remote terminal 30 in order to realize the switching of the active window from the remote terminal 30. The entire desktop screen displayed on the screen 25A may be displayed on the remote terminal 30 only at the time of switching.

  The connection destination terminal 20 captures the desktop screen and transmits the captured screen data to the screen data relay server 100 (S40).

  The screen data relay server 100 inquires about the screen size of the remote terminal 30 (S50). Specifically, the screen data relay server 100 transmits an inquiry command for inquiring about the screen size of the remote terminal 30 to the remote terminal 30.

  In response to the inquiry about the screen size, the remote terminal 30 notifies the screen data relay server 100 of the screen size of the remote terminal 30 (S60). Specifically, the remote terminal 30 transmits a screen size response indicating the screen size to the screen data relay server 100.

  The screen data relay server 100 instructs the connection destination terminal 20 to change the size of the active window based on the screen size of the remote terminal 30 (S70).

  Specifically, the screen data relay server 100 recognizes that the window 200A is the active window based on the fact that the window 200A is displayed in the foreground among the windows 200A, 200B, and 200C.

  The screen data relay server 100 issues an instruction to reduce the size of the active window based on the size (vertical and horizontal size) of the window 200A and the screen size of the remote terminal 30 so as to match the screen size. Send to.

  The connection destination terminal 20 changes the size of the active window based on the instruction to change the size of the active window, and transmits the changed screen data to the screen data relay server 100 (S80). Further, the screen data relay server 100 stores the size of the active window before the change.

  FIG. 6B displays a window 210A in which the size of the window A (active window) is changed based on the size change instruction. When remote connection is started, a login screen or the like may be displayed on the screen 25A of the connection destination terminal 20 without displaying the window.

  The screen data relay server 100 transmits only the screen data of the active window whose size has been changed to the remote terminal 30 (S90). As a result, only the active window of the connection destination terminal 20 is displayed on the remote terminal 30.

  Specifically, as shown in FIG. 7A, a window 210A corresponding to the size of the display 31 is displayed on the screen 31A of the display 31. Further, when the remote terminal 30 is tilted horizontally from the portrait orientation shown in FIG. 7A (that is, the portrait screen), it is adjusted to the landscape screen as shown in FIG. 7B. The size of the window 210A may be changed to the state.

  When the remote terminal 30 is tilted from the portrait orientation to the landscape orientation (or vice versa) as described above, the remote terminal 30 can change the screen size ( (Horizontal or vertical) may be voluntarily notified to the screen data relay server 100.

  After the window 210A is displayed on the display 31, the remote terminal 30 transmits operation data (mouse / keyboard operation data) input via the input function unit 33 of the remote terminal 30 to the screen data relay server 100 (S100). ). Specifically, the remote terminal 30 transmits operation data indicating an operation on a predetermined coordinate on the window A (active window) to the screen data relay server 100.

  The screen data relay server 100 converts the acquired operation data into coordinates on the active window of the desktop screen of the connection destination terminal 20, and transmits the converted operation data (mouse / keyboard operation data) to the connection destination terminal 20. (S110).

  Thereafter, the remote terminal 30 transmits a session disconnection request to the screen data relay server 100 to end the remote connection (S120).

  The screen data relay server 100 instructs the connection destination terminal 20 to return the active window to the size before the size change based on the size of the active window before the size change stored in step S40 (S130).

  As a result, the window A (the active window size is restored from the window 210A (see FIG. 6B) to the window 200A (see FIG. 6A)), and the remote connection state is set to the standby state.

(4) Action / Effect According to the above-described embodiment, the following action / effect can be obtained. According to the screen data relay server 100, the screen configuration recognition unit 110 recognizes an active window on the desktop screen of the connection destination terminal 20. Further, the window control unit 130 instructs the connection destination terminal 20 to change the size of the active window based on the screen size of the remote terminal 30 acquired by the screen size acquisition unit 125. Furthermore, the partial screen relay unit 140 relays the screen data of the active window after the size change to the remote terminal 30.

  For this reason, even when a portable communication device such as a tablet or a smartphone having a small screen size is used as the remote terminal 30, a remote desktop environment that is easy to see and operate can be provided.

  That is, even when the size of the screen 31A of the remote terminal 30 is smaller than the size of the screen 25A of the connection destination terminal 20, only the active window is displayed on the screen 31A, so that it is possible to avoid a state where the display of the active window is too small . Furthermore, since the size of the active window is adjusted to the size of the screen 31A of the remote terminal 30, the active window can be displayed using the entire screen 31A.

  That is, according to the remote connection system 10, even when the remote terminal 30 is a portable communication device such as a tablet or a smartphone, it is possible to provide a remote desktop environment without impairing usability as much as possible.

  In this embodiment, the coordinate conversion instruction unit 160 of the screen data relay server 100 converts the operation data acquired by the operation data acquisition unit 150 into coordinates on the active window of the desktop screen, and the converted operation data is connected to the connection destination terminal. Can be sent to 20. For this reason, even when only the active window is displayed on the screen 31A of the remote terminal 30, the operation on the active window on the desktop screen of the connection destination terminal 20 can be reliably executed.

  In this embodiment, when the session with the remote terminal 30 is disconnected, the window control unit 130 of the screen data relay server 100 can return the active window to the size before the size change. For this reason, when the remote connection by the remote terminal 30 is terminated and the operation is resumed at the connection destination terminal 20, the window size can be restored according to the size of the screen 25A of the connection destination terminal 20.

  In the present embodiment, the screen size acquisition unit 125 of the screen data relay server 100 can acquire the screen size of the remote terminal 30 by a screen size response from the remote terminal 30 in response to an inquiry command that inquires about the screen size. For this reason, it is possible to more reliably set an appropriate active window size according to the screen size of the remote terminal 30.

  In the present embodiment, the window control unit 130 of the screen data relay server 100 can instruct the connection destination terminal 20 to switch the active window based on the active window switching instruction acquired by the window switching instruction acquisition unit 135. . Specifically, the window switching instruction acquisition unit 135 can acquire an active window switching instruction using the launcher 300 (see FIGS. 6A and 6B). Therefore, even when almost only the active window is displayed on the screen 31A of the remote terminal 30, the active window can be easily switched according to the user's intention.

(5) Other Embodiments Although the contents of the present invention have been described above according to the embodiments, the present invention is not limited to these descriptions, and various modifications and improvements are possible. It is obvious to the contractor.

  For example, in the above-described embodiment, the remote terminal 30 is assumed to be a portable communication device such as a tablet or a smartphone. However, the remote terminal 30 is not necessarily limited to such a portable communication device, and is a notebook type. Or it may be a desktop PC.

  In the above-described embodiment, since the screen size of the remote terminal 30 is usually smaller than the size of the window 200A displayed on the screen 25A, an instruction to reduce the window 200A is transmitted to the connection destination terminal 20, but the window 200A When the size of (active window) is smaller than the screen size of the remote terminal 30, an enlargement instruction for extending the size of the window 200A may be transmitted to the connection destination terminal 20.

  Furthermore, in the above-described embodiment, the connection destination terminal 20 and the screen data relay server 100 are connected via the communication network 40A, and the remote terminal 30 and the screen data relay server 100 are connected via the communication network 40B. However, the remote connection system 10 may be configured in a closed network such as a corporate network.

  Although the embodiments of the present invention have been described as described above, it should not be understood that the descriptions and drawings constituting a part of this disclosure limit the present invention. From this disclosure, various alternative embodiments, examples and operational techniques will be apparent to those skilled in the art.

10 Remote connection system
20 Connected terminal
21 Screen data transfer section
23 Window operation execution part
25 display
25A screen
30 Remote terminal
31 display
31A screen
33 Input function section
35 Screen display processing section
37 Operation input processing section
40A, 40B communication network
100 screen data relay server
110 Screen configuration recognition unit
120 Partial screen cutout
125 Screen size acquisition unit
130 Window control unit
135 Window switching instruction acquisition unit
140 Partial screen relay
150 Operation data acquisition unit
160 Coordinate conversion instruction section
200A, 210A window
300 launcher

Claims (7)

A screen data relay server that relays screen data constituting a desktop screen of a connection destination terminal to a remote terminal and displays the desktop screen on the remote terminal,
An active window recognition unit for recognizing an active window on the desktop screen of the connection destination terminal;
A screen size acquisition unit for acquiring a screen size of the remote terminal;
A window control unit that instructs the connection destination terminal to change the size of the active window based on the screen size acquired by the screen size acquisition unit;
A screen data relay server comprising: a screen data relay unit that acquires screen data of the active window after the size change from the connection destination terminal and relays the acquired screen data to the remote terminal. An operation data acquisition unit for acquiring operation data indicating an operation on a predetermined coordinate on the active window displayed on the screen of the remote terminal from the remote terminal;
A coordinate conversion instructing unit that converts the operation data acquired by the operation data acquisition unit into coordinates on the active window of the desktop screen and transmits the converted operation data to the connection destination terminal; Item 6. The screen data relay server according to Item 1.   3. The screen data relay server according to claim 1, wherein when the session with the remote terminal is disconnected, the window control unit instructs the connection destination terminal to return the active window to a size before the size change. .   The screen size acquisition unit transmits an inquiry command for inquiring about the screen size to the remote terminal, and acquires the screen size by a screen size response from the remote terminal in response to the inquiry command. The screen data relay server described in the section. A window switching instruction acquisition unit for acquiring the active window switching instruction from the remote terminal;
5. The screen data according to claim 1, wherein the window control unit instructs the connection destination terminal to switch the active window based on the switching instruction acquired by the window switching instruction acquisition unit. Relay server. A screen data relay program for relaying screen data constituting a desktop screen of a connection destination terminal to a remote terminal and displaying the desktop screen on the remote terminal,
On the computer,
An active window recognition process for recognizing an active window on the desktop screen of the connection destination terminal;
Screen size acquisition processing for acquiring the screen size of the remote terminal;
Window control processing for instructing the connection destination terminal to change the size of the active window based on the acquired screen size;
A screen data relay program for acquiring screen data of the active window after the size change from the connection destination terminal and executing screen data relay processing for relaying the acquired screen data to the remote terminal. A screen data relay method for relaying screen data constituting a desktop screen of a connection destination terminal to a remote terminal and displaying the desktop screen on the remote terminal,
Instructing the connection destination terminal to change the size of the active window on the desktop screen of the connection destination terminal based on the screen size of the remote terminal;
Acquiring the screen data of the active window after the size change from the connection destination terminal and relaying the acquired screen data to the remote terminal.

Images