JP5786592B2 - Relay communication system and relay server - Google Patents

Description

  The present invention relates to a relay communication system having a plurality of relay servers that can communicate with each other, a plurality of client terminals, and a LAN that connects the client terminals to the relay server, and further relates to a relay server used in the relay communication system.

Conventionally, a remote maintenance system for monitoring and maintaining a terminal such as an electronic device installed in a home or office from a remote location has been put into practical use. By using the remote maintenance system, a maintenance worker's service person performs maintenance work on the terminal without going to the place where the terminal is installed.
Conventionally, there has been proposed an image processing apparatus capable of remotely operating a computer terminal while confirming the contents of the screen of the computer terminal connected via a predetermined network (see, for example, Patent Document 1).

JP 2006-59083 A

  The remote control system disclosed in Patent Document 1 is operated only between the image processing apparatus and one computer terminal. That is, in the remote operation disclosed in Patent Document 1, the content of the remote operation is shared only between the remote operation terminal and the operated terminal having a one-to-one relationship. Therefore, conventionally, when the operation side terminal remotely operates the operated side terminal, even if the other terminal has a request to acquire the contents of the remote operation, such request It was difficult to meet.

  An object of the present invention is that a relay communication system having a plurality of relay servers and a plurality of client terminals that can communicate with each other allows a terminal other than the terminal to be remotely operated and a terminal other than the terminal to be remotely operated to acquire the contents of the remote operation. It is in.

  Hereinafter, a plurality of modes will be described as means for solving the problems. These aspects can be arbitrarily combined as necessary.

A relay communication system according to an aspect of the present invention includes a first network, a second network, a first relay server, a second relay server, a first client terminal, a second client terminal, and a third client terminal. And comprising. The first relay server is connected to the first network. The second relay server is connected to the second network and can communicate with the first relay server via the third network. The first client terminal is connected to the first relay server via the first network. The second client terminal and the third client terminal are connected to the second relay server via the second network.
The first relay server and the second relay server include an operation control unit. The operation control unit shares the relay server information including the activation information of the relay server itself and the activation information and connection information of the client terminal connected to the relay server itself.
The second relay server has a second operation control unit. The second operation control unit is a request to remotely operate the first client terminal selected as the operated client terminal with reference to the relay server information from the second client terminal that is an operation client terminal that performs remote operation, If a remote operation request including information on the second client terminal and the first client terminal is received, the following processing is performed. The second operation control unit identifies the first relay server to which the first client terminal is connected, relays the remote operation request to the first relay server, and establishes the first operation session with the second client terminal and to establish between the intermediate server session with the first relay server relays the operation data of the remote control to the first client terminal by the second client terminal between the first operation session and the intermediate server between sessions.
The first relay server has a first operation control unit. If the first operation control unit receives a remote operation request from the second relay server, the first operation control unit performs the following processing. Relays a remote operation request to the first client terminal, between the first client terminal to establish a third operation session, relays the operation data of the far隔操operation between the intermediate server between sessions, and a third operation session, Remote operation information including information on the first client terminal and the second client terminal is created.
If the second operation control unit receives an operation participation request for remote operation from the third client terminal, which is a participating operation client terminal that refers to the remote operation information, the second operation control unit establishes a first participating operation session with the third client terminal. Then, the operation event received from any one of the second client terminal and the third client terminal having the operation right is relayed to the first relay server, and the image data received from the first relay server is Relay to 1 client terminal and 3rd client terminal.

  Here, a plurality of client terminals can be remotely operated with respect to one operated client terminal in the first relay group.

  When adjusting the exclusive operation right, the second operation control unit transmits an exclusive operation right acquisition request for the remote operation received from the third client terminal to the second client terminal, and the exclusive operation right from the second client terminal An authorization response to the right acquisition request may be received.

The relay server according to another aspect of the present invention can communicate with the second relay server connected to the second network, is connected to the first network, and is connected to the first client terminal via the first network. It is a relay server that functions as a first relay server.
The relay server includes an information sharing unit and an operation control unit.
The information sharing unit shares the relay server information including the activation information of the relay server, the activation information of the client terminal connected to the relay server, and the connection information with the second relay server.
The operation control unit is a request to remotely operate the first client terminal selected with reference to the relay server information from the second client terminal connected to the second relay server that is an operation client terminal that performs remote operation. If a remote operation request including information on the second client terminal and the first client terminal is received, the following processing is performed. The operation control unit relays a remote operation request to the first client terminal, establishes an inter-relay server session with the second relay server, establishes a second operation session with the first client terminal, and relays a server between sessions, and the third operation session, the third remote control to the client terminal and the first client terminal by the second client terminal dividing line through the first operating session established between the second relay server Are relayed between the relay server session and the second operation session. The operation control unit creates remote operation information including information on the first client terminal and the second client terminal.
Here, if the operation control unit receives an operation participation request for remote operation from the third client terminal, which is a participation operation client terminal that refers to the remote operation information, the operation control unit performs the following processing. The operation control unit further establishes a participation operation session with the second relay server to which the third client terminal is connected, and the exclusive operation right of the remote operation for the first client terminal adjusted by the second operation control unit Based on the above, the operation data of the remote operation performed between the client terminal having the exclusive operation right of the adjusted remote operation among the second client terminal and the third client terminal and the first client terminal is relayed. The operation event is supplied from a client terminal having an exclusive operation right.

A relay communication system according to still another aspect of the present invention includes a first network, a second network, a third network, a first relay server, a second relay server, a third relay server, and a first client. A terminal, a second client terminal, and a fifth client terminal. The first relay server is connected to the first network. The second relay server is connected to the second network. The third relay server is connected to the third network and can communicate with the first relay server and the second relay server. The first client terminal is connected to the first relay server via the first network. The second client terminal is connected to the second relay server via the second network. The fifth client terminal is connected to the third relay server via the third network. The first relay server, the second relay server, and the third relay server share each other relay server information including start information of the relay server itself and start information and connection information of the client terminal connected to the relay server itself. have. The second relay server has a second operation unit. The second operation unit is a request to remotely operate the first client terminal selected as the operated client terminal with reference to the relay server information from the second client terminal that is an operation client terminal that performs remote operation, If a remote operation request including information on the two client terminals and the first client terminal is received, the first relay server to which the first client terminal is connected is identified, the remote operation request is relayed to the first relay server, The first operation session is established with two client terminals, the inter-relay server session is established with the first relay server, and the second client terminal operates as operation data for remote operation to the first client terminal. The event and the image data are relayed between the first operation session and the relay server session. The first relay server has a first operation control unit. The first operation control unit, when receiving a remote operation request from the second relay server relays the remote operation request to the first client terminal, establishing a second operation session between the first client terminal, the far septum The operation data of the operation is relayed between the relay server session and the second operation session, and remote operation information including information on the first client terminal and the second client terminal is created. The third relay server has a third operation control unit capable of transmitting and receiving an operation participation request. The third operation control unit relays the operation participation request to the first relay server when receiving the operation participation request for the remote operation from the fifth client terminal which is the participating operation client terminal referring to the remote operation information, A first participation operation session is established with the client terminal, a second participation session is established with the third relay server, and the first operation control unit includes the second client terminal and the fifth client terminal, The operation event received from any client terminal having the operation right is relayed to the first client terminal, and the image data received from the first client terminal is relayed to the second client terminal and the fifth client terminal.

  The first relay server according to still another aspect of the present invention is connectable to the second relay server and the third relay server via the WAN, and is connected to the first client terminal, the second client terminal, and the third relay via the LAN. This is a first relay server that can be connected to a client terminal. The first relay server includes a first operation session establishment unit, a second operation session establishment unit, an operated session establishment unit, an operation control unit, and an operation authority change unit. The first operation session establishing unit establishes a first operation session with the first client terminal or the second relay server. The second operation session establishing unit establishes a second operation session with the second client terminal or the third relay server. The operated session establishing unit establishes an operated session with the third client terminal. The operation control unit relays the operation event received from the operation session having the operation authority in the first operation session or the second operation session to the operated session, and receives the image data received from the operated session as the first operation session. And relay to the second operation session. The operation authority changing unit changes an operation session having the operation authority based on the operation authority change request received from the first operation session or the second operation session.

  The first relay server according to still another aspect of the present invention can be connected to the second relay server via the WAN, and can be connected to the first client terminal and the second client terminal via the LAN. It is. The first relay server includes a first operation session establishment unit, a second operation session establishment unit, an operated session establishment unit, an operation control unit, and an operation authority change unit. The first operation session establishing unit establishes a first operation session with the first client terminal. The second operation session establishing unit establishes a second operation session with the second client terminal. The operated session establishing unit establishes an operated session with the second relay server. The operation control unit relays the operation event received from the operation session having the operation authority in the first operation session or the second operation session to the operated session, and receives the image data received from the operated session as the first operation session. And relay to the second operation session. The operation authority changing unit changes an operation session having the operation authority based on the operation authority change request received from the first operation session or the second operation session.

  According to the present invention, a plurality of operation client terminals can be remotely operated with respect to one operated client terminal in the first relay group.

The schematic diagram which shows the whole structure of a relay communication system. The block diagram which shows the structure of a 1st relay server. The block diagram which shows the structure of a 1st client terminal. The figure which shows schematic structure of relay group information. The figure which shows the detailed structure of relay group information. The figure which shows schematic structure of relay server information. The figure which shows the detailed structure of relay server information. The figure which shows schematic structure of remote operation information. The flowchart (the 1) which shows the operation process of an operation client terminal. The flowchart (the 2) which shows the operation process of an operation client terminal. The flowchart which shows the process of a to-be-operated client terminal. The figure which shows an example of the established operation session. The flowchart which shows the operation process of a participating operation client terminal (the 1). The flowchart which shows the operation process of a participating operation client terminal (the 2). The flowchart (the 3) which shows the operation process of a participating operation client terminal. The flowchart (the 1) which shows the process of an operation control relay server. The flowchart (the 2) which shows the operation process of an operation control relay server. The flowchart (the 3) which shows the operation process of an operation control relay server.

1. Outline of this Embodiment In the relay communication system according to this embodiment, client terminals can communicate with each other across a WAN via a plurality of relay servers.

2. Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 shows the overall configuration of a relay communication system. The relay communication system includes a first LAN 1, a second LAN 2, a third LAN 3, and a WAN 4. The first LAN 1, the second LAN 2 and the third LAN 3 are small-scale networks constructed remotely. The WAN 4 is a large-scale network such as the Internet.
In this embodiment, as will be described in detail later, the first relay server A of the first LAN 1, the second relay server B of the second LAN 2, and the third relay server C of the third LAN 3 are the first relay as a relay group. A group is formed.

  The first LAN 1 has a fourth LAN 11 and a fifth LAN 13, and the fourth LAN 11 and the fifth LAN 13 are connected to each other by a first general-purpose router 15. In the fourth LAN 11, the first relay server A and the first client terminal A1 are connected to each other. In the fifth LAN 13, the second client terminal A2 and the first communication device 17 are connected to each other.

In the second LAN 2, the second relay server B and the third client terminal B1 are connected to each other.
The third LAN 3 has a sixth LAN 19, a seventh LAN 21, and an eighth LAN 23. The sixth LAN 19 and the seventh LAN 21 are connected by a second general-purpose router 25, and the sixth LAN 19 and the eighth LAN 23 are connected by a third general-purpose router 27. The third relay server C belongs to the sixth LAN 19. A fourth client terminal C1 is connected to the seventh LAN 21. A fifth client terminal C2 is connected to the eighth LAN 23.

  The first client terminal A1, the second client terminal A2, the third client terminal B1, the fourth client terminal C1, and the fifth client terminal C2 are, for example, personal computers. The first communication device 17 is also a personal computer, for example.

  The first relay server A, the second relay server B, and the third relay server C are connected to each other of the first client terminal A1, the second client terminal A2, the third client terminal B1, the fourth client terminal C1, and the fifth client terminal C2. Relay communication between them. The WAN 4 relays communication among the first relay server A, the second relay server B, and the third relay server C. The communication protocol among the first relay server A, the second relay server B, and the third relay server C is not particularly limited.

3. Components of the relay server The relay server is connected not only to the LAN but also to the WAN, can communicate with each client terminal connected to the same LAN, and communicates with a relay server arranged in another LAN. It is possible. Therefore, each relay server is given a global IP address in addition to the private IP address.
FIG. 2 shows components of the first relay server A. The first relay server A includes a network interface 121, a LAN control unit 122, a WAN control unit 123, a control unit 124, and a database storage unit 125. Further, the first relay server A may include a display unit 126 and an operation input unit 127.
The network interface 121 executes communication with the terminals in the LAN 1 using the private IP address, and further executes communication with the WAN 4 using the global IP address.
The LAN control unit 122 is a processing unit that controls various communications performed with terminals in the LAN 1 via the network interface 121, and controls communication processing according to a predetermined protocol.
The WAN control unit 123 is a processing unit that controls various communications performed with a terminal connected to the WAN 4 via the network interface 121, and controls communication processing according to a predetermined protocol.

The control unit 124 is, for example, a CPU having control and calculation functions, and can execute various processes using a loaded program.
The control unit 124 of this embodiment includes an information sharing unit 131 and an operation control unit 132.

The information sharing unit 131 creates and updates relay group information and relay server information described later.
In addition, the information sharing unit 131 performs processing for sharing relay group information, relay server information, and remote operation information, which will be described later, with relay servers and client terminals in the relay group. Specifically, the information sharing unit 131 shares the created and updated relay group information with the relay servers in the relay group and the client terminals connected to the relay server, and stores them in the relay group information storage unit 141 (described later). To do. The information sharing unit 131 shares the created and updated relay server information with the relay servers in the relay group and the client terminals connected to the relay servers, and stores them in the relay server information storage unit 142 (described later). In addition, the information sharing unit 131 shares the created and updated remote operation information with the relay server and the client terminal in the relay group, and stores them in the remote operation information storage unit 143 (described later).

The operation control unit 132 establishes an operation session for performing a remote operation performed in the relay group in response to a remote operation request, and controls the remote operation. The remote operation request is a request for remote operation output from a client terminal (hereinafter referred to as operation client terminal) that performs remote operation, and includes information on the operation client terminal and a remotely operated client terminal (hereinafter referred to as client to be operated). Terminal) information. The information on the operation client terminal and the operated client terminal is information for identifying each client terminal, and in this embodiment, is the account name of each client terminal.
Specifically, when the operation control unit 132 receives a remote operation request, the operation control unit 132 refers to the relay server information, relays the remote operation request to the operated client terminal, and establishes an operation session for executing the remote operation. Perform the process. For example, when the operation control unit 132 receives a remote operation request from the operation client terminal connected to the relay server, the operation control unit 132 refers to the relay server information and specifies the relay server to which the operated client terminal is connected. , Relay remote control requests. In addition, the operation control unit 132 establishes an operation session with the relay server to which the operated client terminal is connected. Next, the operation control unit 132 of the relay server to which the operated client terminal is connected relays the remote operation request to the operated client terminal, and establishes an operation session with the operated client terminal based on the relay server information. To do.

  In addition, the operation control unit 132 relays operation data related to remote operation performed between the operation client terminal and the operated client terminal via the operation session. The operation data includes an operation event and image data described later. Further, the operation control unit 132 creates or updates the remote operation information, details of which will be described later.

  Further, the operation control unit 132 receives a request for participation in remote operation from another client terminal different from the operation client terminal and the operated client terminal when the remote operation is performed through the operation session. Control the adjustment of exclusive operation rights for remote operation. Thereafter, the operation control unit 132 relays the remote operation data from the client terminal having the exclusive right of remote operation. Hereinafter, a relay server that adjusts the exclusive operation right for remote operation in response to receiving a request for participation in remote operation is referred to as an operation control relay server. A client terminal that requests participation in the remote operation on the way is called a participation operation client terminal.

  The database storage unit 125 is, for example, a hard disk or a nonvolatile RAM, and can store various data. The database storage unit 125 includes a relay group information storage unit 141, a relay server information storage unit 142, and a remote operation information storage unit 143. Details of the information stored in the relay group information storage unit 141, the relay server information storage unit 142, and the remote operation information storage unit 143 will be described later.

The display unit 126 includes a display device such as a liquid crystal display panel. The display unit 126 presents various information related to relay group information, relay server information, remote operation information, and the like to the user.
The operation input unit 127 includes a hard key and a mouse for inputting various instructions to the first relay server A.

  The constituent elements of the second relay server B and the third relay server C are the same as those of the first relay server A, and thus the description thereof is omitted.

4). Components of Client Terminal A client terminal is a terminal that can be directly operated by a user. The client terminal is, for example, a personal computer used for daily work by a user. Each client terminal is assigned a private IP address that is uniquely managed within the same LAN.

  FIG. 3 shows components of the first client terminal A1. The first client terminal A1 includes a LAN interface 221, a control unit 222, a database storage unit 223, a display unit 224, and an operation input unit 225.

  The LAN interface 221 can execute communication with the first relay server A and other terminals in the first LAN 1 using a private IP address.

  The control unit 222 is, for example, a CPU having control and calculation functions, and can execute various processes using a loaded program. The control unit 222 of this embodiment includes an information sharing unit 231, an operation control unit 232, an image setting unit 233, and a client communication control unit 234.

  The information sharing unit 231 performs processing for sharing the relay group information, the relay server information, and the remote operation information with the relay server and the client terminal in the relay group. Specifically, the information sharing unit 231 shares the created and updated relay group information with the relay servers in the relay group and the client terminals connected to the relay server, and stores them in the relay group information storage unit 241 (described later). To do. The information sharing unit 231 shares the created and updated relay server information with the relay servers in the relay group and the client terminals connected to the relay servers, and stores them in the relay server information storage unit 242 (described later). Further, the information sharing unit 231 shares the created and updated remote operation information with the relay server and the client terminal in the relay group, and stores them in the remote operation information storage unit 243 (described later).

The operation control unit 232 establishes an operation session for performing a remote operation performed in the relay group in response to the remote operation request, and controls the remote operation.
The operation control unit 232 of the operation client terminal first receives a remote operation request from the user. Thereafter, the operation control unit 232 transmits a remote operation request to the operated client terminal via the relay server, and further controls to establish an operation session with the operated client terminal via the relay server. .
After the operation session is established, the operation control unit 232 performs control to receive an operation event from the user and output the received operation event to the operation session. The operation event is a user operation via the operation input unit 225, and is, for example, cursor movement, mouse input, or keyboard input via a mouse and a keyboard.
In addition, when the operation control unit 232 receives the image data in which the operation event is processed from the operated client terminal, the operation control unit 232 outputs the received image data to the display unit 224 for display.

  On the other hand, when the operation control unit 232 of the operated client terminal receives a remote operation request, the operation control unit 232 controls to establish an operation session with the operation client terminal via the relay server. If an operation event is received from the operation client terminal, the operation control unit 232 causes the received operation event to be executed in the system of the client terminal, and the image data reflecting the operation event is transmitted via the operation session to the operation client terminal. To output.

  In addition, the operation control unit 232 of the participating operation client terminal transmits an operation participation request to the operation control relay server. Then, in response to an instruction from the user, a request for acquiring an exclusive operation right for remote operation is transmitted to the operation control relay server. If acquisition of the exclusive operation right is permitted from the operation control relay server, the operation control unit 232 then performs remote operation on the operated client terminal. On the other hand, when acquisition of the exclusive operation right from the operation control relay server is not permitted, the operation control unit 232 performs control for monitoring the remote operation thereafter.

  The image setting unit 233 of the operation client terminal and the operated client terminal determines image information of the operation client terminal and the operated client terminal when performing a remote operation, and performs a process of setting the determined image information in the client terminal. . The image information includes screen size, color information, resolution, brightness, and the like. Specifically, the image setting unit 233 exchanges screen information between the operation client terminal and the operated client terminal by handshake processing so that the screen information between the operation client terminal and the operated client terminal becomes common. Determine image information. Then, the image setting unit 233 sets the image information of the client terminal based on the determined image information. As described above, the screen information between the operation client terminal and the operated client terminal is set in common, thereby preventing unclear image data from being displayed on the display unit 224 of the operation client terminal. In the present embodiment, the image setting unit 233 of the operation control unit of each client terminal is set to match the image information of the other client terminals with the image information indicating the low ability among the image information of the operation client terminal and the operated client terminal. Is done.

  The client communication control unit 234 processes communication packets and controls various communications according to protocols such as TCP / IP, UDP, and SIP performed via the LAN interface 221.

  The database storage unit 223 is, for example, a hard disk or a nonvolatile RAM, and can store various data. The database storage unit 223 includes a relay group information storage unit 241, a relay server information storage unit 242, and a remote operation information storage unit 243. Details of the information stored in the relay group information storage unit 241, the relay server information storage unit 242, and the remote operation information storage unit 243 will be described later.

The display unit 224 includes a display device such as a liquid crystal display panel. The display unit 224 presents various information related to relay group information, relay server information, and remote operation information to the user. Further, the display unit 224 of the operation client terminal presents an operation window related to remote operation to the user. On the other hand, the display unit 224 of the operated client terminal presents an operated window related to remote operation to the user.
The operation input unit 225 includes a hard key and a mouse for inputting various instructions to the first client terminal A1.
Since the second client terminal A2, the third client terminal B1, the fourth client terminal C1, and the fifth client terminal C2 are the same as the first client terminal A1, the description thereof is omitted.

5. Relay Group Information The relay group information 20 will be described with reference to FIGS. 4 and 5. FIG. 4 is a diagram illustrating a schematic configuration of relay group information. FIG. 5 is a diagram illustrating a detailed configuration of relay group information. The relay group information 20 is information indicating an outline of each relay group in the relay communication system. FIG. 4 shows that the first relay group includes a first relay server A, a second relay server B, and a third relay server C.

As shown in FIG. 5, the relay group information 20 includes upper information 201 and lower information 202.
The upper information 201 is information about the first relay group itself. “Group id” indicates identification information of the relay group. “Lastmod” indicates the latest update time of the relay group information. “Name” indicates the name of the relay group.

  The lower information 202 is information about the first relay server A, the second relay server B, and the third relay server C. “Site id” indicates identification information of the relay server.

  The relay group information 20 is shared among the first relay server A, the second relay server B, and the third relay server C, and stored in the relay group information storage unit 141 of each relay server. Further, the relay group information 20 is shared between the relay server and the client terminal, and stored in the relay group information storage unit 241 of each client terminal.

6). Relay Server Information The relay server information 30 will be described with reference to FIGS. FIG. 6 shows a schematic configuration of the relay server information. FIG. 7 shows a detailed configuration of the relay server information 30. The relay server information 30 is information indicating an outline of the relay server and the client terminal that constitute the relay communication system.

  As shown in FIG. 6, in the relay server information 30, the first client terminal A1 and the second client terminal A2 are connected to the first relay server A, and the third client terminal B1 is connected to the second relay server B. The information that the fourth client terminal C1 and the fifth client terminal C2 are connected to the third relay server C is shown.

  As illustrated in FIG. 7, the relay server information 30 includes upper information 301-1, 301-2, and 301-3 and lower information 302-1, 302-2, and 302-3.

  The upper information 301-1, 301-2, 301-3 is information about the relay server. “Site id” indicates identification information of the relay server. “Name” indicates the name of the relay server. “Stat” indicates information about whether or not the relay server is activated.

  The lower information 302-1, 302-2, 302-3 is information about the client terminal. “Div” indicates a department name of the client terminal. “Group” indicates identification information of the relay group to which the client terminal belongs. “Id” indicates identification information of the client terminal. “Name” indicates the name of the client terminal. “Site” indicates identification information of a relay server that is a logon destination when the client terminal is logged on.

  The relay server information 30 is shared among the first relay server A, the second relay server B, and the third relay server C, and is stored in the relay server information storage unit 142 of each relay server. The relay server information 30 is shared between the relay server and the client terminal, and stored in the relay server information storage unit 242 of each client terminal.

  When the relay server is activated, “stat” of the upper information 301-1, 301-2, 301-3 is “active”. When the relay server is not activated, “stat” is blank. Thereby, information about whether or not the relay server is activated is shared as the entire relay communication system.

  When the client terminal is logged on to the relay server, the identification information of the relay server that is the logon destination of the client terminal is described in “site” of the lower information 302-1, 302-2, 302-3. When the client terminal is not logged on to the relay server, “site” is blank. Thereby, information about whether or not the client terminal is logged on to the relay server is shared as the entire relay communication system.

7). Remote operation information The remote operation information is information including identification information of the operation client terminal and the operated client terminal, and identification information for identifying the remote operation. In this embodiment, the identification information of each client terminal is an account name. However, the identification information of each client terminal is not limited to this example as long as the information can identify each client terminal. An arbitrary ID is used as remote operation identification information. However, identification information other than an arbitrary ID may be used as long as remote operation can be identified.

  Further, when there are a plurality of operation client terminals for a certain operated client terminal, the remote operation information indicates which operation client terminal is currently remotely operated on the operated client terminal. In the present embodiment, a mark “in operation” is displayed in the “status” column of the operation client terminal that is currently remotely operated.

  The remote operation information may further include image information of each client terminal. The image information has the screen size, color information, resolution, brightness, and the like as described above, and may be referred to in the image information determination process between the operation client terminal and the operated client terminal.

The remote operation information will be described with reference to FIG. The figure shows a schematic configuration of the remote operation information 40. The remote operation information 40 stores the account names of the third client terminal B1 and the second client terminal A2 as operation client terminals, and stores the account name of the fifth client terminal C2 as operated client terminals. In addition, a mark “in operation” is displayed in the “status” column of the third client terminal B1. Further, “31” is stored as identification information for identifying remote operations among the third client terminal B1, the second client terminal A2, and the fifth client terminal C2. From this remote operation information 40, the third client terminal B1 and the second client terminal A2 that are two operation client terminals exist with respect to the fifth client terminal C2, and the third client terminal B1 is currently being remotely operated. I understand that there is.
The second client terminal A2, the third client terminal B1, and the fifth client terminal C2 are associated with image information for each client terminal.
The remote operation information 40 is based on the remote operation request information by the operation control relay server to which the operated client terminal is connected at the timing when the operation session is established and the handshake process is performed between the operating client terminal and the operated client terminal. Created or updated.

8). Information Sharing in Relay Communication System In the relay communication system, setting of the relay group as the first relay group and information sharing in the relay group are performed as follows.
First, as an initial setting of the first relay group, each relay server of the first relay server A, the second relay server B, and the third relay server C creates an account for the client terminal connected to the relay server, Create relay server information and store it in the relay server information storage.
Thereafter, if any relay server requests group construction of the first relay group of the relay communication system, each relay server creates relay group information and stores it in the relay group information storage unit. Next, the relay server exchanges relay server information between the relay servers constituting the first relay group, combines the exchanged relay server information with the relay server information stored in the relay server, and saves it as new relay server information. To do. As a result, common relay server information is held among the first relay server A, the second relay server B, and the third relay server C.
In such a relay communication system, when the increase / decrease state and connection state of the LAN and the client terminal change, when one relay server recognizes the state change, the relay group information and the relay server are determined according to the contents. Update information immediately.

  Then, the one relay server immediately notifies the other relay servers described in the relay group information and the relay server information that the relay group information and the relay server information are updated. In addition, the one relay server immediately notifies the updated relay server information to the client terminal connected to the relay server.

  However, even if another relay server is described in the relay group information and relay server information, if one relay server determines that another relay server is not connected, it immediately notifies the other relay server. Never do.

  As a result, the information about the increase / decrease state and connection state of the LAN and client terminals is shared in real time between the relay server configuring the first relay group and the client terminals connected to the relay server.

9. Data transmission / reception in the relay communication system After the information on the increase / decrease state and connection state of the LAN and the client terminal is shared in the relay communication system as described above, the user who uses the client terminal designates another client terminal for communication When doing so, data is transmitted and received as follows.

  Specifically, the client terminal transmits transmission data including the client terminal information of the designated destination, the client terminal information of the transmission source, and the data to be transmitted to the relay server to which the client terminal is connected. The relay server that has received the transmission data refers to the relay server information and confirms to which relay server in the relay group the specified client terminal is subordinate. Further, the relay server confirms whether the relay server under which the designated client terminal is under control is in an activated state and whether the designated client terminal is in a logon state. Specifically, whether or not the relay server is in an active state can be determined by confirming that the upper information “stat” of the relay server information is set to “active”. Further, it is determined whether or not the client terminal is in the logon state by checking whether or not the identification information of the relay server that is the logon destination of the client terminal is described in the lower information “site” of the relay server information.

  If the activation status of the relay server and the logon status of the client terminal can be confirmed, the received transmission data is relayed and transmitted to the relay server under which the designated client terminal is subordinate. The relay server that has received the transmission data relays transmission data to a designated client terminal under its control.

10. Remote operation processing Next, in the relay communication system as described above, in the state where information on the increase / decrease state and connection state of the LAN and the client terminal is shared, the operation client terminal is operated with respect to the operated client terminal belonging to the same relay group The process of performing remote control will be described.

  Whether the user of the operation client terminal operated the operated client terminal with the mouse or keyboard of the operated client terminal by performing an input operation using the mouse and keyboard in the operation window displayed on the display unit 224 Can be operated as follows.

  In the present embodiment, as will be described below, a plurality of operation client terminals can remotely operate one operated client terminal based on control by the operation control relay server. In the following, in a state where the relay server information 30 shown in FIGS. 6 and 7 is shared in the first relay group, the third client terminal B1 remotely operates the fifth client terminal C2, and further the second A process in which the client terminal A2 participates in the remote operation on the way will be described as an example. Hereinafter, a client terminal that performs remote operation on the operated client terminal first is referred to as an operation client terminal. In this example, the third client terminal B1 is an operation client terminal. A client terminal that participates in the middle of a remote operation that has already been performed is referred to as a participation operation client terminal. In this example, the second client terminal A2 is a participation operation client terminal.

10-1. Processing of Remotely Operated Client Terminal First, processing of the third client terminal B1, which is an operating client terminal, will be described with reference to FIGS. 9A and 9B. 9A and 9B are flowcharts showing the operation process of the operation client terminal.

The third client terminal B1 accepts a search for the operated client terminal (step S101). Specifically, the relay server information 30 stored in the relay server information storage unit 242 is displayed on the display unit 224 in response to a remote operation instruction from the user. The user selects an operated client terminal to be remotely operated from among the client terminals indicated in the relay server information 30 displayed on the display unit 224.
If the user selects the fifth client terminal C2 to be remotely operated via the operation input unit 225 (Yes in step S103), the operation control unit 232 of the third client terminal B1 sends to the second relay server B. A remote operation request is transmitted (step S10). The transmitted remote operation request is transmitted to the fifth client terminal C2 via the second relay server B and the third relay server C.
Thereafter, if an operation permission response is received from the fifth client terminal C2 via the second relay server B (Yes in step S107), the operation control unit 232 of the third client terminal B1 communicates with the second relay server B. The control for establishing the first operation session is performed (step S109).
After that, a second operation session is established between the second relay server B and the third relay server C, and a third operation session is established between the third relay server C and the fifth client terminal C2.
On the other hand, when the operation permission response is not received from the fifth client terminal C2 via the second relay server B and the third relay server C (No in step S107), the operation control unit 232 of the third client terminal B1 performs remote operation. Terminate the process.

After the operation session is established, the image setting unit 233 of the third client terminal B1 executes handshake processing with the image setting unit 233 of the fifth client terminal C2 (step S111), and sets the image information to be transmitted. Processing is performed (step S113).
Subsequently, the operation control unit 232 of the third client terminal B1 receives the image data displayed on the display unit 224 of the fifth client terminal C2 from the fifth client terminal C2 (step S115). Subsequently, the operation control unit 232 of the third client terminal B1 outputs the received image data to the display unit 224 of the third client terminal B1, and displays it as an operation window (step S117).

Thereafter, if an operation event occurs on the operation window via the mouse or the keyboard (Yes in step S119), the operation control unit 232 of the third client terminal B1 transmits the generated operation event via the first operation session. It transmits to the second relay server B (step S121). The transmission event transmitted at this time is relayed by the second relay server B and the third relay server C and transmitted to the fifth client terminal C2.
If the operation control unit 232 of the third client terminal B1 receives a remote operation end instruction from the user (Yes in step S123), the operation control unit 232 transmits the remote operation end instruction to the second relay server B and ends the remote operation. To control. Specifically, the operation control unit 232 of the third client terminal B1 disconnects the first operation session established with the second relay server B (step S125). Further, the operation control unit 232 of the third client terminal B1 closes the operation window displayed on the display unit 224. At this time, the remote operation end instruction is transmitted to the fifth client terminal C2 via the second relay server B and the third relay server, and the second operation session and the third operation session are similarly disconnected.
On the other hand, if the operation control unit 232 of the third client terminal B1 does not receive a remote operation end instruction from the user (No in step S123), the operation control unit 232 returns to step S115 again to perform image data reception processing. At this time, when image difference information (described later) is received as image data, the third client terminal B1 creates a composite image of the latest received image data and image difference information, for example, and displays the operation window. Update.

10-2. Processing of Relay Server Connected with Operation Client Terminal Processing of the second relay server B connected with the third client terminal B1 that performs remote operation will be described.
If a remote operation request is received from the operation control unit 232 of the third client terminal B1 (see step S105 in FIG. 9A), the operation control unit 132 of the second relay server B refers to the relay server information and receives the request. After specifying the relay server C to which the operation client terminal is connected, the remote operation request is relayed. Specifically, the operation control unit 132 of the second relay server B specifies the third relay server to which the fifth client terminal C2 is connected based on the relay server information, and relays the remote operation request to the third relay server C. . If an operation permission response is transmitted from the fifth client terminal C2, the operation control unit 132 of the second relay server B establishes a second operation session with the identified third relay server C.
Thereafter, when a remote operation is performed between the third client terminal B1 and the fifth client terminal C2, the operation control unit 132 of the second relay server B relays the operation event and the image data.

10-3. Processing of Remotely Operated Client Terminal Next, processing of the fifth client terminal C2 that is the operated client terminal will be described. FIG. 10 is a flowchart showing processing of the operated client terminal.
The operation control unit 232 of the fifth client terminal C2 receives the remote operation request from the third client terminal B1 relayed by the second relay server B and the third relay server C (step S131), and receives the fifth client terminal C2. Is in a state in which remote control can be accepted (step S133).
If the remote operation can be accepted (Yes in step S133), the operation control unit 232 of the fifth client terminal C2 transmits a remote operation permission response to the third relay server C (step S135). The transmitted remote control permission response is then transmitted to the third client terminal B1 via the third relay server C and the second relay server B.
On the other hand, if it is determined that the remote operation is not acceptable (No in step S133), the operation control unit 232 of the fifth client terminal C2 sends an error response via the third relay server C and the second relay server B. To the third client terminal B1 (step S137), and the process is terminated.

The operation control unit 232 of the fifth client terminal C2 performs control for establishing a third operation session with the third relay server C under the control of the third relay server C (step S139).
If the third operation session is established, the operation control unit 232 of the fifth client terminal C2 next performs handshake processing with the third client terminal B1 (step S141), and performs setting processing of image information to be transmitted. This is performed (step S143).
After the image information is set, the operation control unit 232 of the fifth client terminal C2 receives the target displayed on the display unit 224 of the fifth client terminal C2 via the third relay server C and the second relay server B. The image data of the operation window is transmitted to the third client terminal B1 based on the set image information (step S145).

  Thereafter, when an operation event is received from the third client terminal B1 (step S147), the operation control unit 232 of the fifth client terminal C2 executes a system process corresponding to the operation event (step S149). Next, the operation control unit 232 of the fifth client terminal C2 transmits the image difference information as image data to the third client terminal B1 (step S151). For example, only part of the image data already shared between the fifth client terminal C2 and the third client terminal B1 may be updated by an operation event. In this case, the operation control unit 232 of the fifth client terminal C2 transmits only the image difference information including the drawing position difference of the image to be the difference as image data to the third client terminal B1. In this way, when the system processing for updating a part of the image data in the operated window according to the operation event is performed, only the image difference information is transmitted, so that the fifth client terminal C2 to the third client terminal B1. The amount of data transferred can be reduced.

Subsequently, when there is a screen update spontaneously on the operated window side, such as update of clock information (Yes in step S153), the process returns to step S151, and the operation control unit 232 of the fifth client terminal C2 3 Send the image difference information to the client terminal B1.
Thereafter, if there is no update of the screen in the operated window (No in step S153) and an instruction to end the remote operation is received from the third client terminal B1 (Yes in step S155), the operation control unit of the fifth client terminal C2 In step S232, the remote control process is terminated. If an instruction to end the remote operation is not received from the third client terminal B1 (No in step S155), the process by the fifth client terminal C2 returns to step S147 again.

10-4. Processing of Relay Server Connected with Operated Client Terminal Processing of the third relay server C connected with the fifth client terminal C2 that is the operated client terminal will be described.
First, when receiving the remote operation request from the second relay server B, the operation control unit 132 of the third relay server C relays the remote operation request to the fifth client terminal C2 that is the operated client terminal. Further, when receiving the remote operation permission response, the operation control unit 132 of the third relay server C establishes a third operation session with the fifth client terminal C2.
Furthermore, when a remote operation is performed between the third client terminal B1 and the fifth client terminal C2, the third relay server C relays the operation event and the image data. Further, the third relay server C creates and updates the remote operation information and stores it in the remote operation information storage unit 144 of the third relay server C, and further stores the remote operation information in the other relay servers in the first relay group. Process to share with client terminal.
Specifically, when the third relay server C returns a permission response to the remote operation request between the third client terminal B1 and the fifth client terminal C2, the first to third operation sessions are established and the image is obtained by handshake processing. The remote operation information is recorded at the timing when the information is exchanged, and the remote operation information 40 (see FIG. 8) is created. The created remote operation information 40 is shared within the first relay group, similarly to the relay group information and the relay server information.

11. Participation in remote operation Next, when another client terminal is remotely operating a client terminal belonging to the same relay group as described above, another client terminal belonging to the same relay group can be remotely operated. The process of participating will be described.
Hereinafter, as shown in FIG. 11, when the third client terminal B1 remotely operates the fifth client terminal C2 via the first to third operation sessions, the second client terminal A2 that is a participating operation client terminal is Explain participating in remote operation. FIG. 11 shows an example of the established first to third operation sessions. As shown in FIG. 11, the first to third operation sessions 401A to 401C are established between the third client terminal B1 and the fifth client terminal C2 by the processing of FIGS. 9A, 9B, and 10.

11-1. Process of Participation Operation Client Terminal First, the process of the second client terminal A2 of the participation operation client terminal will be described with reference to FIGS. 12A to 12C. 12A to 12C are flowcharts showing the operation process of the participating operation client terminal.

  First, the operation control unit 232 of the second client terminal A2 accepts a search for the operated client terminal (step S161). Specifically, the relay server information 30 stored in the relay server information storage unit 242 is displayed on the display unit 224 in response to a remote operation instruction from the user. Alternatively, when there is remote operation information 40 stored in the remote operation information storage unit 244, the operation control unit 232 of the second client terminal A2 displays the remote operation information 40 on the display unit 224. The user selects a client terminal to be operated from among the client terminals indicated in the relay server information 30 or the remote operation information 40 displayed on the display unit 224.

  The user receives selection of the fifth client terminal C2 to be remotely operated via the operation input unit 225 (step S163).

  Thereafter, the operation control unit 232 of the second client terminal A2 confirms whether or not the fifth client terminal C2, which is the operated client terminal, is remotely operated (step S165). For example, the operation control unit 232 of the second client terminal A2 inquires of the third relay server C that is identified by the first relay server A that the fifth client terminal C2 is connected, and the fifth client terminal C2 Check if it is being operated.

  Here, when the fifth client terminal C2 is not remotely operated (No in step S165), the operation control unit 232 of the second client terminal A2 performs control as an operation client terminal. That is, the same processing as that of the third client terminal B1 which is the operation client terminal in FIGS. 9A and 9B is performed. Specifically, the operation control unit 232 of the second client terminal A2 transmits an operation request to the fifth client terminal C2 (step S167), and receives the permission response (Yes in step S171), the first An operation session is established with the relay server A (step 175). Thereafter, the operation control unit 232 of the second client terminal A2 performs the operation session established between the first relay server A, the operation session established between the first relay server A and the second relay server B, and the first 3 receives the image data from the fifth client terminal C2 through the operation session established between the relay server C and the fifth client terminal C2 (step S177), outputs the received image data to the display unit 224 It is displayed (step S179). Furthermore, since the operation control unit 232 of the second client terminal A2 is the only operation client terminal for the fifth client terminal C2, it has an exclusive operation right for the fifth client terminal C2 (Yes in step S181). Therefore, after that, in response to the occurrence of the operation event, the operation event is transmitted to the fifth client terminal C2 via the operation session (step S189, step S191), and the remote operation is performed.

On the other hand, when the fifth client terminal C2 is remotely operated (Yes in step S165), the operation control unit 232 of the second client terminal A2 sends the third relay inquired in step S165 via the first relay server A. It transmits to the server C (step S169). The operation participation request is a request for participating in an already executed remote operation.
If the operation control unit 232 of the second client terminal A2 receives a permission response regarding participation in remote operation from the third relay server C (Yes in step S171), the first participation operation session with the first relay server A is performed. 501A is established. At this time, a second participation operation session 501B is established between the first relay server A and the third relay server C.
On the other hand, when the permission response is not received from the third relay server C (No in Step S171), the operation control unit 232 of the second client terminal A2 executes error processing (Step S173), and ends the participation operation processing. .

After the first and second participating operation sessions 501A to 501B are established, the operation control unit 232 of the second client terminal A2 receives the image data from the third relay server C via the first relay server A (step S177). ). Subsequently, the operation control unit 232 of the second client terminal A2 outputs the received image data to the display unit 224 of the second client terminal A2, and displays it as an operation window (step S179).
Here, the image setting unit 233 of the second client terminal A2 executes a handshake process with the image setting unit 233 of the third client terminal B1 and the fifth client terminal C2, and performs the image information setting process. May be.

  Thereafter, the operation control unit 232 of the second client terminal A2 confirms whether the second client terminal A2 has an exclusive operation right for the fifth client terminal C2 (step S181). Specifically, the operation control unit 232 of the second client terminal A2 refers to the remote operation information 40 and confirms which operation client terminal is marked as “in operation”. In this example, in the remote operation information 40, since the third client terminal B1 is marked as “in operation”, the operation control unit 232 of the second client terminal A2 uses the exclusive operation right for the second client terminal A2. Is confirmed (No in step S181).

Subsequently, the operation control unit 232 of the second client terminal A2 determines whether there is an instruction from the user to acquire the exclusive operation right of the fifth client terminal C2 (step S183). For example, the operation control unit 232 of the second client terminal A2 displays the remote operation information 40 on the display unit 224 and presents that the second client terminal A2 does not have the exclusive operation right of the fifth client terminal C2. An instruction regarding acquisition of the exclusive operation right is received from the user.
If there is an instruction to acquire the exclusive operation right of the fifth client terminal C2 from the user (Yes in step S183), the operation control unit 232 of the second client terminal A2 sends the fifth client terminal to the third relay server C. A request for acquiring the exclusive operation right of C2 is transmitted (step S185).

  If the permission response for obtaining the exclusive operation right of the fifth client terminal C2 is received from the third relay server C (Yes in step S187), or if it is confirmed in step S181 that there is an exclusive operation right, the second The operation control unit 232 of the client terminal A2 proceeds to step S189. Thereafter, if an operation event occurs (Yes in step S189), the operation control unit 232 of the second client terminal A2 transmits the operation event to the third relay server C via the first relay server A (step S189). S191). Subsequently, when the operation control unit 232 of the second client terminal A2 receives a remote operation end instruction from the user (Yes in step S193), the control for disconnecting the operation session established with the fifth client terminal C2 is performed. (Step S195). At this time, the operation control unit 232 of the second client terminal A2 closes the operation window displayed on the display unit 224.

  On the other hand, if the operation control unit 232 of the second client terminal A2 does not receive a remote operation end instruction from the user (No in step S193), the operation control unit 232 returns to step S177 again to perform image data reception processing. At this time, when image difference information (described later) is received as image data, the second client terminal A2, for example, creates a composite image of the latest received image data and the image difference information, and displays the operation window. Update.

If there is no exclusive operation right acquisition instruction from the user in step S183 (No in step S183), or if an exclusive operation right acquisition permission response is not received from the third relay server C in step S187 ( In step S187, No), the operation control unit 232 of the second client terminal A2 monitors the remote operation. Specifically, the operation control unit 232 of the second client terminal A2 receives image data related to the remote operation of the fifth client terminal C2 by the third client terminal B1 (step S197), and displays the received image data on the display unit 224. And displayed as a monitoring window (step S199).
Thereafter, if an instruction to end monitoring is received from the user (Yes in step S201), the operation control unit 232 of the second client terminal A2 joins the first participating operation session 501A established with the first relay server A. Is cut (step S195). At this time, the second participation operation session 501B is also disconnected (step S195).

  On the other hand, if the monitoring end instruction is not received from the user (No in step S201), the remote operation end command from the third client terminal B1 is received from the third relay server C (Yes in step S203). The operation control unit 232 of the client terminal A2 returns to Step 181 again. That is, when the remote operation by the third client terminal B1 is completed, the second client terminal A2 can acquire the exclusive operation right for the remote operation of the fifth client terminal C2. Therefore, thereafter, the operation control unit 232 of the second client terminal A2 confirms that the second client terminal A2 has the exclusive operation right (Yes in Step S181), and proceeds to Step S189.

  On the other hand, when the remote operation end command has not been received from the third relay server C (No in step S203), the processing by the operation control unit 233 of the second client terminal A2 returns to step S197 again.

11-2. Processing of Operation Control Relay Server Next, processing when the operation control relay server to which the operated client terminal is connected receives an operation participation request will be further described with reference to FIGS. 13A to 13C. 13A to 13C are flowcharts showing the operation processing of the operation control relay server. In this example, the operation control relay server is the third relay server C.

  The operation control unit 132 of the third relay server C first determines whether an operation participation request has been received from the participation operation client terminal (step S211). Here, the operation participation request transmitted from the second client terminal A2 and relayed by the first relay server A is received. The join operation request received here is a join operation request for a remote operation executed between the third client terminal B1 and the fifth client terminal C2.

  When the requested operation participation can be permitted (Yes in step S213), the operation control unit 132 of the third relay server C transmits a permission response to the second client terminal A2 via the first relay server A. (Step S215). Here, if the requested operation participation cannot be permitted (No in step S213), the operation control unit 132 of the third relay server C sends an error response to the second client terminal A2 via the first relay server A. A reply is made (step S217), and the process is terminated.

  When the permission response is transmitted, the operation control unit 132 of the third relay server C next performs control for establishing the second participation operation session 501B with the first relay server A to which the second client terminal A2 is connected. (Step S219). At this time, a first participation operation session 501A is established between the second client terminal A2 and the first relay server A. In this embodiment, at this time, the operation control unit 133 of the third relay server C adds the account name of the second client terminal A2 as the operation client terminal to the remote operation information 40 stored in the remote operation information storage unit 144. Then, the remote operation information 40 is updated. Thereafter, the updated remote operation information 40 is shared between the relay server and the client terminal in the first relay group.

  Next, the operation control unit 132 of the third relay server C transmits an instruction to newly acquire screen data to the fifth client terminal C2 (step S221). As described above, there is a case where the image data is already shared between the fifth client terminal C2 and the third client terminal B1, and only a part of the shared image data is updated according to the operation event. . In this case, only the image difference information including the drawing position difference of the image to be subjected to difference as image data is relayed from the fifth client terminal C2 by the third relay server C and the second relay server B, and the third client terminal B1. Sent to. However, the second client terminal A2 participating in the remote operation does not have image data shared by the fifth client terminal C2 and the third client terminal B1. Therefore, in order to display the operation window on the display unit 224 of the second client terminal A2, it is not sufficient to receive the image difference information. Therefore, the operation control unit 132 of the third relay server C transmits an instruction to newly acquire all the new image data displayed in the operated window to the fifth client terminal C2.

  After acquiring the new screen data from the fifth client terminal C2, the operation control unit 132 of the third relay server C sends the newly acquired image data to the second client terminal A2 via the first and second participating operation sessions 501A to 501B. (Step S223). If image data such as image difference information is subsequently received from the fifth client terminal C2, the operation control unit 132 of the third relay server C copies the received image data to the first and second participating operation sessions 501A to 501A. The data is transmitted to the second client terminal A2 via 501B.

  Thereafter, the operation control unit 132 of the third relay server C determines whether or not an exclusive operation right acquisition request has been received from the second client terminal A2 (step S225). When the exclusive operation right acquisition request is received (Yes in step S225), the operation control unit 132 of the third relay server C transmits the exclusive operation right acquisition request to the operation client terminal that is operating. (Step S227). In this example, the operation control unit 132 of the third relay server C transmits an exclusive operation right acquisition request to the third client terminal B1 that is currently operating the fifth client terminal C2. If an exclusive operation right permission response is received from the third client terminal B1 (Yes in step S229), the operation control unit 132 of the third relay server C will receive the second client terminal A2 that is the exclusive operation right request source. A permission response is transmitted to (step S231). Subsequently, the operation control unit 132 of the third relay server C changes the exclusive operation right to the participating operation client terminal that has requested the exclusive operation right (step S233). In this example, the operation control unit 132 of the third relay server C changes the exclusive operation right for the fifth client terminal C2 from the third client terminal B1 to the second client terminal A2. Specifically, the operation control unit 132 of the third relay server C performs control to switch the third operation session 401C so as to accept operation events from the first and second participating operation sessions 501A to 501B. At this time, the operation control unit 133 of the third relay server C updates “status” in the remote operation information 40 stored in the remote operation information storage unit 144. Specifically, the “status” of the second client terminal A2 is updated to “in operation”, and the “status” of the third client terminal B1 is changed to blank. The updated remote operation information 40 is shared between the relay server and the client terminal in the first relay group.

  On the other hand, when the permission response is not received from the third client terminal B1 (No in Step S229), the operation control unit 132 of the third relay server C returns an error response to the requester of the exclusive operation right (Step S235). ). In this example, the operation control unit 132 of the third relay server C returns an error response to the second client terminal A2.

  After returning an error response to the second client terminal A2, the operation control unit 132 of the third relay server C next determines whether or not a remote operation end instruction has been received from the third client terminal B1 (step S237). . Similarly, when the exclusive operation right acquisition request has not been received from the second client terminal A2 (No in step S225), the operation control unit 132 of the third relay server C next remotely connects to the third client terminal B1. It is determined whether or not an operation end instruction is received.

  If the remote operation end instruction is received (Yes in step S237), the operation control unit 132 of the third relay server C determines whether there is another operation client terminal (step S239). Here, if there is no other operation client terminal (No in step S239), the operation control unit 132 of the third relay server C is connected to the third client terminal B1 and the fifth client terminal C2. Control is performed to disconnect the first to third operation sessions 501A to 301C (step S241).

  On the other hand, in the present embodiment, since the second client terminal A2 exists as the operation client terminal (Yes in step S239), the operation control unit 132 of the third relay server C ends the remote operation with respect to the second client terminal A2. The command is transmitted (step S243), and the process returns to step S125 again. That is, by transmitting a remote operation end command, the second client terminal A2 is notified of the end of the remote operation by the third client terminal B1, and the exclusive operation of the fifth client terminal C2 from the second client terminal A2 Determine whether to receive a request to acquire rights.

12 Effects of this Embodiment According to the relay communication system in this embodiment, a plurality of client terminals can be remotely operated with respect to one operated client terminal in the first relay group.

13. Other Embodiments Although one embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and various modifications can be made without departing from the scope of the invention. In particular, a plurality of embodiments and modifications described in this specification can be arbitrarily combined as necessary.

  (A) In the above embodiment, the operation control relay server has been described with an example in which the operated client terminal is connected to the relay server. However, the operation control relay server may be a relay server to which an operation client terminal is connected.

  (B) In the above example, the remote operation information 40 is created by the relay server to which the operated client terminal is connected at the timing when the operation session is established between the operating client terminal and the operated client terminal and the handshake process is performed. An example was given. However, the timing at which the remote operation information 40 is created is not limited to the above example, and may be the timing at which an operation event occurs, for example. Further, the remote operation information 40 may be created not by the relay server to which the operated client terminal is connected, but by the operation client terminal, the operated client terminal, or the relay server to which the operation client terminal is connected.

(C) In the above embodiment, the latest relay group information and relay server information are always shared among all relay servers and client terminals. However, the present invention is not limited to such an embodiment. For example, one of the relay servers may be a center terminal, and the center terminal may manage access rights between the relay servers.
(D) In the above embodiment, an example has been given in which the created and updated remote operation information 40 is shared between the relay server and the client terminal in the relay group.
However, the remote operation information 40 has only the operation client terminal, the operated client terminal, the relay server to which the operation client terminal is connected, and the relay server to which the operated client terminal is connected. 224 may be stored. Then, the participating operation client terminal may determine the remote operation to participate by referring to the relay server information 30 and inquiring whether any of the above terminals is being operated remotely.

  (E) In the above example, the remote operation information 40 has an example having information related to one remote operation “31”. However, a plurality of remote operations may be performed within the same relay group, and when a plurality of remote operations are performed, the remote operation information 40 may include information regarding a plurality of remote operations.

(F) Each relay server in which the operation session or the participating operation session is established may further store connection information in association with the remote operation information stored in the remote operation information storage unit. The connection information is information regarding an operation session or a participating operation session established for the relay server.
For example, in the above embodiment, the third relay server C, which is the operation control relay server, establishes the second operation session 401B, the third operation session 401C, and the second participation operation session 501B with respect to the third relay server C. Session information may be included.
Thus, since the 3rd relay server C has stored the connection information established with respect to the 3rd relay server C regarding remote operation information, the 3rd relay server C is the 3rd relay server. Even if C is a monitoring control relay server for a plurality of remote operations, it is possible to more appropriately identify the operation session established in the third relay server C and perform relay control of operation events and image data.
Each client terminal for which an operation session or a participating operation session is established associates connection information related to the operation session established for the client terminal with the remote operation information stored in the remote operation information storage unit. May be stored. For example, the fifth client terminal C2 may store connection information in which the third operation session 401C is established with respect to the fifth client terminal C2 in association with the remote operation information.

  (G) In the embodiment, the participation operation client terminal is the second client terminal A1, but the sixth client terminal B2 (not shown) may request the second remote operation. In that case, if the second relay server B accepts an operation participation request for remote operation from the sixth client terminal B2, which is a participation operation client terminal referring to the remote operation information, the operation participation request is transferred to the third relay server C. Relay, establish a first participation operation session with the sixth client terminal B2, establish a second participation operation session with the third relay server C, and the operation control unit 132 of the second relay server B The client terminal and the fifth client terminal which adjust the exclusive operation right of the remote operation for the fifth client terminal C2 and have the exclusive operation right of the remote operation after the adjustment among the fourth client terminal B1 and the sixth client terminal B2 Relays operation data of remote operation performed with C2.

(H) As another embodiment, in the relay communication system of FIG. 1, in addition to the fourth client terminal C1 and the fifth client terminal C2, a sixth client terminal C3 (not shown) is arranged in the third relay server C. Explain what was done.
The third relay server C is connectable to the second relay server B and the first relay server A via the WAN 4, and is connected to the fourth client terminal C1, the fifth client terminal C2, and the sixth client terminal C3 via the LAN. Connectable. The operation control unit 132 establishes a first operation session with the fourth client terminal C1 or the second relay server B as a first operation session establishment unit. In the operation control unit 132, the second operation session establishing unit establishes a second operation session with the fifth client terminal C2 or the first relay server A. The operation control unit 132 establishes an operated session with the sixth client terminal C3 as an operated session establishment unit. The operation control unit 132 further relays the operation event received from the operation session having the operation authority in the first operation session or the second operation session to the operated session, and receives the image data received from the operated session as the first operation session. Relay to the first operation session and the second operation session. As the operation authority changing unit, the operation control unit 132 changes the operation session having the operation authority based on the operation authority change request received from the first operation session or the second operation session.
In the above embodiment, in a relay communication system having a plurality of relay servers and a plurality of client terminals that can communicate with each other, a terminal other than the remotely operated terminal and the remotely operated terminal acquires the contents of the remote operation. Can do.

(I) Another embodiment will be described using the relay communication system of FIG.
The third relay server C can be connected to the second relay server B via the WAN 4, and can be connected to the fourth client terminal C 1 and the fifth client terminal C 2 via the LANs 19, 21 and 23. The operation control unit 132 establishes a first operation session with the fourth client terminal C1 as a first operation session establishment unit. The operation control unit 132 establishes a second operation session with the fifth client terminal C2 as a second operation session establishment unit. The operation control unit 132 establishes an operated session with the second relay server B as an operated session establishment unit. The operation control unit 132 relays the operation event received from the operation session having the operation authority in the first operation session or the second operation session to the operated session, and receives the image data received from the operated session as the first operation session. Relay to session and second operation session. As the operation authority changing unit, the operation control unit 132 changes the operation session having the operation authority based on the operation authority change request received from the first operation session or the second operation session.
In the above embodiment, in a relay communication system having a plurality of relay servers and a plurality of client terminals that can communicate with each other, a terminal other than the remotely operated terminal and the remotely operated terminal acquires the contents of the remote operation. Can do.

  The present invention can be widely applied to a relay communication system having a plurality of relay servers that can communicate with each other, a plurality of client terminals, and a LAN that connects the client terminals to the relay server, and a relay server used therefor.

1 First LAN
2 Second LAN
3 Third LAN
4 WAN
30 Relay server information 40 Remote operation information A 1st relay server B 2nd relay server C 3rd relay server A1 1st client terminal A2 2nd client terminal B1 3rd client terminal C1 4th client terminal C2 5th client terminal

Claims (7)

A first network;
A second network;
A first relay server connected to the first network;
A second relay server connected to the second network and capable of communicating with the first relay server via a third network;
A first client terminal connected to the first relay server via the first network;
A second client terminal and a third client terminal connected to the second relay server via the second network;
With
Each of the first relay server and the second relay server has an information sharing unit that shares the relay server information including the start information of the relay server itself and the start information and connection information of the client terminal connected to the relay server itself. And
The second relay server
A request to remotely operate the first client terminal selected as an operated client terminal with reference to the relay server information from the second client terminal that is an operation client terminal that performs remote operation, the second client terminal If a remote operation request including information on the terminal and the first client terminal is received, the first relay server to which the first client terminal is connected is specified, and the remote operation request is relayed to the first relay server. and the second to establish a first operation session between the client terminal establishes a relay server between sessions between the first relay server, before SL to the first client terminal by the second client terminal Operation events and image data as remote operation data are used as the first operation session and the relay server. A second operation control unit for relaying between the session,
The first relay server is
Upon receiving the remote control request from the second relay server, wherein the first client terminal to relay remote operation request, a second operation session is established between the first client terminal, before Symbol remote control A first operation control unit that relays the operation data between the relay server session and the second operation session and creates remote operation information including information on the first client terminal and the second client terminal. ,
When the second operation control unit receives an operation participation request for the remote operation from the third client terminal that is a participation operation client terminal that refers to the remote operation information, the second operation control unit is connected to the third client terminal. Establishing a participation operation session, relaying an operation event received from any one of the second client terminal and the third client terminal having an operation right to the first relay server; and Relay the image data received from the first client terminal and the third client terminal;
Relay communication system.   When adjusting the exclusive operation right, the second operation control unit transmits an exclusive operation right acquisition request for the remote operation received from the third client terminal to the second client terminal, and The relay communication system according to claim 1, wherein a permission response to the exclusive operation right acquisition request is received from a client terminal. A relay server that is communicable with a second relay server connected to the second network, is connected to the first network, and functions as a first relay server connected to the first client terminal via the first network. And
An information sharing unit for sharing the relay server information with the second relay server, including the relay server start information and the start information and connection information of the client terminal connected to the relay server;
A request to remotely operate the first client terminal selected with reference to the relay server information from a second client terminal connected to the second relay server, which is an operation client terminal that performs remote operation, If a remote operation request including information on the second client terminal and the first client terminal is received, the remote operation request is relayed to the first client terminal, and a session between relay servers is established with the second relay server. And establishing a second operation session with the first client terminal, establishing between the inter-relay server session, the second operation session, and between the second client terminal and the second relay server. remote Procedure to the first client terminal by said second client terminal first dividing line via the operation sessions An operation for relaying an operation event and image data as operation data of the remote server between the relay server session and the third operation session to create remote operation information including information on the first client terminal and the second client terminal A control unit,
If the operation control unit receives an operation participation request for the remote operation from a third client terminal that is a participation operation client terminal that refers to the remote operation information, the second relay server to which the third client terminal is connected And the second client terminal and the third client terminal based on the exclusive operation right of the remote operation with respect to the first client terminal adjusted by the second relay server. Relay the operation data of the remote operation performed between the client terminal having the exclusive operation right of the remote operation after the adjustment and the first client terminal,
The operation event is a relay server supplied from a client terminal having the exclusive operation right.   When adjusting the exclusive operation right, the first operation control unit transmits an exclusive operation right acquisition request for the remote operation received from the third client terminal to the second client terminal. The relay server according to claim 3, wherein a permission response to the exclusive operation right acquisition request is received from a client terminal. A first network;
A second network;
A third network;
A first relay server connected to the first network;
A second relay server connected to the second network and capable of communicating with the first relay server via a third network;
A third relay server connected to the three networks and capable of communicating with the first relay server and the second relay server;
A first client terminal connected to the first relay server via the first network;
A second client terminal connected to the second relay server via the second network;
A fifth client terminal connected to the third relay server via the third network;
With
The first relay server, the second relay server, and the third relay server share the relay server information including the startup information of the relay server itself and the startup information and connection information of the client terminal connected to the relay server itself. Has an information sharing unit
The second relay server
A request to remotely operate the first client terminal selected as an operated client terminal with reference to the relay server information from the second client terminal that is an operation client terminal that performs remote operation, the second client terminal If a remote operation request including information on the terminal and the first client terminal is received, the first relay server to which the first client terminal is connected is specified, and the remote operation request is relayed to the first relay server. and the second to establish a first operation session between the client terminal establishes a relay server between sessions between the first relay server, before SL to the first client terminal by the second client terminal Operation events and image data as remote operation data are used as the first operation session and the relay server. A second operation control unit for relaying between the session,
The first relay server is
Upon receiving the remote control request from the second relay server, wherein the first client terminal to relay remote operation request, a second operation session is established between the first client terminal, before Symbol remote control A first operation control unit that relays the operation data between the relay server session and the second operation session and creates remote operation information including information on the first client terminal and the second client terminal. ,
The third relay server has a third operation control unit capable of transmitting and receiving an operation participation request,
If the third operation control unit receives an operation participation request for the remote operation from the fifth client terminal that is a participation operation client terminal that refers to the remote operation information, the third operation control unit sends the operation participation request to the first relay server. And establish a first participation operation session with the fifth client terminal, establish a second participation session with the first relay server, and the first operation control unit includes the second client An operation event received from any one of the terminal and the fifth client terminal having an operation right is relayed to the first client terminal, and image data received from the first client terminal is relayed to the second client terminal And relay to the fifth client terminal,
Relay communication system. A first relay server connectable to the second relay server and the third relay server via the WAN, and connectable to the first client terminal, the second client terminal and the third client terminal via the LAN,
A first operation session establishing unit for establishing a first operation session with the first client terminal or the second relay server;
A second operation session establishing unit for establishing a second operation session with the second client terminal or the third relay server;
An operated session establishing unit for establishing an operated session with the third client terminal;
The operation event received from the operation session having the operation authority in the first operation session or the second operation session is relayed to the operated session, and the image data received from the operated session is relayed to the first operation session. And an operation control unit that relays to the second operation session;
An operation authority change unit that changes an operation session having an operation authority based on the operation authority change request received from the first operation session or the second operation session;
A first relay server. A first relay server connectable to the second relay server via the WAN and connectable to the first client terminal and the second client terminal via the LAN;
A first operation session establishing unit for establishing a first operation session with the first client terminal;
A second operation session establishing unit for establishing a second operation session with the second client terminal;
An operated session establishing unit for establishing an operated session with the second relay server;
The operation event received from the operation session having the operation authority in the first operation session or the second operation session is relayed to the operated session, and the image data received from the operated session is relayed to the first operation session. And an operation control unit that relays to the second operation session;
An operation authority change unit that changes an operation session having an operation authority based on the operation authority change request received from the first operation session or the second operation session;
A first relay server.

Images