JP6344370B2 - COMMUNICATION SYSTEM, SERVER DEVICE, CLIENT DEVICE, AND PROGRAM - Google Patents

Description

  The present invention relates to a technical field of a communication system in which a user operation input to a client device is notified to a server device via a network, and the server device executes processing according to the user operation.

  2. Description of the Related Art Conventionally, a system in which a server device executes processing according to a user operation input to a client device such as a thin client is known. The client device notifies the server of the input user operation using a predetermined protocol. The server device transmits information indicating the screen to the client device based on the execution result of the process according to the notified user operation. The client device displays a screen on the display based on the information received from the server device. For example, Patent Document 1 discloses that when a client connects to a server using TCP and a remote operation is performed, the client transmits an input event to the server using UDP (paragraph). [0058]).

JP 2015-49641 A

  However, various user operations are generally possible on the same screen. In this case, it may not be appropriate for the client device to notify the user operation using only a single protocol for all user operations. For example, when the user operation is notified by UDP as in the technique disclosed in Patent Document 1, the client device cannot recognize whether or not the server device has accepted the user operation. On the other hand, when the user operation is notified by TCP, the server device transmits a confirmation response to the client device when the user operation is accepted. The client device recognizes that the server device has accepted the user operation by receiving the confirmation response. However, the client apparatus transmits a packet notifying the next user operation after receiving the confirmation response. Therefore, the response time with respect to the user operation becomes long. In the case of UDP, since the confirmation response is not transmitted and received, the response time is shorter than in the case of TCP.

  The present invention has been made in view of the above points, and a client device uses a protocol suitable for each of a plurality of user operations possible on the same screen from a plurality of protocols. It is an object of the present invention to provide a communication system, a server device, a client device, and a program that can notify the user.

  In order to solve the above-described problem, the invention according to claim 1 is a client device to which a user operation is input and a server device to which the client device can be connected via a network, according to the user operation. In a communication system including a server device that executes processing, the server device is a first storage unit that stores a plurality of operation lists corresponding to a plurality of predetermined screens, and a plurality of devices corresponding to the corresponding screens First storage means for storing an operation list including operation information indicating a user operation and protocol information indicating a protocol corresponding to the user operation among a plurality of predetermined protocols, for each of the user operations; When the screen displayed by the client device is switched to any one of the plurality of screens, the first storage Of the plurality of operation lists stored in the means, an operation list transmission unit that transmits an operation list corresponding to the screen after switching to the client device, and an operation list transmitted by the operation list transmission unit Screen information transmitting means for transmitting screen information indicating a screen; and operation information receiving means for receiving operation information indicating a user operation input to the client apparatus from the client apparatus using a protocol determined by the client apparatus. The operation information receiving means for receiving the operation information using the protocol indicated by the protocol information corresponding to the operation information among the protocol information included in the operation list transmitted by the operation list transmitting means, and the operation According to the user operation indicated by the operation information received by the information receiving means And a second storage that stores the operation list received by the operation list receiving unit. The operation list receiving unit receives the operation list from the server device. Means, screen information receiving means for receiving the screen information transmitted from the server device, display means for displaying the screen indicated by the screen information received by the screen information receiving means, and user operations are input Input means; acquisition means for acquiring protocol information corresponding to operation information indicating the user operation input using the input means from the operation list stored in the second storage means; and the input Protocol information indicated by the protocol information acquired by the acquisition means among the plurality of protocols is indicated as operation information indicating a user operation. Characterized in that and an operation information transmitting means for transmitting to said server device by using a.

  According to a second aspect of the present invention, the client device includes the first client device including the operation list reception unit, the second storage unit, the input unit, the acquisition unit, and the operation information transmission unit, and the screen information. And a second client device comprising a receiving means and the display means.

  The invention according to claim 3 is characterized in that the client device is a thin client.

  According to a fourth aspect of the present invention, there is provided a client device to which a user operation is input, and a server device to which the client device can be connected via a network, and a server device that executes processing according to the user operation. In the server device included in the communication system, a first storage unit that stores a plurality of operation lists corresponding to a plurality of predetermined screens, and each of a plurality of user operations corresponding to the corresponding screens A first storage means for storing an operation list including operation information indicating a user operation and protocol information indicating a protocol corresponding to the user operation among a plurality of predetermined protocols; and displayed by the client device When the screen is switched to any one of the plurality of screens, the first storage means stores the Out of a plurality of operation lists, operation list transmission means for transmitting an operation list corresponding to the screen after switching to the client device, and screen information indicating a screen corresponding to the operation list transmitted by the operation list transmission means. Screen information transmitting means for transmitting and operation information receiving means for receiving operation information indicating a user operation input to the client device from the client device with a protocol determined by the client device, wherein the operation list is transmitted The operation information receiving means for receiving the operation information using the protocol indicated by the protocol information corresponding to the operation information among the protocol information included in the operation list transmitted by the means, and received by the operation information receiving means. Processing for executing processing according to user operation indicated by the operation information Characterized in that it comprises a stage, a.

  The invention according to claim 5 is characterized in that the plurality of protocols are a first protocol in which an acknowledgment is transmitted from the server device to the client device when the server device receives the operation information from the client device; And at least a second protocol in which the confirmation response is not transmitted.

  According to a sixth aspect of the present invention, the operation information receiving means is updated each time first operation information transmitted using the first protocol is transmitted among operation information transmitted by the client device. When the operation information to which the number is added is received and the second operation information transmitted using the second protocol among the operation information transmitted from the client device is received by the operation information receiving unit, A determination unit configured to determine whether or not the operation information receiving unit receives the first operation information added with a number that matches the number added to the second operation information; and the processing unit includes the determination unit When it is determined that the first operation information has not been received, the first operation information is received in response to the first operation information being received by the operation information receiving means. After executing the process corresponding to the user operation indicated by, and executes a process corresponding to the user operation indicated by the second operation information.

  The invention described in claim 7 is characterized in that the first protocol is TCP and the second protocol is UDP.

  According to an eighth aspect of the present invention, the plurality of protocols include a third protocol in which the operation information encrypted by the client device is transmitted from the client device to the server device, and the operation information that is not encrypted. And at least a fourth protocol transmitted from the client device to the server device.

  The invention according to claim 9 is characterized in that the third protocol is SSL.

  According to a tenth aspect of the present invention, there is provided a client device to which a user operation is input, and a server device to which the client device can be connected via a network, and a server device that executes processing according to the user operation. When a screen displayed by the client device is switched to any one of a plurality of predetermined screens on a computer included in the server device included in the communication system provided, the screen corresponds to the plurality of screens. First storage means for storing a plurality of operation lists, each of a plurality of user operations corresponding to a corresponding screen, operation information indicating a user operation and the user operation among a plurality of predetermined protocols Stored in a first storage means for storing an operation list including protocol information indicating a protocol corresponding to Out of a plurality of operation lists, an operation list transmission step for transmitting an operation list corresponding to the screen after switching to the client device, and screen information indicating a screen corresponding to the operation list transmitted by the operation list transmission step. A screen information transmission step for transmitting, and an operation information reception step for receiving operation information indicating a user operation input to the client device from the client device using a protocol determined by the client device, wherein the operation list transmission Of the protocol information included in the operation list transmitted in the step, the operation information receiving step for receiving the operation information using the protocol indicated by the protocol information corresponding to the operation information, and the operation information receiving step. The user operation indicated by the operation information Wherein the processing step of executing processing corresponding, that is execution.

  According to an eleventh aspect of the present invention, there is provided a client device to which a user operation is input, and a server device to which the client device can be connected via a network, and executes a process according to the user operation. In the client device included in the communication system provided, when a screen displayed by the client device is switched to any one of a plurality of predetermined screens, a plurality of screens corresponding to the plurality of predetermined screens A first storage means for storing a list of operations, and for each of a plurality of user operations corresponding to a corresponding screen, operation information indicating a user operation and the user operation among a plurality of predetermined protocols. Stored in a first storage means for storing an operation list including protocol information indicating a corresponding protocol. An operation list receiving means for receiving an operation list corresponding to the screen after switching from the number of operation lists, and a second storage means for storing the operation list received by the operation list receiving means; Acquisition means for acquiring protocol information corresponding to operation information indicating the user operation input using the input means, from an input means for inputting a user operation and the operation list stored in the second storage means And operation information transmission means for transmitting operation information indicating the input user operation to the server device using a protocol indicated by the protocol information acquired by the acquisition means among the plurality of protocols. It is characterized by that.

  According to a twelfth aspect of the present invention, there is provided a client device to which a user operation is input, and a server device to which the client device can be connected via a network, and a server device that executes processing according to the user operation. When a screen displayed by the client device is switched to any one of a plurality of predetermined screens on a computer included in the client device included in the communication system provided, the screen corresponds to the plurality of screens. First storage means for storing a plurality of operation lists, each of a plurality of user operations corresponding to a corresponding screen, operation information indicating a user operation and the user operation among a plurality of predetermined protocols Stored in a first storage means for storing an operation list including protocol information indicating a protocol corresponding to Of the plurality of operation lists, an operation list receiving step for receiving an operation list corresponding to the screen after switching from the server device, and the operation list received by the operation list receiving step are stored in a second storage unit. A second storage step; an acquisition step for acquiring protocol information corresponding to operation information indicating a user operation input using an input unit from the operation list stored in the second storage unit; and the input An operation information transmission step of transmitting operation information indicating a user operation to the server device using a protocol indicated by the protocol information acquired by the acquisition step among the plurality of protocols. .

  According to the first, third, fourth, tenth to twelfth aspects of the present invention, an operation list defining a protocol for each of a plurality of user operations corresponding to one screen is first stored for the plurality of screens. Stored in the means. When the screen displayed on the client device is switched, the server device transmits an operation list corresponding to the screen after switching to the client device. Based on the operation list received from the server device, the client device transmits operation information using a protocol corresponding to the input user operation among a plurality of protocols. Therefore, the client device can notify the server device of the user operation using a protocol suitable for each of a plurality of user operations that can be performed on the same screen from a plurality of protocols.

  According to the second aspect of the present invention, the process of transmitting operation information in response to a user operation and the process of displaying a screen are executed by different client devices. Therefore, the processing load related to the user interface can be distributed to the two client devices.

  According to the invention described in claim 5, the client device notifies the first protocol capable of confirming whether or not the server device has surely accepted, and the second protocol whose response time is shorter than the first protocol. Can be used according to the user operation.

  According to the invention described in each of claims 6 and 7, the client device transmits the operation information to which the number is added to the server device. Each time the client device transmits operation information using the first protocol, the client device updates the added number. When the client apparatus transmits operation information using the second protocol, the client apparatus does not update the added number. When the server device has received the operation information using the second protocol, but has not yet received the operation information added with the number that matches the number added to the operation information using the first protocol, The execution of the process corresponding to the user operation indicated by the operation information received using the second protocol is suspended. When the server apparatus receives operation information to which the same number is added using the first protocol, the server apparatus first executes a process corresponding to the user operation indicated by the operation information, and then performs the suspended process thereafter. Run. Therefore, the user operation is performed in the order of the process between the process corresponding to the user operation notified using the first protocol and the process corresponding to the user operation notified using the second protocol. Can be matched to the order.

  According to the invention described in each of claims 8 and 9, the client device can encrypt the user operation that needs to be concealed and notify the server device of it. In addition, the client apparatus can notify the user operation that does not need to be concealed without encrypting it, so that the response time can be shortened compared with the encryption.

(A) is a figure showing an example of outline composition of communications system S of one embodiment. (B) is a figure showing an example of outline composition of application server 1 of one embodiment. (C) is a diagram showing a schematic configuration example of the controller 2 of the present embodiment. (A) is a figure which shows the structural example of importance table DB6. (B) is a figure which shows the structural example of a state transition table. 6 is a sequence diagram showing an operation example of the communication system S. FIG. FIG. 4A is a flowchart illustrating an example of a controller reception process in the controller 2. FIG. 5B is a flowchart illustrating an example of user operation processing in the controller 2. FIG. 4A is a flowchart illustrating an example of a TCP reception process in the application server 1. (B) is a flowchart illustrating an example of a UDP reception process in the application server 1. It is a flowchart which shows an example of the operation order sort process in the application server. 4 is a flowchart illustrating an example of state machine processing in the application server 1.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[1. Configuration of communication system]
FIG. 1A is a diagram illustrating a schematic configuration example of the communication system S of the present embodiment. As shown in FIG. 1A, the communication system S includes an application server 1, a plurality of controllers 2, and a plurality of renderers 3. The application server 1 is an example of a server device of the present invention. The controller 2 is an example of a first client device of the present invention. The renderer 3 is an example of a second client device according to the present invention. The application server 1, the controller 2, and the renderer 3 are each connected to the network 10. The network 10 is configured by, for example, the Internet.

  The controller 2 and the renderer 3 may be thin clients. The controller 2 and the renderer 3 basically execute only processing related to the user interface. The application server 1 executes most other processes. The controller 2 executes processing related to user operations. The renderer 3 displays a moving image indicating a processing result by the application server 1. The controller 2 and the renderer 3 share processing related to the user interface, so that the processing load can be distributed.

  The application server 1 executes an application program in response to a request from the controller 2. Examples of application programs include application programs such as menus, drawings, karaoke, games, information retrieval, and online shopping. The application server 1 executes processing according to the user operation notified from the controller 2 according to the application program. Further, the application server 1 causes the renderer 3 to display a screen corresponding to the application program to be executed. Specifically, the application server 1 transmits at least a moving image out of moving images and audio corresponding to the execution of the application program to the renderer 3 by streaming using UDP. There may be one or more screens corresponding to one application program. For example, the menu application program is a program for the user to select an application program to be executed from among a plurality of application programs. When the menu application program is activated, selectable application program names are displayed as selectable menu items. For example, suppose that menu items include information retrieval, karaoke, online shopping, games, and drawing. In this case, the screen corresponding to the application program of the menu is the screen where the cursor is displayed over the information search item, the screen where the cursor is displayed over the karaoke item, and the cursor over the online shopping item. There are screens where the cursor is displayed over the game item and screens where the cursor is displayed over the drawing item. The application server 1 may switch the screen displayed on the renderer 3 by a user operation notified from the controller 2.

  The application server 1 is configured to be able to access an application DB (DataBase) 5 and an importance table DB 6. For example, the application server 1, the application DB 5, and the importance table DB 6 may be connected by a network such as a LAN (Local Area Network). Alternatively, the application server 1 may include an application DB 5 and an importance table DB 6. In the application DB 5, one or a plurality of application programs are registered. A plurality of importance tables are registered in the importance table DB6. The importance table is an example of the operation list of the present invention. The importance table is registered in the importance table DB 6 for each screen that can be displayed by the renderer 3 by executing the application program registered in the application DB 5. In the importance level table, importance levels corresponding to user operations are defined. The importance level indicates a protocol used when the controller 2 communicates with the application server 1. The importance is an example of protocol information of the present invention. When the screen displayed by the renderer 3 is switched, the application server 1 transmits an importance table corresponding to the screen after switching to the controller 2. Details of the importance table will be described later.

  The controller 2 accepts user operations. The controller 2 notifies the application server 1 of the received user operation via the network 10. Specifically, the controller 2 transmits a user operation including a key ID for identifying the user operation to the application server 1. At this time, the controller 2 refers to the importance table received from the application server 1 and acquires the importance corresponding to the user operation. The controller 2 transmits a user operation using a protocol indicated by the acquired importance. Therefore, the application server 1 receives a user operation using the same protocol as the protocol used by the controller 2. Based on the importance table, the application server 1 is notified of the user operation by an appropriate protocol according to the user operation. Examples of the controller 2 include a remote controller that can be connected to the network 10, a smartphone, a mobile phone, and a portable game machine.

  The renderer 3 receives from the application server 1 at least a moving image out of a moving image and sound indicating the execution result of the application program. When the moving image indicating the execution result is received, the renderer 3 displays the received moving image on the display. When the voice indicating the execution result is received, the renderer 3 outputs the received voice through the speaker. Examples of the renderer 3 include a television receiver such as a smart TV, a personal computer, and a karaoke device.

  The user uses an application program by combining the controller 2 and the renderer 3. That is, the user operates the controller 2 to cause the application server 1 to execute the application program, and uses the renderer 3 to check the execution result of the application program.

  The communication system S may or may not include the integrated client 4 having the functions of the controller 2 and the renderer 3. Examples of the integrated client 4 include a television receiver and a personal computer.

[2. Configuration of Application Server 1]
Next, the configuration of the application server 1 will be described with reference to FIG. FIG. 1B is a diagram illustrating a schematic configuration example of the application server 1 of the present embodiment. As shown in FIG. 1B, the application server 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a storage unit 14, a communication unit 15, and the like. Composed. These components are connected to the bus 16. The communication unit 15 is connected to the network 10. The storage unit 14 is configured by, for example, a hard disk drive. The storage unit 14 stores a plurality of moving image data. Each moving image data is data for displaying a moving image representing a screen displayed by the renderer 3. Each moving image data is stored in association with a moving image ID. The moving image ID is identification information for identifying moving image data. Further, the storage unit 14 stores a state transition table. Details of the state transition table will be described later. The storage unit 14 may store at least one of the application DB 5 and the importance level table DB 6. The storage unit 14 stores an OS, a server program, and the like. The server program is a program that causes the CPU 11 as a computer to execute processing such as transmission of an importance table, execution of an application program, and transmission of a moving image indicating an execution result of the application program. The server program or the like may be downloaded from another server or the like via the network 10 or the like, for example. Alternatively, the server program or the like may be recorded on a recording medium such as an optical disc, a magnetic tape, or a memory card and read into the storage unit 14 via a drive device.

[3. Configuration of controller 2]
Next, the configuration of the controller 2 will be described with reference to FIG. FIG. 1C is a diagram illustrating a schematic configuration example of the controller 2 of the present embodiment. As shown in FIG. 1C, the controller 2 includes a CPU 21, a ROM 22, a RAM 23, a storage unit 24, a communication unit 25, an input unit 26, a display unit 27, and the like. These components are connected to the bus 28. The communication unit 25 is connected to the network 10. The input unit 26 is an input device for inputting a user operation. The input unit 26 may be configured by at least one of a button, a key, a touch panel, a keyboard, and the like, for example. The display unit 27 is a display configured by, for example, a liquid crystal panel, an organic EL panel, or the like. The RAM 23 is an example of a second storage unit of the present invention. The RAM 23 stores an importance table received from the application server 1 by the controller 2. The storage unit 24 is configured by, for example, a flash memory or a hard disk drive. The storage unit 24 stores an OS, a controller program, and the like. The controller program is a program that causes the CPU 21 as a computer to execute processing such as reception and storage of an importance table, display of an operation screen, execution of processing according to a user operation, transmission of a request to the application server 1, and the like. . The controller program or the like may be downloaded from a server device such as the application server 1 via the network 10 or the like, for example. Alternatively, the controller program or the like may be recorded on a recording medium such as an optical disk, a magnetic tape, or a memory card and read into the storage unit 24 via a drive device. Alternatively, the controller program or the like may be installed in the controller 2 in advance.

[4. Importance table, state transition table]
FIG. 2A is a diagram illustrating a configuration example of the importance degree table DB6. In the importance level table, importance levels corresponding to user operations are defined. In the importance table DB6, an importance table is registered for each screen on which the renderer 3 can be displayed. Depending on the user operation, the screen displayed by the renderer 3 may be switched to another screen. In the present embodiment, a state machine is defined as a model of the behavior of the application server 1 with respect to user operations. It is defined that the screen is switched by the state transition in the state machine. Accordingly, since the state and the screen correspond one-to-one, the importance table is registered for each state. Only one state (that is, only one screen) may exist for one application program, or a plurality of states (that is, a plurality of screens) may exist. The importance level table is created by the administrator of the communication system S, for example.

  As shown in FIG. 2A, each importance table registered in the importance table DB 6 includes a state ID. The state ID is identification information for identifying a state in the state machine and identification information for identifying a screen corresponding to the state.

  Each importance table further includes a plurality of key IDs. The key ID is an example of user operation information according to the present invention. The key ID is identification information for identifying a user operation that can be performed by the user on the screen indicated by the corresponding state ID. The user operation indicated by the key ID not listed in the importance table is invalid. Basically, multiple types of user operations are possible on one screen. In the present embodiment, the key ID indicates a key pressed by the user. This key may be a key provided in the controller 2, for example. Further, for example, this key may be a key displayed on the display unit 27 of the controller 2. For example, the user can press a key displayed on the display unit 27 by operating a touch panel, a mouse, a keyboard, or the like.

  Further, each importance table includes importance for each key ID. The importance level indicates a protocol used for the controller 2 to transmit a packet including the corresponding key ID to the application server 1. The protocol may be, for example, a transport layer protocol, an application layer protocol, or the like. A plurality of protocols that can be used for packet transmission may be predetermined by the administrator of the communication system S.

  For example, a plurality of protocols include a first protocol in which an ACK (acknowledgment response) is transmitted from the application server 1 to the controller 2 when the application server 1 receives a key ID from the controller 2, and a second protocol in which no ACK is transmitted. You may include at least. In this case, the controller 2 uses the first protocol that can confirm whether or not the application server 1 has been received reliably and the second protocol that has a shorter response time than the first protocol, depending on the user operation to be notified. be able to. For example, the first protocol is set for a user operation in which priority is given to the application server 1 receiving the notification reliably over the short response time. The second protocol is set for a user operation in which a short response time is prioritized over the application server 1 reliably receiving a notification. The first protocol may be, for example, TCP (Transmission Control Protocol). The second protocol may be, for example, UDP (User Datagram Protocol).

  For example, a plurality of protocols include a third protocol in which a key ID encrypted by the controller 2 is transmitted from the controller 2 to the application server 1, and a fourth protocol in which an unencrypted key ID is transmitted from the controller 2 to the application server 1. And at least. Thereby, the controller 2 can encrypt and notify the user operation which needs to be kept secret. Moreover, the controller 2 can shorten the response time compared with the encryption by notifying the user operation that does not need to be concealed without the encryption. For example, on the screen for entering a personal identification number, numeric keys "0" to "9" for inputting and transmitting the personal identification number, input keys for confirming the personal identification number, and a menu for displaying a menu Assume that the key can be pressed. In this case, a third protocol may be set for each numeric key. A fourth protocol may be set for the input key and the menu key. The third protocol may be, for example, SSL (Secure Socket Layer). SSL in this case represents the Secure Socket Layer Over Transmission Control Protocol in more detail. The fourth protocol may be, for example, TCP or UDP whose application layer protocol is not an encryption protocol.

  In the example of the importance table shown in FIG. 2A, “0” or “1” is set as the importance. For example, importance “0” indicates UDP, and importance “1” indicates TCP. Three or more types of protocols may be settable. For example, importance “0” may indicate UDP, importance “1” may indicate TCP, and importance “2” may indicate SSL.

  With the importance table as described above, the controller 2 can notify the application server 1 of a user operation using a protocol suitable for each of a plurality of user operations possible on the same screen from a plurality of protocols. .

  FIG. 2B is a diagram illustrating a configuration example of the state transition table. The state transition table defines, for each combination of the state before the transition and the state after the transition, a user operation that is a condition for causing the state transition in the state machine.

  As shown in FIG. 2B, a previous state ID is set for each cell in the first column of the state transition table. The previous state ID is a state ID indicating a state before transition, that is, a current state. A post-state ID is set for each cell in the first row of the state transition table. The rear state ID is a state ID indicating the state after the transition. A key ID and a moving image ID are set in some of the other cells excluding these cells. The key ID set for the cell of interest corresponds to the condition for transition from the state indicated by the previous state ID corresponding to the row of the cell of interest to the state indicated by the subsequent state ID corresponding to the column of the cell of interest. User operation to be performed. In the example of FIG. 2B, the key ID “no operation” indicates a case where no operation is performed. The moving image ID set in the cell of interest is displayed in the renderer 3 when transitioning from the state indicated by the previous state ID corresponding to the row of the cell of interest to the state indicated by the subsequent state ID corresponding to the column of the cell of interest. Indicates the video to be displayed. In the present embodiment, a moving image is displayed on the renderer 3 based on the moving image data. Therefore, a video that does not actually move at all is also called a video. However, when the video indicated by the moving image ID does not move at all, the video may be a still image.

  For example, in FIG. 2B, a key ID indicating no operation and a moving image ID of moving image 1 are set in a cell corresponding to the previous state ID indicating state ST1 and the subsequent state ID indicating state ST1. This indicates that, when the user does not perform any operation when the current state is ST1, the state transition does not substantially occur and the moving image 1 is displayed on the renderer 3. Movie 1 represents a screen corresponding to state ST1. In a cell corresponding to the previous state ID indicating the state ST1 and the subsequent state ID indicating the state ST2, the key ID indicating the right key and the moving image ID of the moving image A are set. This indicates that if the user presses the right key when the current state is ST1, the current state transitions from the state ST1 to the state ST2, and the moving image A is displayed on the renderer 3. Movie A is a movie showing how the screen changes from the screen corresponding to state ST1 to the screen corresponding to state ST2. The key ID and the moving image ID are not set in the cells corresponding to the previous state ID indicating the state ST1 and the subsequent state ID indicating the state ST3. Therefore, there is no direct transition from state ST1 to state ST3.

[5. Communication method using first protocol and second protocol]
Next, an example of a communication method between the application server 1 and the controller 2 when the first protocol and the second protocol are used will be described. TCP is used as an example of the first protocol, and UDP is used as an example of the second protocol. In the importance table, the importance of UDP is set to “0”, and the importance of TCP is set to “1”.

  When notifying the user operation, the controller 2 transmits a packet including a key ID indicating the user operation to the application server 1. At this time, the controller 2 may add the entire sequence number and the TCP sequence number to the transmitted key ID.

  The overall sequence number is a number that is updated each time the controller 2 transmits a key ID regardless of whether TCP or UDP is used. For example, the overall sequence number may be incremented by one. The overall sequence number indicates the order in which user operations are input to the controller 2.

  The TCP sequence number is a number that is updated each time the controller 2 transmits a key ID using TCP. For example, the TCP sequence number may be increased by one. The TCP sequence number indicates the order in which user operations corresponding to the importance “1” should be processed by the application server 1. The controller 2 is important during the period from when the key ID indicating the user operation corresponding to the importance level “1” is transmitted using TCP until the ACK corresponding to the transmission of the key ID is received from the application server 1. The user operation input corresponding to the degree “1” is not accepted. Thereby, the order in which the user operations corresponding to the importance “1” are processed is maintained. Even if the key ID is transmitted using UDP, the TCP sequence number is not updated. After transmitting the key ID indicating the user operation corresponding to the importance “1”, the controller 2 receives the input of the user operation corresponding to the importance “0” without receiving an ACK for the key ID. And the controller 2 transmits key ID which shows the received user operation to the application server 1 using UDP. Thereby, the response time can be shortened. However, the application server 1 sets the key ID indicating the user operation corresponding to the importance “0” transmitted later before the key ID indicating the user operation corresponding to the importance “1” transmitted earlier. There is a possibility of receiving. Therefore, when the application server 1 processes the user operations in the order in which the key IDs are received, the processing order between the user operation corresponding to the importance “1” and the user operation corresponding to the importance “0” is maintained. I can't.

  Therefore, the application server 1 uses the TCP sequence number added to the received key ID. Specifically, when the application server 1 receives a key ID transmitted using UDP, the key ID with the same TCP sequence number added to the key ID already uses TCP. Is received. When the key ID to which the same TCP sequence number is added is received using TCP, the application server 1 immediately executes a process corresponding to the user operation indicated by the key ID received using UDP. When the key ID to which the same TCP sequence number is added has not been received using TCP, the application server 1 suspends processing corresponding to the user operation indicated by the key ID received using UDP. When the key ID to which the same TCP sequence number is added is received using TCP, the application server 1 executes processing corresponding to the user operation indicated by the received key ID. Thereafter, the application server 1 executes a process according to the user operation indicated by the key ID received using UDP that has been suspended. Thereby, the order of processing between the user operation corresponding to the importance “1” and the user operation corresponding to the importance “0” can be maintained. When there are a plurality of user operations whose processes are suspended, the application server 1 may execute the suspended processes in the order of the entire sequence numbers. In this case, the order of processing between user operations corresponding to the importance “0” is maintained. Note that the order of processing between user operations corresponding to the importance “0” may not be maintained.

  When a user operation corresponding to the importance “1” is performed, the state in the state machine changes, and when a user operation corresponding to the importance “0” is performed, the state transition table is set so that the state does not change. It is assumed that it has been created. Therefore, the screen is switched only when a user operation corresponding to the importance “1” is performed.

  FIG. 3 is a sequence diagram illustrating an operation example of the communication system S of the present embodiment. For example, when the controller 2 connects to the application server 1 using TCP, the application server 1 sets the current state to the initial state. The initial state is a state corresponding to a menu screen for selecting an application program, for example. The application server 1 transmits an importance table corresponding to the current state to the controller 2 (step S1). In this importance table, up, down, left and right direction keys, a circle mark key and a cross mark key are defined. On the menu screen, the direction key is a key for moving the cursor on the menu. The circle key is a key for starting an application program corresponding to the menu item where the cursor is currently positioned. The cross mark key is a key for ending the menu screen. Importance “1” is set for each key. Such importance setting is based on the idea that operations on the menu need to be processed by the application server 1 in order and reliably. For example, the application server 1 starts transmitting a moving image of a menu screen on which a cursor is displayed on a menu item indicating information retrieval to the renderer 3 (step S2). The renderer 3 displays a menu screen. After starting the transmission of the moving image, the application server 1 transmits an ACK for the connection from the controller 2 to the controller 2 (step S3).

  After receiving ACK, the user presses the left key of the controller 2. Then, the controller 2 transmits a packet including the entire sequence number “1”, the TCP sequence number “1”, and the key ID “left” to the application server 1 using TCP (step S4). The application server 1 changes the state according to the state transition table corresponding to the left key. The state after the transition is a state corresponding to a menu screen in which a cursor is displayed on the menu item indicating karaoke, for example, one left of the menu item indicating information search. The contents of the importance table are the same on all menu screens. That is, between menu screens, although the position of the cursor on the menu is different, the user operations that can be input and the importance levels for the user operations match. Therefore, when the content of the importance table does not change even when the state changes, the application server 1 does not need to transmit the importance table to the controller 2. In response to the left key, the application server 1 transmits to the renderer 3 a moving image in which the cursor displayed on the menu moves to the left (step S5). The application server 1 transmits ACK to the controller 2 (step S6). Next, the application server 1 continues the moving image transmission of the menu screen after the cursor is moved.

  After receiving ACK, the user presses the left key again. Then, the controller 2 transmits a packet including the entire sequence number “2”, the TCP sequence number “2”, and the key ID “left” to the application server 1 using TCP (step S7). The application server 1 changes the state according to the state transition table corresponding to the left key. The state after the transition is a state corresponding to a menu screen in which a cursor is displayed on a menu item indicating a drawing on the left of the menu item indicating karaoke, for example. The application server 1 transmits a moving image in which the cursor displayed on the menu further moves to the left to the renderer 3 (step S8). Then, the application server 1 transmits ACK to the controller 2 (step S9).

  After receiving ACK, the user presses the circle key. Then, the controller 2 transmits a packet including the entire sequence number “3”, the TCP sequence number “3”, and the key ID “maru” to the application server 1 using TCP (step S10). The application server 1 changes the state according to the state transition table. The state after the transition is a state corresponding to, for example, a drawing screen. The application server 1 transmits an importance table corresponding to the state after the transition to the controller 2 (step S11). In this importance table, up, down, left and right direction keys, a cross mark key and a triangle mark key are defined. In addition, the importance table defines the simultaneous pressing of the up key and the circle key, the simultaneous pressing of the down key and the circle key, the simultaneous pressing of the left key and the circle key, and the simultaneous pressing of the right key and the circle key. ing. On the drawing screen, the direction key is a key for moving the cursor. The simultaneous pressing of the direction key and the circle key is an operation for drawing a line at the cursor position while moving the cursor. The triangle mark key is a key for changing a color for drawing a line. The cross key is a key for ending drawing. The importance “1” is set for the cross mark key and the triangle mark key. The importance “0” is set for the other keys. With this importance setting, the cursor movement and drawing operations in drawing do not have a big effect even if the order is changed or some operations are not processed, and priority is given to shortening the response time. Based on thought. After transmitting the importance, the application server 1 starts a drawing application program. Further, the application server 1 transmits, from the menu screen, for example, a moving image that switches to a drawing screen whose color currently selected for drawing a line is white to the renderer 3 (step S12). Then, the application server 1 transmits ACK to the controller 2 (Step 13).

  The user presses the left key and the circle key simultaneously. The importance corresponding to this operation is “0”. The controller 2 transmits a packet including the entire sequence number “4”, the TCP sequence number “3”, and the key ID “left + maru” to the application server 1 using UDP (step S14). Because of UDP, the TCP sequence number is not updated. The current state does not change. Accordingly, the application server 1 continues to transmit the moving picture on the drawing screen to the renderer 3 (step S15). However, the application server 1 transmits a moving image in which the cursor moves to the left and a line is drawn on the drawing screen to the renderer 3, but receives the key ID by UDP, so the application server 1 does not transmit ACK.

  Next, the user presses the up key and the circle key simultaneously. The importance corresponding to this operation is “0”. The controller 2 transmits a packet including the entire sequence number “5”, the TCP sequence number “3”, and the key ID “upper + maru” to the application server 1 using UDP (step S16). The application server 1 transmits to the renderer 3 a moving image of a drawing screen on which a line is drawn by moving the cursor upward (step S17).

  Next, the user presses the triangle key. The importance corresponding to this operation is “1”. The controller 2 transmits a packet including the entire sequence number “6”, the TCP sequence number “4”, and the key ID “thank you” to the application server 1 using TCP (step S18). Next, the user simultaneously presses the right key and the circle key. The importance corresponding to this operation is “0”. The controller 2 transmits a packet including the entire sequence number “7”, the TCP sequence number “4”, and the key ID “right + maru” to the application server 1 using UDP (step S19).

  Here, the application server 1 receives the packet including the key ID “Right + Mal” first and the packet including the key ID “Right + Mal” out of the packet including the key ID “Sankaku”. The TCP sequence number added to this key ID is “4”. The application server 1 receives the key IDs to which the TCP sequence numbers “1” to “3” are added in steps S4, S7, and S10 using TCP. However, the application server 1 has not received the key ID “thank you” with the TCP sequence number “4” added using TCP. Therefore, the application server 1 suspends the process of moving the cursor to the right and drawing a line.

  Thereafter, the application server 1 receives the key ID “sankaku”. Then, the application server 1 makes a state transition according to the state transition table. The state after the transition is a state corresponding to a drawing screen for drawing a red line. The application server 1 transmits to the renderer 3 a moving image of a drawing screen in which the color used for line drawing changes from white to red (step S20). Next, the application server 1 transmits ACK to the controller 2 (step 21). Next, the application server 1 transmits to the renderer 3 a moving image of a drawing screen in which the cursor moves to the left and a line is drawn (step S22).

  The user presses the cross key. Then, the controller 2 transmits a packet including the entire sequence number “8”, the TCP sequence number “5”, and the key ID “X” to the application server 1 using TCP (step S23). The application server 1 changes the state according to the state transition table. The state after the transition is a state corresponding to the menu screen. The application server 1 transmits an importance table corresponding to the state after the transition to the controller 2 (step S24). Next, the application server 1 transmits a moving image that switches from the drawing screen to the menu screen to the renderer 3 (step S25). Then, the application server 1 transmits ACK to the controller 2 (step 26).

[6. Operation of communication system S]
Next, the operation of the communication system S of the present embodiment will be described with reference to FIGS. FIG. 4A is a flowchart illustrating an example of a controller reception process in the controller 2. When the controller program is activated, the CPU 21 of the controller 2 executes controller reception processing. First, the CPU 21 generates a TCP socket, and then connects to the TCP socket on the application server 1 side (step S31). Moreover, CPU21 produces | generates a UDP socket. Next, the CPU 21 sets the overall sequence number to 1 (step S32). The TCP sequence number is set to 1 (step S33). Next, the CPU 21 determines whether or not the controller program ends (step S34). At this time, if the CPU 21 determines that the controller program does not end (step S34: NO), the CPU 21 proceeds to step S35.

  In step S35, the CPU 21 reads the data transmitted from the application server 1 from the TCP socket. Next, the CPU 21 determines whether or not the read data is an importance table (step S36). At this time, if the CPU 21 determines that the read data is an importance table (step S36: YES), the CPU 21 proceeds to step S37. On the other hand, when the CPU 21 determines that the read data is not the importance table (step S36: NO), the CPU 21 proceeds to step S38.

  In step S37, the CPU 21 updates the importance table. Specifically, when an old importance table is stored in the RAM 23, the CPU 21 deletes the importance table. The CPU 21 stores the importance table received this time in the RAM 23. When this process is finished, the CPU 21 proceeds to step S34.

  In step S38, the CPU 21 determines whether or not the read data is ACK. At this time, if the CPU 21 determines that the read data is ACK (step S38: YES), the CPU 21 proceeds to step S39. On the other hand, when the CPU 21 determines that the read data is not ACK (step S38: NO), the CPU 21 proceeds to step S34.

  In step S39, the CPU 21 sets the key operation transmission flag to FALSE. Next, the CPU 21 proceeds to step S34. In step S34, if the CPU 21 determines that the controller program ends (step S34: YES), the CPU 21 ends the controller reception process.

  FIG. 4B is a flowchart illustrating an example of user operation processing in the controller 2. When the controller program is activated, the CPU 21 of the controller 2 executes user operation processing. First, the CPU 21 determines whether or not the controller program ends (step S41). At this time, if the CPU 21 determines that the controller program does not end (step S41: NO), the CPU 21 proceeds to step S42.

  In step S <b> 42, the CPU 21 acquires the key ID of the key pressed by the user as the user operation input to the input unit 26. Next, the CPU 21 acquires the importance corresponding to the acquired key ID from the importance table stored in the RAM 23 (step S43). Next, the CPU 21 determines whether or not the acquired importance is “1” (step S44). At this time, if the CPU 21 determines that the importance is “1” (step S44: YES), the CPU 21 proceeds to step S45. On the other hand, when the CPU 21 determines that the importance is not “1” (step S44: NO), the CPU 21 proceeds to step S49.

  In step S45, the CPU 21 determines whether or not the key operation transmission flag is FALSE. At this time, if the CPU 21 determines that the key operation transmission flag is FALSE (step S45: YES), the CPU 21 proceeds to step S46. On the other hand, if the CPU 21 determines that the key operation transmission flag is not FALSE (step S45: NO), the CPU 21 proceeds to step S41.

  In step S46, the CPU 21 sets a key operation transmission flag to TRUE. Next, the CPU 21 writes the acquired key ID, overall sequence number, and TCP sequence number in the TCP socket (step S47). Thereby, the CPU 21 transmits a packet including the key ID, the entire sequence number, and the TCP sequence number to the application server 1 using TCP. Next, the CPU 21 increments the TCP sequence number by 1 (step S48), and proceeds to step S50.

  In step S49, the CPU 21 writes the acquired key ID, overall sequence number, and TCP sequence number in the UDP socket. Thereby, the CPU 21 transmits a packet including the key ID, the entire sequence number, and the TCP sequence number to the application server 1 using UDP. Next, the CPU 21 proceeds to step S50.

  In step S50, the CPU 21 increments the overall sequence number by 1, and proceeds to step S41. In step S41, if the CPU 21 determines that the controller program ends (step S41: YES), the CPU 21 ends the user operation process.

  FIG. 5A is a flowchart illustrating an example of a TCP reception process in the application server 1. When the server program is activated, the CPU 11 of the server program 1 executes a TCP reception process. First, the CPU 11 generates a TCP socket and executes a preparation process for waiting for a connection from the controller 2 (step S51). Next, the CPU 11 waits for a connection from the controller 2 (step S52). Next, when connected to the controller 2, the CPU 11 reads out the packet data received from the controller 2 from the TCP socket (step S53). Next, the CPU 11 transfers the read packet to an operation order sorting process to be described later (step S54). Next, the CPU 11 determines whether or not the server program ends (step S55). At this time, if the CPU 11 determines that the server program does not end (step S55: NO), the CPU 11 proceeds to step S53. On the other hand, if the CPU 11 determines that the server program ends (step S55: YES), the CPU 11 ends the TCP reception process.

  FIG. 5B is a flowchart illustrating an example of the UDP reception process in the application server 1. When the server program is activated, the CPU 11 of the server program 1 executes a UDP reception process. First, the CPU 11 generates a UDP socket (step S61). Next, the CPU 11 reads out the packet data transmitted from the controller 2 from the UDP socket (step S62). Next, the CPU 11 transfers the read packet to the operation order sorting process (step S63). Next, the CPU 11 determines whether or not the server program ends (step S64). At this time, if the CPU 11 determines that the server program does not end (step S64: NO), the CPU 11 proceeds to step S62. On the other hand, if the CPU 11 determines that the server program is terminated (step S64: YES), it terminates the UDP reception process.

  FIG. 6 is a flowchart illustrating an example of the operation order sorting process in the application server 1. When the server program is activated, the CPU 11 of the server program 1 executes an operation order sorting process. First, the CPU 11 sets the latest TCP sequence number t of the TCP packet to 1 (step S71). Next, the CPU 11 determines whether or not the server program ends (step S72). At this time, if the CPU 11 determines that the server program does not end (step S72: NO), the CPU 11 proceeds to step S73. In step S73, the CPU 11 stands by until a packet is transferred from the TCP reception process or the UDP reception process. When the packet is transferred, the CPU 11 determines whether or not the transferred packet is a UDP packet. Based on the IP header of the packet, it can be determined whether or not the packet is a UDP packet. When the CPU 11 determines that the transferred packet is a UDP packet (step S73: YES), the CPU 11 proceeds to step S74. On the other hand, when the CPU 11 determines that the transferred packet is not a UDP packet (step S73: NO), the CPU 11 proceeds to step S77.

  In step S74, the CPU 11 determines whether or not the TCP sequence number included in the packet matches t. At this time, if the CPU 11 determines that the TCP sequence number matches t (step S74: YES), the CPU 11 proceeds to step S75. On the other hand, if the CPU 11 determines that the TCP sequence number does not match t (step S74: NO), the CPU 11 proceeds to step S76.

  In step S75, the CPU 11 inputs a key ID included in the acquired packet into a state machine process described later, and proceeds to step S72. In step S76, the CPU 11 adds the packet to the queue secured in the RAM 13, and proceeds to step S72.

  In step S77, the CPU 11 sets t to the TCP sequence number included in the packet. Next, the CPU 11 inputs a key ID included in the acquired packet into a state machine process described later (step S78). Next, the CPU 11 acquires a packet whose TCP sequence number included in the packet matches t among the packets added to the queue (step S79). Next, the CPU 11 inputs the key ID included in the acquired packet to the state machine process (step S80). When a plurality of packets are acquired, the CPU 11 selects these packets in the order of the entire sequence numbers included in the packets. Input to state machine processing. Then, the CPU 11 proceeds to step S72. In step S72, if the CPU 11 determines that the server program ends (step S72: YES), the CPU 11 ends the operation order sorting process.

  FIG. 7 is a flowchart illustrating an example of state machine processing in the application server 1. When the server program is activated, the CPU 11 of the server program 1 executes state machine processing. First, the CPU 11 determines whether or not the server program ends (step S81). At this time, if the CPU 11 determines that the server program does not end (step S81: NO), the CPU 11 proceeds to step S82. In step S82, the CPU 11 obtains the key ID input from the operation order sorting process. When the key ID is not input from the operation order sorting process, the CPU 11 acquires the key ID “no operation”. Next, the CPU 11 acquires the current state ID as the state ID of the previous state SA (step S83). Next, the CPU 11 acquires the importance table TA corresponding to the state ID of the state SA from the importance table DB 6 (step S84). Next, the CPU 11 specifies the state ID of the previous state SA and the subsequent state SB corresponding to the key ID included in the acquired packet from the state transition table. Then, the CPU 11 changes the current state from the state SA to the state SB (step S85). Next, the CPU 11 determines whether or not the state SA and the state SB match (step S86). At this time, if the CPU 11 determines that the state SA and the state SB match (step S86: YES), the CPU 11 proceeds to step S87. On the other hand, if the CPU 11 determines that the state SA and the state SB do not match (step S86: NO), the CPU 11 proceeds to step S88.

  In step S87, the CPU 11 acquires the moving image IDs corresponding to the previous state SA and the subsequent state SB from the state transition table. Then, the CPU 11 transmits the moving image corresponding to the moving image ID to the renderer 3 by streaming (step S87). At this time, the CPU 11 executes processing according to the user operation, if necessary. For example, when the user moves the cursor or draws a line on the drawing screen, the CPU 11 adds an image to the moving image transmitted to the renderer 3 so that the cursor is moved or the line is drawn. To do. Further, the CPU 11 stores data of a picture drawn by the user in the storage unit 14. When step S87 is completed, the CPU 11 proceeds to step S81.

  In step S88, the CPU 11 acquires the importance table TB corresponding to the state SB from the importance table DB6. Next, the CPU 11 determines whether or not the contents of the importance table TA and the contents of the importance table TB completely match (step S89). At this time, if the CPU 11 determines that the contents of the importance table TA and the contents of the importance table TB are completely matched (step S89: YES), the CPU 11 proceeds to step S91. On the other hand, if the CPU 11 determines that the contents of the importance table TA and the contents of the importance table TB are at least partially different (step S89: NO), the CPU 11 proceeds to step S90.

  In step S90, the CPU 11 transmits the importance table TB to the controller 2 and proceeds to step S91. In step S91, the CPU 11 acquires the moving image IDs corresponding to the previous state SA and the subsequent state SB from the state transition table. Then, the CPU 11 transmits the moving image corresponding to the moving image ID to the renderer 3 by streaming (step S92). Next, the CPU 11 proceeds to step S81. In step S81, if the CPU 11 determines that the server program ends (step S81: YES), the CPU 11 ends the state machine process.

  As described above, according to the above-described embodiment, when the screen displayed by the renderer 3 is switched to any one of the plurality of screens, the application server 1 stores a plurality of items stored in the importance table DB 6. Among the importance tables, the importance table corresponding to the screen after switching is transmitted to the controller 2. In addition, the application server 1 transmits a moving image indicating a screen corresponding to the transmitted importance table to the renderer 3. Further, the application server 1 receives the key ID indicating the user operation input to the controller 2 from the controller 2 using a protocol determined by the controller 2 among a plurality of predetermined protocols. At this time, the application server 1 receives the key ID using the protocol indicated by the importance corresponding to the key ID among the importance included in the transmitted importance table. In addition, the application server 1 executes a process according to the user operation indicated by the received key ID.

1 Application Server 2 Controller 3 Renderer 4 Integrated Client 5 Application DB
6 Importance table DB
10 Network 11, 21, 71 CPU
12, 22, 72 ROM
13, 23, 73 RAM
14, 24, 74 Storage unit 15, 25, 75 Communication unit 26 Input unit 27 Display unit S Communication system

Claims (12)

In a communication system comprising: a client device to which a user operation is input; and a server device to which the client device can be connected via a network, and a server device that executes processing according to the user operation.
The server device
First storage means for storing a plurality of operation lists corresponding to a plurality of predetermined screens, operation information indicating user operations for each of a plurality of user operations corresponding to the corresponding screens, and predetermined A first storage means for storing an operation list including protocol information indicating a protocol corresponding to the user operation among the plurality of received protocols;
When the screen displayed by the client device is switched to any one of the plurality of screens, the operation list corresponding to the screen after switching among the plurality of operation lists stored in the first storage unit Operation list transmission means for transmitting to the client device;
Screen information transmitting means for transmitting screen information indicating a screen corresponding to the operation list transmitted by the operation list transmitting means;
Operation information receiving means for receiving operation information indicating a user operation input to the client apparatus from the client apparatus according to a protocol determined by the client apparatus, the operation list transmitted by the operation list transmitting means Operation information receiving means for receiving the operation information using a protocol indicated by protocol information corresponding to the operation information among the protocol information included in
Processing means for executing processing according to a user operation indicated by the operation information received by the operation information receiving means;
With
The client device is
Operation list receiving means for receiving the operation list from the server device;
Second storage means for storing the operation list received by the operation list receiving means;
Screen information receiving means for receiving the screen information transmitted from the server device;
Display means for displaying a screen indicated by the screen information received by the screen information receiving means;
An input means for inputting a user operation;
Obtaining means for obtaining protocol information corresponding to operation information indicating the user operation input using the input means from the operation list stored in the second storage means;
Operation information transmission means for transmitting operation information indicating the input user operation to the server device using a protocol indicated by the protocol information acquired by the acquisition means among the plurality of protocols;
A communication system comprising: The client device is
A first client device comprising the operation list receiving means, the second storage means, the input means, the acquisition means, and the operation information transmission means;
A second client device comprising the screen information receiving means and the display means;
The communication system according to claim 1, comprising:   The communication system according to claim 2, wherein the client device is a thin client. The server device included in a communication system comprising: a client device to which a user operation is input; and a server device to which the client device can be connected via a network, and a server device that executes processing according to the user operation In
First storage means for storing a plurality of operation lists corresponding to a plurality of predetermined screens, operation information indicating user operations for each of a plurality of user operations corresponding to the corresponding screens, and predetermined A first storage means for storing an operation list including protocol information indicating a protocol corresponding to the user operation among the plurality of received protocols;
When the screen displayed by the client device is switched to any one of the plurality of screens, the operation list corresponding to the screen after switching among the plurality of operation lists stored in the first storage unit Operation list transmission means for transmitting to the client device;
Screen information transmitting means for transmitting screen information indicating a screen corresponding to the operation list transmitted by the operation list transmitting means;
Operation information receiving means for receiving operation information indicating a user operation input to the client apparatus from the client apparatus according to a protocol determined by the client apparatus, the operation list transmitted by the operation list transmitting means Operation information receiving means for receiving the operation information using a protocol indicated by protocol information corresponding to the operation information among the protocol information included in
Processing means for executing processing according to a user operation indicated by the operation information received by the operation information receiving means;
A server device comprising:   The plurality of protocols include a first protocol in which an acknowledgment is transmitted from the server device to the client device when the server device receives the operation information from the client device, and a second protocol in which the acknowledgment is not transmitted. The server apparatus according to claim 4, wherein: The operation information receiving means includes the operation information to which the number updated every time the first operation information transmitted using the first protocol is transmitted among the operation information transmitted by the client device. Receive
Of the operation information transmitted from the client device, when the second operation information transmitted using the second protocol is received by the operation information receiving means, it matches the number added to the second operation information. A determination unit for determining whether the first operation information to which the number is added is received by the operation information reception unit;
When the determination unit determines that the first operation information has not been received, the processing unit receives the first operation information in response to the reception of the first operation information by the operation information reception unit. The server apparatus according to claim 5, wherein a process corresponding to a user operation indicated by the second operation information is executed after executing a process corresponding to the indicated user operation. The first protocol is TCP;
The server device according to claim 5, wherein the second protocol is UDP.   The plurality of protocols include a third protocol in which the operation information encrypted by the client device is transmitted from the client device to the server device, and the operation information not encrypted is transmitted from the client device to the server device. The server apparatus according to claim 1, further comprising at least a fourth protocol to be executed.   The server apparatus according to claim 8, wherein the third protocol is SSL. The server device included in a communication system comprising: a client device to which a user operation is input; and a server device to which the client device can be connected via a network, and a server device that executes processing according to the user operation On computers included in
A first storage means for storing a plurality of operation lists corresponding to the plurality of screens when the screen displayed by the client device is switched to any one of a plurality of predetermined screens; For each of a plurality of user operations corresponding to the corresponding screen, an operation list including operation information indicating a user operation and protocol information indicating a protocol corresponding to the user operation among a plurality of predetermined protocols is stored. An operation list transmission step of transmitting an operation list corresponding to the screen after switching among the plurality of operation lists stored in the first storage means to the client device;
A screen information transmission step of transmitting screen information indicating a screen corresponding to the operation list transmitted by the operation list transmission step;
The operation list received by the operation list transmission step, which is an operation information reception step for receiving operation information indicating a user operation input to the client device from the client device with a protocol determined by the client device. An operation information receiving step for receiving the operation information using a protocol indicated by protocol information corresponding to the operation information among the protocol information included in
A processing step of executing processing according to a user operation indicated by the operation information received by the operation information receiving step;
A program characterized by having executed. The client device included in a communication system comprising: a client device to which a user operation is input; and a server device to which the client device can be connected via a network, and a server device that executes processing according to the user operation In
When a screen displayed by the client device is switched to any one of a plurality of predetermined screens, a first storage unit that stores a plurality of operation lists corresponding to the plurality of predetermined screens. An operation including operation information indicating a user operation and protocol information indicating a protocol corresponding to the user operation among a plurality of predetermined protocols for each of a plurality of user operations corresponding to the corresponding screen. Of the plurality of operation lists stored in the first storage means for storing the list, an operation list receiving means for receiving an operation list corresponding to the screen after switching from the server device;
Second storage means for storing the operation list received by the operation list receiving means;
An input means for inputting a user operation;
Obtaining means for obtaining protocol information corresponding to operation information indicating the user operation input using the input means from the operation list stored in the second storage means;
Operation information transmission means for transmitting operation information indicating the input user operation to the server device using a protocol indicated by the protocol information acquired by the acquisition means among the plurality of protocols;
A client device comprising: The client device included in a communication system comprising: a client device to which a user operation is input; and a server device to which the client device can be connected via a network, and a server device that executes processing according to the user operation On computers included in
A first storage means for storing a plurality of operation lists corresponding to the plurality of screens when the screen displayed by the client device is switched to any one of a plurality of predetermined screens; For each of a plurality of user operations corresponding to the corresponding screen, an operation list including operation information indicating a user operation and protocol information indicating a protocol corresponding to the user operation among a plurality of predetermined protocols is stored. An operation list receiving step of receiving, from the server device, an operation list corresponding to the screen after switching among the plurality of operation lists stored in the first storage means.
A second storage step of storing the operation list received in the operation list reception step in a second storage means;
An acquisition step of acquiring protocol information corresponding to operation information indicating a user operation input using the input unit, from the operation list stored in the second storage unit;
An operation information transmission step of transmitting operation information indicating the input user operation to the server device using a protocol indicated by the protocol information acquired by the acquisition step among the plurality of protocols,
A program characterized by having executed.

Images