JP2010211724A - Client device, server-based computing system and client control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a client device that can reduce the frequency of communication incidental to pointer movement, and to improve a response to operation, in an SBC system. <P>SOLUTION: When display rendering data G are generated according to an event input from the client deice 20 to a server device 10, an object area table 24b describing area information about objects included in the rendering data G in association with pointer ID is generated and sent together with the rendering data G to the client device 20. When a pointer P is moved on the client device 20 with the rendering data G according to the input event received and displayed, the pointer ID in an object area corresponding to the moved position of the pointer P is identified by the object area table 24b, and pointer data Pn of a shape corresponding to the pointer ID are read from a pointer shape table 24a and rendered and displayed in the moved pointer position. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a client device of a server-based computing system, a server-based computing system, and a client control program.

  In a conventional server-client system, for example, there is a server-based computing system (SBC) in which a desired application program is activated and executed on the server device side by remote operation from the client device. In this SBC system, display drawing data that is processed and updated on the server device side in response to an operation input of the client device is transmitted and transferred from the server device to the client device every time the drawing is updated. As a result, the client device only needs to have a minimum function such as display and input, and resources such as applications are centrally managed by the server device.

  As described above, since the application program is executed on the server device, the SBC system can realize a highly functional computing environment even when the performance of the client device is low.

  On the other hand, in the SBC system, drawing data for display in response to a request from a client device is generated or acquired by a server device, transferred to the client device, and displayed. For this reason, every time the drawing data is updated, if the transfer processing to the client device occurs, the communication frequency and the data amount increase, and it is difficult to improve the operation response of the drawing update as seen from the client device. It is.

  In particular, when a request for changing the display position and shape of the pointer is continuously generated as the pointer is moved by the cursor key or the mouse, the request for changing the pointer display position to the server device is transmitted. Accordingly, the response transmission processing to the client device of the drawing data whose pointer display position and shape are updated by the server device is continuously repeated, so that the communication frequency increases dramatically and the pointer display operation response also deteriorates.

  In the conventional SBC system, a gateway is provided between the thin client terminal and the server apparatus, and operation requests made from the thin client terminal to the server apparatus are stored in the gateway until a specific condition is satisfied. Then, after the specific condition is satisfied, the stored operation request is made to the server device (the client device operation event is not notified to the server device until the specific condition is satisfied), so that the thin client terminal and the server A system that guarantees operation even when a session becomes abnormal due to an inability to communicate with an apparatus has been considered (see, for example, Patent Document 1).

JP 2004-171063 A

  In the conventional SBC system, the frequency of communication with the server apparatus can be expected to be reduced by controlling the server apparatus so as not to notify the operation event of the client terminal until a specific condition is satisfied.

  However, it cannot be applied to control that requires a pointer drawing update in real time in accordance with the operation of the cursor key or the mouse, and it cannot be expected to reduce the communication frequency, the amount of data, and improve the operation response.

  The present invention has been made in view of such a problem. In the SBC system, a client device, server-based computing, and the like that can reduce the communication frequency associated with the movement of the pointer and improve the operation response. An object is to provide a system and a client control program.

  The client device according to claim 1 transmits an input event corresponding to a user operation to a server device connected via a network, and follows an application program executed by the server device in response to the input event. A client device that receives the generated screen information, and stores pointer data storage means that associates and stores drawing data of the pointer for each type of pointer, and an object area included in the screen information from the server device. Table receiving means for receiving an object area table that associates information with the type information of the pointer, table storage means for storing the object area table received by the table receiving means, and display means for displaying the screen information According to the user operation, the display means Pointer movement instructing means for instructing movement of the pointer in the displayed screen information, and an object area corresponding to the pointer movement instruction position in the screen information by the pointer movement instructing means by the table storage means Object area determination means for determining based on the stored object area table and stored in the table storage means in association with the object area corresponding to the pointer movement instruction position determined by the object area determination means. In accordance with the pointer type information, the pointer data acquisition means for acquiring the drawing data of the pointer stored by the pointer data storage means, and the drawing data of the pointer acquired by the pointer data acquisition means by the pointer movement instruction means Screen information A pointer display control means for displaying in response to the movement indicated position of the pointer on the inner, further comprising a are characterized.

  The client device according to claim 2 is the client device according to claim 1, wherein the table receiving unit includes, from the server device, information on the object area included in the screen information, and type information of the pointer. The object area table associated with the additional display information is received and stored in the table storage means in association with the object area corresponding to the pointer movement instruction position determined by the object area determination means. Additional information acquisition means for acquiring additional display information, and additional display information acquired by the additional information acquisition means are displayed in correspondence with the pointer movement instruction position in the screen information by the pointer movement instruction means. And additional information display control means.

The server-based computing system according to claim 3 has a server device and a client device connected via a network, and follows an application program executed by the server device in response to an input event from the client device. A server-based computing system configured to transmit and display generated screen information to the client device,
The server device includes: table generation means for generating an object area table in which object area information included in the screen information is associated with pointer type information; and the object area table generated by the table generation means Transmission means for transmitting to the device,
The client device associates and stores the drawing data of the pointer for each pointer type, and the object area information and the pointer type information included in the screen information from the server device. A table receiving means for receiving the associated object area table, a table storage means for storing the object area table received by the table receiving means, a display means for displaying the screen information, and according to a user operation, Pointer movement instruction means for instructing movement of the pointer in the screen information displayed by the display means, and an object area corresponding to the pointer movement instruction position in the screen information by the pointer movement instruction means are stored in the table. Object area table stored by storage means In accordance with the type information of the pointer stored in the table storage means in association with the object area corresponding to the movement instruction position of the pointer determined by the object area determination means, Pointer data acquisition means for acquiring the drawing data of the pointer stored by the pointer data storage means, and the pointer drawing data acquired by the pointer data acquisition means for the pointer in the screen information by the pointer movement instruction means And pointer display control means for displaying corresponding to the movement instruction position.

  The program according to claim 4 generates an input event corresponding to a user operation to a server device connected via a network, and generates the program according to an application program executed on the server device in response to the input event. Pointer data storage means for controlling a computer of a client device that receives received screen information, and storing the computer in a memory in association with drawing data of the pointer for each type of pointer, the server Table receiving means for receiving an object area table associating object area information contained in the screen information with the pointer type information from the apparatus, and storing the object area table received by the table receiving means in a memory Table storage means, said image Display means for displaying information on the display unit, pointer movement determining means for determining the movement position of the pointer according to the user operation in the screen information displayed by the display means, and the screen determined by the pointer movement determining means Object area determination means for determining an object area corresponding to the movement position of the pointer in the information based on the object area table stored by the table storage means, and the movement position of the pointer determined by the object area determination means Pointer data acquisition means for acquiring the drawing data of the pointer stored in the pointer data storage means in accordance with the pointer type information stored in the table storage means in relation to the object area corresponding to Take by acquisition means The drawing data pointer that has been, is characterized in that to function as a pointer display control means, for displaying in correspondence with the moving position of the pointer within the screen information determined by said pointer movement determining means.

  According to the present invention, there are provided a client device, a server-based computing system, and a client control program capable of reducing the communication frequency associated with the movement of the pointer and improving the operation response in the SBC system. it can.

1 is a block diagram showing a configuration of an SBC (Server Based Computing) system according to an embodiment of the present invention. The block diagram which shows the circuit structure of the server apparatus 10 in the said SBC system. The figure which shows the content of the object area | region table 14b produced | generated in RAM14 of the said server apparatus 10. FIG. The figure which shows the format of the object information notification event 14bt for transmitting the object area | region table 14b produced | generated in the said server apparatus 10 to the client apparatus 20. FIG. The block diagram which shows the circuit structure of the client apparatus 20 in the said SBC system. The figure which shows the content of the pointer shape table 24a produced | generated in RAM24 of the said client apparatus 20. FIG. The figure which shows the specific pointer display state according to the movement position of the pointer P on the drawing data G displayed on the client apparatus 20 of the SBC system. The flowchart which shows the server process of the server apparatus 10 in the said SBC system. The flowchart which shows the input corresponding | compatible process accompanying the server process of the server apparatus 10 in the said SBC system. The flowchart which shows the client process of the client apparatus 20 in the said SBC system. The flowchart which shows the data reception process accompanying the client process of the client apparatus 20 in the said SBC system. The flowchart which shows the operation event data transmission process accompanying the client process of the client apparatus 20 in the said SBC system.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of an SBC (Server Based Computing) system according to an embodiment of the present invention.

  This SBC system includes a server device 10 and a plurality of client devices (Thin clients) 20 connected to a network N composed of a LAN (Local Area Network) or a WAN (Wide Area Network).

  The server device 10 has a plurality of application programs such as a document creation processing program, a spreadsheet processing program, a presentation material creation program, a mail processing program, an Internet connection processing program, and a Web display program, and is connected to the server device 10. It is activated in response to an operation input (input event) signal from the client device 20,.

  In the server device 10, the display output drawing data G generated on the client frame buffer RAM 14a (see FIG. 2) in accordance with the execution of the application program according to the operation input signal from the client device 20,. After being compressed, it is transmitted (transferred) to the client device 20 of the access source.

  Then, in the client devices 20,..., The drawing data G transferred from the server device 10 is decompressed and expanded in the frame buffer RAM 25 (see FIG. 5) and displayed on the display device 26.

  That is, each client device (Thin client) 20 in the SBC system has an input function corresponding to a user operation such as a keyboard and a mouse and an output function to an LCD display unit and a printer as main functions. The server device 10 does not have at least various application functions and data file management functions.

  And the data file produced | generated with the various processes started and performed in the server apparatus 10 according to the operation input (input event) signal from the client apparatus 20 ... is fundamentally in the said server apparatus 10. Alternatively, it is stored and stored for each user account or as a shared file in a storage device such as a magnetic disk managed and managed by the server device 10.

  FIG. 2 is a block diagram showing a circuit configuration of the server device 10 in the SBC system.

  The server device 10 includes a CPU 11 as a computer, and a ROM 13, a RAM 14, a frame buffer RAM 15, and a display device 16 are connected to the CPU 11 via a bus 12.

  Further, a communication I / F (interface) 19 with an input device 17 such as a keyboard and a mouse, an external storage device 18, a client device 20,.

  The CPU 11 controls the operation of each part of the circuit using the RAM 14 as a working memory in accordance with a system program or various application programs stored in advance in the ROM 13, and via a key input signal from the input device 17 or a communication I / F 19. The various programs are activated and executed in response to a processing command (input event) signal corresponding to a user operation from the client device 20 received.

  In this server device 10, various data generated in accordance with an application program activated / executed in response to an input event signal from the client device 20 is stored in the external storage device 18 in association with the user ID, for example. . The drawing data G for client display is generated using the client frame buffer RAM 14 a in the RAM 14, and after being compressed, is transferred from the communication I / F 19 to the client device 20 for display output.

  When the drawing data G for display is generated in the client frame buffer RAM 14a, it is determined whether or not the state of the object included in the drawing data G is changed. When it is determined that there is a change in the state of the object included in the drawing data G, the object area table 14b (described by associating the display information of the pointer P with the area information of the object included in the drawing data G) 3) is generated and transferred to the client device 20 as an object information notification event 14bt (see FIG. 4) having a predetermined data format.

  Note that drawing data to be displayed on the display device 16 of the server device 10 itself is generated on the frame buffer RAM 15.

  FIG. 3 is a diagram showing the contents of the object area table 14b generated in the RAM 14 of the server device 10. As shown in FIG.

  The object area table 14b includes object IDs, area information (XS, YS) (XE, YE) of various objects included in the drawing data G generated in the client frame buffer RAM 14a, and pointers in the object area. Pointer ID indicating the shape of P, an extended information flag indicating whether or not there is additional display information (pop-up display / balloon display / color change display, etc.) when the pointer P moves within the object area, and this extension The additional display information when the information flag is “ON” is described in association with it.

  In the extended information flag table area, an event transmission command is also described when it is necessary to notify the server device 10 that the pointer P has moved into the corresponding object area.

  FIG. 4 is a diagram showing a format of an object information notification event 14bt for transmitting the object area table 14b generated by the server device 10 to the client device 20. As shown in FIG.

  The object information notification event 14bt describes the identifier “event ID” and “data size” of the object information notification event 14bt in the header part. The data portion includes, for each piece of object area information included in the generated drawing data G, an identifier “object ID”, “addition” or “change” or “change” or “ “Registration attribute information” indicating “erase”, “region information” indicating start coordinates (XS, YS) and end coordinates (XE, YE), “pointer display information (pointer ID)” indicating the shape of the pointer P, The “extended information flag” and the “additional display information” are described. The number of each piece of object information is described at the head of the data portion.

  FIG. 5 is a block diagram showing a circuit configuration of the client device 20 in the SBC system.

  The client device 20 includes a CPU 21 as a computer, and a ROM 23, a RAM 24, and a frame buffer RAM 25 are connected to the CPU 21 via a bus 22. The drawing data G written in the frame buffer RAM 25 is output to the display device 26 and displayed.

  Further, an input device 27 such as a keyboard, a mouse, a microphone, and an optical sensor, an external storage device 28, and a communication I / F (interface) 29 with the server device 10 are connected to the CPU 21 via the bus 22.

  The CPU 21 controls the operation of each part of the circuit using the RAM 24 as a working memory in accordance with a system program stored in the ROM 23 in advance. The CPU 21 receives a key input signal from the input device 27, a mouse movement signal, and the communication I / F 29. The system program is activated and executed in response to an application response signal, transfer drawing data G, and the like from the server apparatus 10 to be executed.

  In the client device 20, various data generated by executing the application program in the server device 10 is appropriately read and stored in the external storage device 28, and the generated drawing data G for transfer is The compressed data is decompressed, written in the frame buffer RAM 25, and displayed on the display device 26.

  The RAM 24 functioning as the working memory stores a pointer shape table 24a (see FIG. 6) and an object area table 24b (see FIG. 3).

  The object area table 24b is described by associating the display information of the pointer P with the area information of the object included in the drawing data G for display written in the frame buffer RAM 25, and is transmitted from the server device 10. It is updated according to the incoming object information notification event 14bt (see FIG. 4).

  FIG. 6 is a view showing the contents of the pointer shape table 24 a generated in the RAM 24 of the client device 20.

  The pointer shape table 24a includes, for example, an arrow-shaped pointer P1 when the pointer is positioned in a normal display area, a pointing pointer P2 when the pointer is positioned in a linked object area, and a text object. Various pointer shape data that differs depending on the area where the pointer is positioned, such as the cursor-shaped pointer P3 when the pointer is positioned in the area, are pointer ID, type (normal / link / text /...), Size (H × W ) And stored in association with the coordinates (Xn, Yn) of the hot spot Sn indicating the reference position in the pointer.

  That is, when drawing data G for client display is generated by an application program executed on the server device 10 in accordance with an input event corresponding to a user operation from the client device 20 to the server device 10, the drawing data G is updated. Each time, the object area table 14b (see FIG. 3) is generated that associates the information of each object included in the drawing data G with the display information of the pointer P. The object area table 14b is transmitted to the client apparatus 20 as an object information notification event 14bt (see FIG. 4), and is updated and stored in the object area table 24b (see FIG. 3) of the client apparatus 20.

  In the client device 20, for example, when the position of the pointer P on the display screen (drawing data G) is only moved by a mouse operation, the pointer ID to be displayed in the object area corresponding to the moved position is stored in the RAM 24. This is determined from the object area table 24b (see FIG. 3). Then, pointer data Pn having a shape corresponding to the pointer ID is read from the pointer shape table 24a in the RAM 24 and displayed at the movement position of the pointer P accompanying the mouse operation.

  For this reason, in the state in which the client device 20 only moves the pointer P on the drawing data G being displayed, it is not necessary to transmit an input event for the pointer movement display to the server device 10. The client device 20 itself can display a pointer Pn having a shape corresponding to the movement position of the pointer P.

  FIG. 7 is a diagram showing a specific pointer display state corresponding to the movement position of the pointer P on the drawing data G displayed on the client device 20 of the SBC system.

  That is, on the drawing data G displayed on the client device 20, the object area (XS1, YS1) to (XE1, YE1) of the linked photograph A or the object area (XS3) of the photograph B from the normal object area. , YS3) to (XE3, YE3), the pointer P is moved from the arrow-shaped pointer P1 to the pointer-shaped pointer P2 without the need to send an event to the server device 10 and displayed. Become so. When the pointer P is moved to the text A object areas (XS2, YS2) to (XE2, YE2) or the text B object areas (XS4, YS4) to (XE4, YE4), Without the need for event transmission, the arrow-shaped pointer P1 or the pointing-point pointer P2 is changed to the cursor-shaped pointer P3 to be moved and displayed.

  Next, the operation of the SBC system configured as described above will be described.

  FIG. 8 is a flowchart showing server processing of the server apparatus 10 in the SBC system.

  In a state of waiting for data reception from the client device 20 by the communication I / F 19 (step S1), when data is received (step S2), whether or not the content of the received data is an event signal requesting login. Is determined (step S3).

  If it is determined that an event signal requesting login from the client device 20 has been received (step S3 (Yes)), the login processing of the client device 20 that is the login request transmission source is executed, and user authentication processing, An initialization process of the client frame buffer RAM 14a is performed (step S4).

  On the other hand, when data is received from the client device 20 that has already been logged in (steps S1 and S2), if it is determined that an input event signal associated with a user operation of the client device 20 has been received (step S3 ( No) → S5 (Yes)), the process proceeds to the input corresponding process in FIG. 9 (step SA).

  When data from the client device 20 is received (steps S1 and S2), if it is determined that the content of the received data is neither a log-in request event signal nor a user input event signal (step S1). S3 (No) → S5 (No)), and another process corresponding to the content of the received data is executed (step S6).

  FIG. 9 is a flowchart showing an input handling process accompanying the server process of the server apparatus 10 in the SBC system.

  In this input correspondence processing, first, the content of the input event signal received from the client device 20 is analyzed (step A1), and an event for the application program to be executed is issued according to the content of the analyzed event signal. (Step A2).

  Then, with the execution of the application program according to the input event signal, it is determined whether or not the display drawing data G generation process is included (step A3). If it is determined that the process for generating the display drawing data G is included (step A3 (Yes)), the object information included in the drawing data G is read based on the application program being executed. (Step A4), it is determined whether or not there is a change in the state of the object information already stored in the object area table 14b (see FIG. 3) with the previous generation processing of the drawing data G (Step A5).

  If it is determined that the object information already stored in the object area table 14b (see FIG. 3) has changed due to, for example, the update of the current drawing data G (step A5 (Yes)). ), A new object area table 14b is generated based on the object information included in the updated drawing data G (step A6).

  Then, the object information described in the newly generated object area table 14b is converted into the format of the object information notification event 14bt (see FIG. 4) and transmitted to the client device 20 that is the transmission source of the input event signal. (Step A7).

  Then, client display drawing data G generated in accordance with the execution of the application program according to the input event signal from the client device 20 is drawn in the client frame buffer RAM 14a (step A8).

  The display drawing data G drawn in the client frame buffer RAM 14a is generated as drawing data to be transmitted after being subjected to an encoding process such as data compression (step A9), and the client which is the transmission source of the input event signal It is transmitted to the device 20 (step A10).

  When it is determined that the generation processing of the display drawing data G is not included in accordance with the execution of the application program according to the input event signal (step A3 (No)), for example, between the client device 20 A process corresponding to the input event other than the drawing data G, such as a connection confirmation signal transmission process periodically performed in step S11, is executed (step A11).

  As a result, each time the client display drawing data G corresponding to the input event signal received from the client device 20 is updated, the server device 10 generates the object area table 14b corresponding to the drawing data G, and The information notification event 14bt is transmitted to the client device 20.

  FIG. 10 is a flowchart showing client processing of the client device 20 in the SBC system.

  When the power of the client device 20 is turned on and a user connection start operation is performed, communication with the server device 10 is started and a login request is transmitted (step B1), and user authentication processing, memory initialization processing, and the like are performed. A process for establishing a connection with the server apparatus 10 is performed (step B2).

  Then, the data reception standby state from the server device 10 is entered (step B3), and the data received from the server device 10 is analyzed (step B4), so that the connection with the server device 10 associated with the login request is established. It is determined whether it has been established (step B5).

  If it is determined that the connection with the server device 10 has been established (step B5 (Yes)), the occurrence of an input event associated with the user operation of the client device 20 itself or the occurrence of a received event associated with data reception from the server device 10 A state is reached (step B6).

  If it is determined that a reception event associated with data reception from the client device 10 has occurred in this event generation standby state (step B7 (Yes)), the process proceeds to a data reception process in FIG. 11 (step BC).

  FIG. 11 is a flowchart showing data reception processing accompanying client processing of the client device 20 in the SBC system.

  In this data reception process, first, it is determined whether or not the content of the reception event associated with the data reception from the server device 10 is a display drawing event (step C1).

  Here, when it is determined that the content of the reception event accompanying the data reception from the server device 10 is a display drawing event (step C1 (Yes)), the compression of the received drawing data G is decoded. The analysis process is executed (step C2). The analyzed drawing data G is written into the frame buffer RAM 25, and the drawing process for the display device 26 is executed (step C3).

  That is, the display drawing data G created by the input corresponding process accompanying the server process of the server device 10 is written in the frame buffer RAM 25 and displayed on the display device 26.

  On the other hand, it is determined that the content of the reception event accompanying the data reception from the server device 10 is the object information notification event 14bt (see FIG. 4) transmitted in step A7 in the input corresponding processing accompanying the server processing. If it is performed (step C4 (Yes)), each object information in the object area table 24b (see FIG. 3) according to the registered attribute information (change / add / delete) for each object information described in the notification event 14bt. Are changed or added or deleted (step C5). As a result, each object information in the object area table 24b (see FIG. 3) is updated to information corresponding to the object included in the display drawing data G written in the frame buffer RAM 25.

  Further, when it is determined that the content of the reception event accompanying the data reception from the server device 10 is a cache data registration event such as various pointer data stored in the pointer shape table 24a (see FIG. 6) ( In step C6 (Yes), the cache data described in the data registration event is stored in a predetermined work area in the RAM 24 and stored (step C7).

  When it is determined that the content of the reception event associated with the data reception from the server device 10 is an event corresponding to another process transmitted through step A11 in the input handling process associated with the server process. (Step C6 (No)), another process corresponding to the received event is executed (step C8).

  On the other hand, in the event occurrence standby state in step B6, when an input event accompanying a user operation occurs, and it is determined that the input event is, for example, a movement event of the pointer P on the display screen in response to a mouse operation. (Step B8 (Yes) → B9 (Yes)), the object information corresponding to the movement position of the pointer P is read based on the object area table 24b (see FIG. 3) stored in the RAM 24 (see FIG. 3). Step B10), it is determined whether or not the pointer P is moving within the same object area (step B11).

  If it is determined that the pointer P is moved within the same object area (step B11 (Yes)), the pointer Pn before the movement is displayed on the display screen corresponding to the movement position of the pointer P. Is drawn and displayed (step B17).

  For example, on the display screen of the drawing data G as shown in FIG. 7, the object area table 24b indicates that the pointer positions before and after the movement are both within the object area (XS1, YS1) (XE1, YE1) of the same picture A. If it is determined based on (see FIG. 3), the pointing pointer P2 corresponding to the pointer ID “02” is drawn and displayed at the moved pointer position without change.

  When “event transmission” is described as the extension information of the object area corresponding to the pointer position after the movement with the pointer movement this time (step B18 (Yes)), the operation event data in FIG. The process proceeds to a transmission process, and the pointer movement event is transmitted to the server device 10 (step BD).

  On the other hand, if it is determined in steps B9 to B11 that the pointer position after movement has entered another object area based on the object area table 24b (see FIG. 3) stored in the RAM 24 (step B11 (No. )) Based on “ON” or “OFF” of the extension information flag of the object area corresponding to the pointer position after the movement, “Yes” or “Yes” of additional display information (pop-up display / balloon display / color change display, etc.) "None" is determined (step B12).

  Here, when it is determined that the additional display information is “present” based on the fact that the extension information flag of the object area corresponding to the pointer position after the movement is “ON” (step B12 (Yes)), Drawing data according to the additional display information is read (step B13), and is drawn and displayed at the moved pointer position (step B14).

  Further, based on the object area table 24b (see FIG. 3) stored in the RAM 24, it is determined whether or not the pointer ID of the object area corresponding to the pointer position before and after the movement is changed (step B15).

  If it is determined that the pointer ID of the object area corresponding to the pointer position before and after the movement is changed (step B15 (Yes)), the pointer shape is determined according to the pointer ID of the object area corresponding to the pointer position after the movement. The pointer shape data stored in the table 24a is read (step B16).

  Then, the pointer Pn after the shape change read from the pointer shape table 24a is drawn and displayed on the display screen corresponding to the movement position of the pointer P (step B17).

  For example, in the display screen of the drawing data G as shown in FIG. 7, it is indicated that the pointer position before and after the movement has entered the object area (XS1, YS1) (XE1, YE1) of the photograph A from the normal area. When the determination is made based on the table 24b (see FIG. 3), the pointing pointer corresponding to the pointer ID “02” after the movement from the arrow-shaped pointer P1 corresponding to the pointer ID “01” before the movement. It is changed to P2, and is drawn and displayed at the pointer position after movement.

  Also in this case, when “event transmission” is described as the extension information of the object area corresponding to the pointer position after the movement with the current pointer movement (step B18 (Yes)), the operation in FIG. The process proceeds to event data transmission processing, and the pointer movement event is transmitted to the server device 10 (step BD).

  On the other hand, even when it is determined that another input event accompanying the user operation has occurred in the event occurrence standby state in step B6 (step B8 (Yes) → B9 (No)), the operation event data in FIG. The process proceeds to a transmission process, and event transmission to the server device 10 is executed according to the type of other input event associated with the user operation (step BD).

  FIG. 12 is a flowchart showing operation event data transmission processing accompanying client processing of the client device 20 in the SBC system.

  That is, in this operation event data transmission process, first, the type of the input event accompanying the user operation is determined (step D1). Then, an event signal corresponding to the input event determined as the type is generated (step D2) and transmitted to the server device 10 (step D3).

  Note that if it is determined that the content of the event received from the server device 10 is an event corresponding to another process transmitted through step A11 in the input handling process accompanying the server process (step S11). B8 (No)), for example, other processing such as connection confirmation processing periodically performed with the server device 10 is executed (step B19).

  Therefore, according to the SBC system having the above-described configuration, when an input event signal is received from the client device 20 to the server device 10, the server device 10 activates an application program corresponding to the input event to display a client display. Drawing data G is generated. Then, an object area table 14b in which the identification information (pointer ID) of the pointer P is related to the area information of the object included in the drawing data G is generated and transmitted to the client device 20 together with the drawing data G. When the client device 20 moves the pointer P in a state where the drawing data G corresponding to the input event is received and displayed, the identification information of the pointer P in the object area corresponding to the movement position of the pointer P ( Pointer ID) is determined from the object area table 24b (14b), and pointer data Pn having a shape corresponding to the pointer ID is read from the pointer shape table 24a, and is drawn and displayed at the pointer position after movement.

  Therefore, with the movement operation of the pointer P on the client device 20, the input event is not transmitted to the server device 10 one by one, and only the client device 20 side performs the corresponding on the drawing data G corresponding to the movement of the pointer P. The display of the pointer P can be updated, the frequency of communication from the client device 20 to the server device 10 can be greatly reduced, and the operation response of the pointer movement viewed from the client device 20 can be greatly improved.

  In the object area table 14b (24b), not only the identification information (pointer ID) of the pointer P but also the area information of the object included in the drawing data G for client display is described. The additional display information (pop-up display / balloon display / color change display, etc.) displayed together with the drawing of the pointer P is also described in relation to it.

  For this reason, it is possible to display additional information to be displayed in the object area to which the pointer P has moved without transmitting an input event associated with the movement operation of the pointer P to the server device 10.

  Note that each processing method by the SBC system described in the embodiment, that is, server processing by the server apparatus 10 shown in the flowchart of FIG. 8, input corresponding processing accompanying the server processing shown in the flowchart of FIG. 9, flowchart of FIG. The client apparatus 20 shown in FIG. 11, the data reception process accompanying the client process shown in the flowchart of FIG. 11, and the operation event data transmission process accompanying the client process shown in the flowchart of FIG. As programs that can be executed, external storage devices 18, 28 such as a memory card (ROM card, RAM card, etc.), a magnetic disk (floppy disk, hard disk, etc.), an optical disk (CD-ROM, DVD, etc.), a semiconductor memory, etc. It may be distributed and stored in the medium. Then, the computers (CPUs 11 and 21) of the server device 10 and the client device 20 read the programs stored in the media of the external storage devices 18 and 28 into the storage devices (flash ROMs 13 and 23 and RAMs 14 and 24). By controlling the operation by the program, the pointer movement display function only on the client device 20 side based on the object information included in the drawing data G described in the above embodiment is realized. Processing can be executed.

  Further, program data for realizing each of the above methods can be transmitted on the communication network (N) in the form of a program code, and from a computer device (program server) connected to the communication network (N). The program data is fetched and stored in a storage device (flash ROM 13, 23 or RAM 14, 24), and the pointer movement display function only on the client device 20 side based on the object information included in the drawing data G described above is realized. You can also

  Note that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention at the stage of implementation. Further, each of the embodiments includes inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent elements are deleted from all the constituent elements shown in each embodiment or some constituent elements are combined in different forms, the problems described in the column of the problem to be solved by the invention If the effects described in the column “Effects of the Invention” can be obtained, a configuration in which these constituent requirements are deleted or combined can be extracted as an invention.

DESCRIPTION OF SYMBOLS 10 ... Server apparatus 20 ... Client apparatus 11, 21 ... CPU
12, 22 ... Bus 13, 23 ... ROM
14, 24 ... RAM
14a: Client frame buffer RAM
24a ... Pointer shape table 14b, 24b ... Object area table 14bt ... Object information notification event 15, 25 ... Frame buffer RAM
16, 26 ... Display device 17, 27 ... Input device 18, 28 ... External storage device 19, 29 ... Communication I / F
P1 ... Arrow-shaped pointer data P2 ... Pointer-shaped pointer data P3 ... Cursor-shaped pointer data N ... Communication network G ... Display drawing data

Claims (4)

Client device that transmits an input event corresponding to a user operation to a server device connected via a network and receives screen information generated according to an application program executed on the server device in response to the input event Because
Pointer data storage means for storing the drawing data of the pointer in association with each type of pointer;
Table receiving means for receiving from the server device an object area table associating the object area information included in the screen information with the pointer type information;
Table storage means for storing the object area table received by the table receiving means;
Display means for displaying the screen information;
Pointer movement instruction means for instructing movement of the pointer within the screen information displayed by the display means in response to a user operation;
An object area determination means for determining an object area corresponding to the pointer movement instruction position in the screen information by the pointer movement instruction means based on the object area table stored by the table storage means;
The pointer stored in the pointer data storage means according to the pointer type information stored in the table storage means in association with the object area corresponding to the pointer movement instruction position determined by the object area determination means. Pointer data acquisition means for acquiring the drawing data of
Pointer display control means for displaying the drawing data of the pointer acquired by the pointer data acquisition means in correspondence with the pointer movement instruction position in the screen information by the pointer movement instruction means;
A client device comprising: The table receiving means receives an object area table that associates the pointer type information and additional display information with the object area information included in the screen information from the server device,
Additional information acquisition means for acquiring additional display information stored in the table storage means in association with the object area corresponding to the pointer movement instruction position determined by the object area determination means;
Additional information display control means for displaying the additional display information acquired by the additional information acquisition means in correspondence with the pointer movement instruction position in the screen information by the pointer movement instruction means;
The client apparatus according to claim 1, further comprising: A server apparatus and a client apparatus connected via a network, and screen information generated according to an application program executed by the server apparatus in response to an input event from the client apparatus is transmitted to the client apparatus for display. A server-based computing system,
The server device
Table generating means for generating an object area table in which object area information included in the screen information is associated with pointer type information;
Transmission means for transmitting the object area table generated by the table generation means to the client device,
The client device is
Pointer data storage means for storing the drawing data of the pointer in association with each type of pointer;
A table receiving means for receiving an object area table associating the object area information included in the screen information with the pointer type information from the server device;
Table storage means for storing the object area table received by the table receiving means;
Display means for displaying the screen information;
Pointer movement instruction means for instructing movement of the pointer within the screen information displayed by the display means in response to a user operation;
An object area determination means for determining an object area corresponding to the pointer movement instruction position in the screen information by the pointer movement instruction means based on the object area table stored by the table storage means;
The pointer stored in the pointer data storage means according to the pointer type information stored in the table storage means in association with the object area corresponding to the pointer movement instruction position determined by the object area determination means. Pointer data acquisition means for acquiring the drawing data of
Pointer display control means for displaying the drawing data of the pointer acquired by the pointer data acquisition means in correspondence with the pointer movement instruction position in the screen information by the pointer movement instruction means;
A server-based computing system. Client device that transmits an input event corresponding to a user operation to a server device connected via a network and receives screen information generated according to an application program executed on the server device in response to the input event A program for controlling a computer of
The computer,
Pointer data storage means for associating the drawing data of the pointer with each pointer type and storing it in a memory;
A table receiving means for receiving from the server device an object area table in which object area information included in the screen information is associated with the pointer type information;
Table storage means for storing the object area table received by the table receiving means in a memory;
Display means for displaying the screen information on a display unit;
Pointer movement determination means for determining the movement position of the pointer according to the user operation in the screen information displayed by the display means;
An object area judging means for judging an object area corresponding to the moving position of the pointer in the screen information judged by the pointer movement judging means based on an object area table stored by the table storage means;
In accordance with the pointer type information stored in the table storage means in association with the object area corresponding to the pointer movement position determined by the object area determination means, the pointer data stored in the pointer data storage means is stored. Pointer data acquisition means for acquiring drawing data;
Pointer display control means for displaying the drawing data of the pointer acquired by the pointer data acquisition means corresponding to the movement position of the pointer in the screen information determined by the pointer movement determination means;
A client control program designed to function as

Images