JP5482710B2 - Display terminal device and program - Google Patents

Description

The present invention relates to a display terminal device and a program for receiving large screen data generated on a server device side and displaying a part of the display data on a display screen.

  Conventionally, in each terminal device (PC terminal) connected to a network such as an in-house LAN, the individual terminal device independently activates and executes an application such as document creation or table creation, and various types generated in accordance with this. The file is also stored in its own storage device in the terminal device, or is stored in an external storage medium such as a magnetic disk, optical disk, or small semiconductor memory, or transferred to a storage device managed by a server device on the network and stored. Yes.

  In such a conventional server / client system, the generated file is managed in each terminal device itself. Therefore, if the terminal device is lost or illegally taken out and put into the hands of a third party, the saved file is stored. May be read out and important information and confidential information may be leaked.

  In addition, if each terminal device starts and executes an application independently, it is necessary to update, change, and add the application for each terminal device, which is cumbersome and expensive. .

  For this reason, in recent server-client systems, all applications that are input / output / displayed on each terminal device are started and executed on the server device, and all generated files associated therewith are also managed on the server device side. SBC (Server Based Computing) system has been introduced (see, for example, Patent Document 1 and Patent Document 2).

  In such a server-based computing system, drawing data of application software executed on the server device side is transferred to a terminal device (client device), and the drawing data is displayed on the client device ( For example, see Patent Document 3).

  Recently, even in this server-based computing system, it is considered that a mobile terminal having a small display screen, such as a mobile phone, is used as a client device (for example, see Patent Document 4).

JP 2004-171063 A JP 2003-158534 A JP-T-2004-503862 JP 2004-348380 A

  In the conventional server-based computing system, when a portable terminal having a small display screen is used as the client device, the display screen data (drawing data) acquired from the server device is usually associated with the screen size of the PC terminal. Since it is generated, the drawing data area displayed on the display screen of the portable terminal is a partial area. For this reason, when the area of information that the user of the drawing data wants to see is not displayed, the user needs to perform operations such as screen scrolling to change the display area each time.

  In particular, when a list box or test box existing on drawing data is frequently set as an operation target, it is very troublesome to display the object area in accordance with the display area.

The present invention, even if the table示画surface is small, frequently without the need to perform the operation of changing the display area, and an object thereof is to allow to easily view the area of the information the user wants to view.

The invention of claim 1 is a display terminal device that receives large screen data generated on the server device side and displays a part of the display data on the display screen, and displays the object when the object is displayed. Setting means for arbitrarily setting whether or not to display at a central position, and when an object included in the large screen data is arbitrarily selected by the display terminal device, the fact that the object is selected Notification means for notifying the server device, and in response to the notification, whether or not the object in the large screen data does not fit on the display screen of the display terminal device is determined in the server device Receiving means for receiving information including the display position of the object in the large screen data transmitted from the server device in the case of being received, and the received table When displaying the display data of the display position of the object in among the large screen data based on the information including the position on the display screen, if the setting of the object center position displayed by said setting means, the display of the object characterized by comprising a table示制control means Ru is displayed at the center position of the screen, the.

According to the present invention, when a part of the large screen data received from the server device is displayed on the display terminal device, the object included in the large screen data can be appropriately displayed on the display screen of the display terminal device. it can.

1 is a block diagram showing a configuration of a server-based computing system including a server device 10 and client devices 20 (20P, 20M),... According to an embodiment of the present invention. The block diagram which shows the circuit structure of the server apparatus 10 in the said server base computing system. The figure which shows the content of the management data in the display management area | region 13A ensured in the memory | storage part 13 of the said server apparatus 10. FIG. The block diagram which shows the circuit structure of the client apparatus 20 (20P, 20M) in the said server base computing system. The figure which shows the display control operation | movement when the selection selection instruction | indication of list box LB is opened on the display screen (25) of the client apparatus 20 in the said server base computing system. The figure which shows the display control operation (the 2) when selecting and opening the list box LB on the display screen (25) of the client apparatus 20 in the server-based computing system. The figure which shows the display control operation | movement at the time of the selection instruction | indication of the text box TB on the display screen (25) of the client apparatus 20 in the said server base computing system. The flowchart which shows the server control processing by the server apparatus 10 of the said server base computing system. 6 is a flowchart showing object selection processing accompanying server control processing of the server device 10; It is a flowchart which shows the client control processing by the client apparatus 20 of the said server base computing system.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram illustrating a configuration of a server-based computing system including a server device 10 and client devices 20 (20P, 20M),... According to an embodiment of the present invention.

  This server-based computing system includes a server device 10 and a plurality of client devices 20 (20P, 20M),... Connected on a network N composed of a LAN (Local Area Network) or a WAN (Wide Area Network). .

  The server device 10 is a personal computer connected to the network N by wire, for example. As the client device 20, 20P is a portable personal computer wirelessly connected via an access point AP on the network N, and 20M is a mobile phone wirelessly connected via the access point AP.

  The server device 10 has various application programs such as a document creation processing program, a spreadsheet processing program, an address book program, a notepad program, a presentation material creation program, a mail processing program, an Internet connection processing program, and a Web display program. , The client device 20 (20P, 20M) connected to the server device 10 is activated in response to an operation input (input event) signal from the client device 20 (20P, 20M),.

  In this server device 10, display output drawing data generated in accordance with execution of an application program in response to an operation input signal from the client device 20,... Is converted into drawing data for transfer and is compressed / encrypted. And transmitted (transferred) to the client device 20 of the access source.

  Then, in the client device 20 (20P, 20M),..., The drawing data transferred from the server device 10 is decompressed and decoded and displayed on the display unit 25.

  At this time, in the server device 10, when the operation input signal from the client device 20 is an input signal instructing an object area (list box, text box, etc.) specified in advance in the drawing data as an operation target. In order to display the object area on the drawing data in accordance with the display screen (25) of the client apparatus 20, information indicating the display position and area on the drawing data is generated and transmitted (notified) to the client apparatus 20. It has a function.

  The client device 20 has a function of cutting out the drawing data according to information indicating the display position and area on the drawing data notified from the server device 10 and displaying the drawing data on the display screen (25).

  FIG. 2 is a block diagram showing a circuit configuration of the server device 10 in the server-based computing system.

  The server device 10 includes a CPU 11 as a computer. The CPU 11 includes a memory 12 including a hard disk and a flash ROM, a storage unit 13 including a RAM, a transmission / reception control unit 14 with the client device 20, and a display unit. 15, an input unit 16, and a storage medium read / write unit 18 for reading / writing data from / to an external storage medium 18a such as an optical disk or a magnetic disk.

  The CPU 11 stores a system program stored in the memory 12 in advance, or read and stored in the memory 12 from the external storage medium 18a, or read and stored in the memory 12 from a program server on the network N. According to various application programs, the storage unit 13 is used as a working memory to control the operation of each part of the circuit. The client device 20 (20P, 20M) is received via the key input signal from the input unit 16 or the transmission / reception control unit 14. ),... Are started and executed in response to a processing command signal corresponding to a user operation (input event).

  In the server device 10, various data generated in accordance with an application program that is activated and executed in response to an input event signal from the client device 20 is stored in the memory 12 in association with the user ID, for example. Further, the drawing data for display is written in the virtual frame buffers (FB) 12a, 12b,... Prepared in the memory 12 corresponding to the client devices 20. Then, it is converted into transfer drawing data obtained by extracting an image change portion (difference) between the previous drawing data and the current drawing data, transferred from the transmission / reception control unit 14 to the client device 20 and displayed.

  In addition, a display management area 13A is secured in the storage device 13 of the server device 10.

  FIG. 3 is a diagram showing the contents of the management data in the display management area 13 </ b> A secured in the storage unit 13 of the server device 10.

  In this display management area 13A, display mode management data ("1" or "0") set and notified for each client device 20 ... is an identifier (A, B) for each client device 20 ... ,...), And management data “1” “0” indicates the central display mode setting “present” “non-existent”.

  When the server apparatus 10 receives an instruction signal for operating a specific object area (list box, text box, etc.) on the drawing data from the client apparatus 20 set to the central display mode, the server apparatus 10 performs the drawing. In order to display the object area on the data in alignment with the center of the display screen (25) of the client apparatus 20, information indicating the display position and area on the drawing data is generated and transmitted (notified) to the client apparatus 20. On the other hand, when an instruction signal for operating a specific object area (list box, text box, etc.) on the drawing data is received from the client device 20 that is not set to the central display mode, the drawing data on the drawing data is displayed. In order to display the object area in accordance with the upper left of the display screen (25) of the client apparatus 20, information indicating the display position and area on the drawing data is generated and transmitted (notified) to the client apparatus 20.

  FIG. 4 is a block diagram showing a circuit configuration of the client device 20 (20P, 20M) in the server-based computing system.

  The client device 20 includes a CPU 21 as a computer. The CPU 21 includes a memory 22 formed of a flash ROM, a storage unit 23 formed of a RAM, a transmission / reception control unit 24 with the server device 10, and a display controller 25a via a bus 27. A storage medium read / write unit 28 for reading / writing data is connected to the display unit 25, the input unit 26, and an external storage medium 28a such as a memory card.

  The display controller 25a includes a frame buffer (FB) 25b. The frame buffer (FB) 25b is generated and transferred by the server device 10 and decompressed, for example, a VGA (Video Graphics Array) size drawing. Data is stored. The display controller 25 a cuts out drawing data stored in the frame buffer (FB) 25 b at a display position corresponding to a user operation and an area corresponding to the display screen size of the display unit 25, and displays it on the display unit 25. Let

  At this time, if the display position and area for displaying the drawing data on the display unit 25 are notified from the server device 10, the drawing data corresponding to the display position and area is cut out and displayed on the display unit 25. To do.

  The CPU 21 stores the memory 23 in accordance with a system program (client control program) stored in the memory 22 in advance, or read from the external storage medium 28a into the memory 22 or read from the program server on the network N into the memory 22. Is used as a working memory to control the operation of each part of the circuit. A key input signal from the input unit 26, an application response signal received from the server device 10 via the transmission / reception control unit 24, transfer drawing data, display position / The client control program is activated and executed according to the area information.

  In this server-based computing system, drawing data generated by the server device 10 in response to an event such as a key input from the client device 20 is updated after each drawing data is generated and updated. The difference area is extracted and transferred to the client device 20 as transfer drawing data. Then, with respect to the drawing data already stored and displayed in the frame buffer (FB) 25b in the client device 20, only the image change area is sequentially rewritten and displayed and updated. As a result, the amount of data transferred from the server device 10 to the client device 20 is greatly reduced.

  Next, in the server-based computing system configured as described above, when a specific object area (list box LB or text box TB) displayed on the display screen (25) of the client device 20 is selected and designated as an operation target Next, a display function corresponding to the selected object for displaying the specific object region in accordance with the display screen (25) based on the control in the server device 10 will be described.

  FIG. 5 is a diagram showing a display control operation (part 1) when the list box LB is selected and opened on the display screen (25) of the client device 20 in the server-based computing system.

  FIG. 6 is a diagram showing a display control operation (part 2) when the list box LB is selected and opened on the display screen (25) of the client device 20 in the server-based computing system.

  FIG. 7 is a diagram showing a display control operation when a text box TB is instructed on the display screen (25) of the client device 20 in the server-based computing system.

  5 to 7, “G” is, for example, VGA size drawing data stored in the frame buffer (FB) 25 b of the client device 20, and “E” is displayed on the display unit 25 in the drawing data G. Display screen area, “LB” is a list box that is present and developed on the drawing data G, “M” is a tap mark that is tapped by the user when selecting the list box LB, and “TB” is drawing data. A text box “F” on G is a focus mark that is designated and operated by the user when selecting and instructing the text box TB.

  The display screen area E (25) for the drawing data G (FB) is based on the start point coordinates (DX, DY) corresponding to the upper left of the display screen area E and the start point coordinates (DX, DY). It is managed by the vertical length DH and the horizontal length DW.

  Note that the area size of the list box LB and the text box TB, which are operation target object areas existing on the drawing data G, is managed by the vertical length LH and the horizontal length LW.

  That is, for example, as shown in FIG. 5A, when the tap mark M of the list box LB existing on the drawing data G is tapped, the expanded list box LB fits in the display screen area E. Further, as shown in FIG. 5B, the cutout position and area for the drawing data of the display screen area E are controlled to be changed.

  For example, as shown in FIG. 6A, when the tap mark M of the list box LB existing on the drawing data G is tapped, the horizontal length LW of the expanded list box LB is the above-described length LW. When the display screen area E does not fit in the horizontal length DW, the display screen area E is rotated horizontally to fit the list box LB as shown in FIG. 6B. The cut-out position and area for E drawing data are controlled to be changed.

  Similarly, for example, as shown in FIG. 7A, when the focus mark F is designated and operated in a text box TB existing on the drawing data G, the horizontal length LW of the text box TB is the display screen. When the display screen area E does not fit in the horizontal length DW of the area E, the display screen area E is rotated horizontally to fit the text box TB so that the text box TB is accommodated as shown in FIG. Control to change the cutout position and area for the drawing data.

  FIG. 8 is a flowchart showing server control processing by the server device 10 of the server-based computing system.

  FIG. 9 is a flowchart showing object selection processing accompanying server control processing of the server device 10.

  FIG. 10 is a flowchart showing client control processing by the client device 20 of the server-based computing system.

  First, in the client device 20, when a connection request to the server device 10 is instructed by a user operation of the input unit 26, a connection establishment processing request is transmitted from the transmission / reception control unit 24 to the server device 10 (step B1 in FIG. 10). ), A connection establishment process based on an authentication process with the server device 10 is executed (step B2).

  When the server apparatus 10 receives the connection establishment process request transmitted from the client apparatus 20 (step S1 in FIG. 8), it is based on the authentication process with the client apparatus 20 that is the connection request source. A connection establishment process is executed (step S2).

  Thereby, in a state where the connection between the server apparatus 10 and the client apparatus 20 is established, an input such as opening an arbitrary Web page in response to a user input on the client apparatus 20 (step B3 (YES) in FIG. 10). When the event is accepted (step B4 (YES)), the input event is transmitted to the server device 10 (step B5).

  When the server device 10 receives an input event for opening, for example, a Web page transmitted from the client device 20 (step S3 (YES) in FIG. 8), the server device 10 responds to an application program such as a Web browser. An operation signal corresponding to the input event is transmitted (step S4), and processing corresponding to the input event is performed by the application program. In this case, a user-specified web page is opened, and the drawing data is sent to the event input source. A process of writing to the frame buffer (FB) 12a in the memory 12 corresponding to the client device 20 and converting it into transfer drawing data and transmitting it to the client device 20 is executed (step S5 (NO) → S6).

  When the client device 20 receives, for example, the drawing data of the Web page transmitted from the server device 10 (step B9 (YES) in FIG. 10), the drawing data G already stored in the frame buffer (FB) 25b. (Step B12 (YES)), and the drawing data determined as the difference image is written to the frame buffer (FB) 25b (step B15).

  For example, in the initial stage of opening a web page, drawing data of the entire page is received as a difference image and written to the frame buffer (FB) 25b, and thereafter the drawing content of the web page is updated. Only the difference image of the drawing updated portion is received together with the position information, and the drawing data G stored in the frame buffer (FB) 25b is updated (step B9 (YES) → B12 (YES)). → B15).

  The drawing data G stored in the frame buffer (FB) 25b has the display start point coordinates (DX, DY) and the display screen size of the display unit 25 according to the user operation, for example, as shown in FIG. The display screen area E corresponding to the corresponding vertical and horizontal length (DH × DW) is cut out by the display controller 25a (step B16), and is output and displayed on the display unit 25 (step B17).

  Thus, the drawing data G generated and transferred by the server device 10 in response to a user input event in the client device 20 is stored in the frame buffer (FB) 25b while being updated sequentially, and a display screen area corresponding to a user operation E is displayed on the display unit 25.

  When the client device 20 indicates a specific object area (list box LB or text box TB) existing in the drawing data G displayed on the display unit 25 as an operation target, the object area is displayed on the display screen area E. When it is desired to display the image at the center, the center display mode is set according to the user operation of the input unit 26 (step B3 (YES) → B6).

  When the setting input of the central display mode is performed (step B6 (YES)), the central display mode setting data “1” is transmitted to the server device 10 (step B7), and the setting of the central display mode is canceled. Is input (step B6 (NO)), the setting cancellation data “0” of the central display mode is transmitted to the server device 10 (step B8).

  When the server device 10 receives the central display mode setting data “1” or the setting cancellation data “0” transmitted from the client device 20, it is stored in the display management area 13A (see FIG. 3) in the storage unit 13. The management data in the central display mode corresponding to the client device 20 that is stored and managed is set to “1” indicating the presence of setting or “0” indicating the absence of setting (step S3 (YES) in FIG. 8). → S4, S5 (NO) → S6).

(Change processing of display screen area E accompanying object selection)
In accordance with the control process between the server device 10 and the client device 20, the client device 20 cuts out the display screen area E of the drawing data G including the tap mark M of the list box LB, for example, as shown in FIG. When the tap mark M is designated and input by a user operation to open the list box LB in the state displayed on the display unit 25 (step B9 (YES) → B12 (YES) → B15 to B17 in FIG. 10), An input event signal indicating selection of the list box LB is transmitted to the server device 10 (step B3 (YES) → B4 (YES) → B5).

  When the server apparatus 10 receives an input event signal indicating selection of the list box LB transmitted from the client apparatus 20 (step S3 (YES) in FIG. 8), the selection of the list box LB (object) is selected. The determination is made (steps S4 and S5 (YES)), and the process proceeds to the object selection process in FIG. 9 (step SA).

  When this object selection process is activated, display area information (DX, DY, DW, DH) corresponding to the current display screen area E is transmitted to the client apparatus 20 to which an event input for the object selection has been performed. Is transmitted (step A1).

  When the client device 20 receives a transmission request for the current display area information (DX, DY, DW, DH) transmitted from the server device 10 (step B9 (YES) → B10 (YES) in FIG. 10). As shown in FIG. 5A, the display area information (DX, DY, DW, DH) in which the display screen area E of the drawing data G displayed on the current display unit 25 is set is sent to the server device 10. It is transmitted (step B13).

  When the server apparatus 10 receives the display area information (DX, DY, DW, DH) transmitted from the client apparatus 20 (step A2 (YES) in FIG. 9), the display area information (DX, DY, It is determined whether or not the object area (in this case, list box LB (LX, LY, LW, LH)) currently selected by the user fits within the display screen area E set by (DW, DH) (step) A3).

  Here, when the object area (LX, LY, LW, LH) selected by the user is within the display screen area E set by the display area information (DX, DY, DW, DH) of the client device 20. If it is determined (step A3 (YES)), the selected object is developed and drawn with respect to the drawing data G currently stored in the frame buffer (FB) 12a (step S8 in FIG. 8). The drawing data for transfer which consists of difference image data is transmitted to the client apparatus 20 (step S9).

  As a result, the client device 20 receives the difference image data of the selected object and updates the drawing data G stored in the frame buffer (FB) 25b (step B9 (YES) → B12 in FIG. 10). (YES) → B15), the drawing data G is cut out in a state where the selected object area fits in the display screen area E and displayed on the display unit 25 (steps B16 and B17).

  On the other hand, in step A3 in the object selection process of the server device 10, as shown in FIG. 5A, the display screen set by the display area information (DX, DY, DW, DH) of the client device 20 When it is determined that the area (LX, LY, LW, LH) of the list box LB selected by the user does not fit in the area E (step A3 (NO) in FIG. 9), the display area information It is determined whether or not correction of the list box LB in the X direction is necessary based on whether or not the width LW of the list box LB is larger than the width DW (step A4).

  Here, as shown in FIG. 5A, when the horizontal width LW of the list box LB is smaller than the horizontal width DW of the display area information, it is determined that correction of the list box LB in the X direction is not necessary. (Step A4 (NO)), the vertical and horizontal widths for setting the display area after the change are managed without change (DH → DH ′) (DW → DW ′) (Step A6).

  Then, it is determined whether or not correction of the list box LB in the Y direction is necessary based on whether or not the vertical width LH of the list box LB is larger than the vertical width DH ′ of the display area information (step A12). ).

  Here, as shown in FIG. 5A, since the vertical width LH of the list box LB is smaller than the vertical width DH ′ of the display area information, it is determined that correction of the list box LB in the Y direction is not necessary. If so (step A12 (NO)), it is determined whether or not the client device 20 is set to the central display mode “1” based on the management data stored in the display management area 13A of the storage unit 13 (step A12 (NO)). Step A14).

  If it is determined that the center display mode “1” is set (step A14 (YES)), the horizontal width LW of the list box LB is subtracted from the horizontal width DW of the display area according to the following equation (1). The remaining half is subtracted from the start point coordinate LX in the X direction of the list box LB to set the X direction start point coordinate (DX ′) of the display screen area E. Further, according to the following expression (2), half of the remainder obtained by subtracting the vertical width LH of the list box LB from the vertical width DH of the display area is subtracted from the start point coordinate LY in the Y direction of the list box LB. A direction start point coordinate (DY ') is set (step A15).

DX ′ ← LX− (DW−LW) / 2 Formula (1)
DY '← LY- (DH-LH) / 2 Formula (2)
In this case, the changed display area information (DX ′, DY ′, DW ′, DH ′) set in steps A6 and A15 is transmitted to the client device 20 (step A17).

  Then, the selected list box LB is expanded and drawn with respect to the drawing data G currently stored in the frame buffer (FB) 12a (step S8 in FIG. 8), and the transfer drawing data including the difference image data is obtained. It is transmitted to the client device 20 (step S9).

  As a result, the client device 20 changes the display screen region E for the drawing data G in accordance with the display region information (DX ′, DY ′, DW ′, DH ′) received from the server device 10 (FIG. 10). Step B9 (YES) → B11 (YES) → B14). Then, the difference image data of the list box LB transmitted from the server device 10 is received, and the drawing data G stored in the frame buffer (FB) 25b is updated (step B9 (YES) → B12 (YES) → B15), the drawing data G is cut out in accordance with the changed display screen area E (DX ′, DY ′, DW ′, DH ′), and the list box LB is displayed on the display screen as shown in FIG. It is positioned on the center of the area E and displayed on the display unit 25 (steps B16 and B17).

  On the other hand, in step A4, for example, as shown in FIG. 6A (or FIG. 7A), the horizontal width LW of the list box LB (text box TB) is larger than the horizontal width DW of the display area information. When it is determined that correction in the X direction of the list box LB (text box TB) is necessary (step A4 (YES) in FIG. 9), the horizontal width LW of the list box LB (text box TB) is the display area. It is determined whether or not the width is larger than 3/4 times the horizontal width DW of the information (step A5).

  Here, if it is determined that the width LW of the list box LB (text box TB) is larger than the width DW of the display area information, but does not exceed three-thirds (step A5 (NO) )), The vertical and horizontal widths for setting the display area after the change remain unchanged (DH → DH ′) (DH → DW ′) (step A7), and the horizontal width LW of the list box LB (text box TB) is Reduction correction is performed in accordance with the horizontal width DW 'of the display area (step A9).

  On the other hand, in step A5, for example, as shown in FIG. 6A (or FIG. 7A), the horizontal width LW of the list box LB (text box TB) is 3/3 times the horizontal width DW of the display area. If it is determined that the width is larger than (step A5 (YES)), as shown in FIG. 6B (FIG. 7B), the horizontal width DW of the current display area is changed to that of the display area after the change. The vertical width DH ′ is set, and the vertical width DH of the current display area is set as the horizontal width DW ′ of the changed display area, thereby rotating the vertical and horizontal directions of the display screen area E with respect to the drawing data G (step A8). ). Then, the horizontal width LW of the list box LB (text box TB) is reduced and corrected in accordance with the horizontal width DW ′ of the rotated display area (step A9).

  Then, whether or not the object selection process is executed by an input event corresponding to the designation operation of the tap mark M for setting the list box LB as an operation target, that is, is the selection process of the list box LB. It is determined whether the selection process is for the text box TB (step A10).

  Here, if it is determined that the selection process of the list box LB according to the designation operation of the tap mark M (step A10 (YES)), each text data described in the list box LB is stored. The font size is changed to a font size obtained by dividing the width DW ′ of the list box LB by the maximum number of characters in each item in the list (step A11). Thus, the text data in each list is adjusted to fit appropriately in accordance with the horizontal width LW of the list box LB that has been reduced and corrected in step A9.

  Thereafter, in step A12, since the vertical width LH of the list box LB (or text box TB) is larger than the vertical width DH ′ of the display area information, the list box LB (text box TB) is corrected in the Y direction. If it is determined that it is necessary (step A12 (YES)), the vertical width LH of the list box LB (text box TB) is reduced and corrected in accordance with the vertical width DH 'of the display area (step A13). ).

  If it is determined that the center display mode “1” is not set (step A14 (NO)), for example, as shown in FIG. 6B, the list box LB (text box TB) is drawn. The start point coordinates (LX, LY) are set as display start point coordinates (DX ′, DY ′) of the display screen area E after being changed (step A16).

  Then, in the case of the list box LB shown in FIG. 6 or the text box TB shown in FIG. 7, the changed display area information (DX ′, DY ′) set in steps A8 to A14 → A16. , DW ′, DH ′) are transmitted to the client device 20 (step A17).

  Then, the selected list box LB (text box TB) is expanded and drawn with respect to the drawing data G currently stored in the frame buffer (FB) 12a (step S8 in FIG. 8), and is composed of the difference image data. The drawing data for transfer is transmitted to the client device 20 (step S9).

  As a result, the client device 20 changes the display screen region E for the drawing data G in accordance with the display region information (DX ′, DY ′, DW ′, DH ′) received from the server device 10 (FIG. 10). Step B9 (YES) → B11 (YES) → B14). Then, the difference image data of the list box LB (text box TB) transmitted from the server device 10 is received, and the drawing data G stored in the frame buffer (FB) 25b is updated (step B9 (YES)). → B12 (YES) → B15). Then, the drawing data G is cut out in accordance with the rotated / changed display screen area E (DX ′, DY ′, DW ′, DH ′) as shown in FIG. 6B (or FIG. 7B). Then, the list box LB (text box TB) is displayed on the display unit 25 (DX ′, DY ′ = LX, LY) with the start point position of the rotated display screen area E (steps B16, B17).

  Thereafter, when an operation for terminating the connection with the server device 10 is performed in the client device 20 (step B18 (YES)), a connection termination processing signal is transmitted to the server device 10 (step B19). . When the server device 10 receives the connection end processing signal transmitted from the client device 20 (step S7 (YES) in FIG. 8), the connection with the client device 20 is ended (step S10). .

  Therefore, according to the display function corresponding to the selected object in the server-based computing system configured as described above, a specific object (list box LB or text box TB) on the drawing data displayed on the client device 20 is set as an operation target. When the selection is made, it is determined whether or not the object to be drawn and updated in the server apparatus 10 can be accommodated in the current display screen area E in the client apparatus 20. When it is determined that the drawing update object does not fit in the current display screen area E in the client device 20, the drawing update object on the drawing data is displayed in the display screen area E of the client device 20. The change information of the start point coordinates (DX ′, DY ′) and the vertical and horizontal widths (DH ′ × DW ′) of the display screen area E for the drawing data is generated and transmitted (notified) to the client device 20. The

  Thereby, in the client device 20, the display screen area E is changed and displayed on the display unit 25 according to the object on the drawing data updated and transferred by the server device 10, so that the client device 20 is connected to the mobile terminal. Even if the display screen is small (20M, 20P) or the like, it is possible to easily display the object area targeted by the user without changing the display screen area E.

  Further, according to the selected object corresponding display function in the server-based computing system having the above configuration, when the horizontal width LW of the object to be rendered and updated in the server device 10 is larger than the horizontal width DW of the display screen area E of the client device 20 If the horizontal width LW of the object is reduced and corrected in accordance with the horizontal width DW of the display screen area E, and the vertical width LH of the object is larger than the vertical width DH of the display screen area E of the client device 20, The vertical width LH of the object is reduced and corrected in accordance with the vertical width DH of the display screen area E.

  Further, according to the display function corresponding to the selected object in the server-based computing system having the above-described configuration, the client device 20 having the vertically long display screen area E, and the horizontal width LW of the object to be rendered and updated in the server device 10 is When the width is larger than the width DW of the display screen area E of the client device 20, the start point coordinates (DX ', DY') and the vertical width (DH '× DW') obtained by rotating the display screen area E with respect to the drawing data by 90 degrees. ) Change information is generated and transmitted (notified) to the client device 20.

  As a result, even when the client device 20 is a mobile terminal (20M, 20P) or the like and the display screen is small, it is not necessary to change the display screen area E, and the display area of the object targeted by the user can be displayed. The image can be displayed in the screen area E without fail.

  Further, according to the display function corresponding to the selected object in the server-based computing system having the above configuration, the object to be drawn and updated in the server device 10 is the list box LB, and the horizontal width LW of the list box LB is the display screen. When the reduction correction is performed in accordance with the horizontal width DW of the area E, the font size of the character data described in the list is changed in accordance with the horizontal width LW (= DW) of the reduction-corrected list box LB. Therefore, the list box LB that is the operation target of the user can be surely stored in the display screen area E and displayed.

(Other embodiments)
In the server-based computing system of the embodiment, the drawing data G generated by the server device 10 in response to the input event from the client device 20 is transferred from the server device 10 to the client device 20 that is the event input source, The client device 20 is configured to cut out and display in the display screen area E corresponding to the display unit 25. Therefore, when the specific object is selected as the operation target on the drawing data displayed on the client device 20 (step S5 (YES)), the server device 10 performs drawing update in the server device 10. Change information of the start point coordinates (DX ′, DY ′) and the vertical and horizontal width (DH ′ × DW ′) of the display screen area E for the drawing data is generated so that the object fits in the display screen area E in the client device 20. Sent (notified) to the client device 20 (step SA).

  On the other hand, as a server-based computing system according to another embodiment, the client device 20 transmits the input event on the drawing data G generated by the server device 10 every time the input event is transmitted to the server device 10. Information on the position and size of the current display screen area E (DX, DY, DW, DH) is transmitted, and the server device 10 determines the current display screen area E from the drawing data G generated in response to the input event. The drawing data of the portion corresponding to the position and size information (DX, DY, DW, DH) is cut out, transferred to the event input source client device 20, and displayed on the display unit 25.

  The information on the position and size of the display screen area E displayed on the client device 20 has its initial information stored in advance in the server device 10, and the server device 10 receives the input event transmitted from the client device 20. The position information and the size information (DX, DY, DW, DH) of the display screen area E of the client device 20 may be calculated based on the initial information.

  In such a server-based computing system according to another embodiment, when a specific object on the drawing data is selected by the client device 20 as an operation target, the server device 10 is updated by the server device 10. The start point coordinates (DX ′, DY ′) and the vertical and horizontal widths (DH ′ × DW ′) of the display screen area E for the drawing data are changed so that the specific object fits in the display screen area E of the client device 20. Information is generated (steps A2 to A16 in FIG. 9), and the drawing data of the portion corresponding to the display screen area E after the change is cut out and transferred to the client device 20. As a result, even in the server-based computing system of this other embodiment, even when the client device 20 is a mobile terminal (20M, 20P) or the like and the display screen is small, as in the above embodiment. Without changing the display screen area E, it is possible to easily display the object area targeted by the user.

  Note that each processing method by the server-based computing system described in each of the embodiments, that is, the control process of the server apparatus 10 shown in the flowchart of FIG. 8, the control process of the server apparatus 10 shown in the flowchart of FIG. Each of the methods such as the object selection process accompanying the above and the control process of the client apparatus 20 shown in the flowchart of FIG. 10 can be executed by a computer as a program that can be executed by a memory card (ROM card, RAM card, etc.), magnetic disk ( It can be stored and distributed in external recording media 18a, 28a such as a floppy disk, a hard disk, etc., an optical disk (CD-ROM, DVD, etc.), a semiconductor memory or the like. Then, the computers (CPUs 11 and 21) of the server device 10 and the client device 20 read the programs stored in the external recording media 18a and 28a into the storage devices (the memories 12 and 22 and the storage units 13 and 23) and read the programs. By controlling the operation by the program, the display function corresponding to the selected object described in the above embodiments can be realized, and the same processing can be executed by the above-described method.

  Further, program data for realizing each of the above methods can be transmitted on the communication network (N) in the form of a program code, and from a computer device (program server) connected to the communication network (N). The program data can be fetched and stored in a storage device (the memories 12 and 22 and the storage units 13 and 23) to realize the above-described display function corresponding to the selected object.

  Note that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention at the stage of implementation. Further, each of the embodiments includes inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent elements are deleted from all the constituent elements shown in each embodiment or some constituent elements are combined in different forms, the problems described in the column of the problem to be solved by the invention If the effects described in the column “Effects of the Invention” can be obtained, a configuration in which these constituent requirements are deleted or combined can be extracted as an invention.

10: Server device 20: Client device (mobile terminal)
11,21 ... CPU
12, 22 ... Memory 12a, 12b, ... Virtual frame buffer (FB)
DESCRIPTION OF SYMBOLS 13, 23 ... Memory | storage part 13A ... Display management area 14, 24 ... Transmission / reception control part 15, 25 ... Display part 25a ... Display controller 25b ... Frame buffer (FB)
DESCRIPTION OF SYMBOLS 16, 26 ... Input part 17, 27 ... Bus 18, 28 ... Storage medium read / write part 18a, 28a ... External storage medium N ... Network AP ... Access point G ... Drawing data E ... Display screen area LB ... List box M ... Tap mark TB ... Text box F ... Focus mark

Claims (5)

A display terminal device that receives large screen data generated on the server device side and displays a part of the display data on the display screen,
Setting means for arbitrarily setting whether to display the object at the center position of the display screen when displaying the object;
A notification means for notifying the server device that the object has been selected when an object included in the large screen data is arbitrarily selected by the display terminal device;
In response to the notification, whether or not the object in the large screen data does not fit on the display screen of the display terminal device is determined in the server device, and is transmitted from the server device when it is determined that the object does not fit in the display screen. Receiving means for receiving information including a display position of the object in the large screen data to be received;
When displaying the display data of the display position of the object in the large screen data on the display screen based on the information including the received display position, if the setting means displays the object center position, and Table示制control means Ru display the object at the center of the display screen,
A display terminal device comprising: When a display area transmission request in the display terminal apparatus is received from the server apparatus, display area information in the large screen data displayed on the display screen of the display terminal apparatus is transmitted to the server apparatus. Then, the server device determines whether the object does not fit on the display screen of the display terminal device based on the display area information received from the display terminal device and the display position of the object.
The display terminal device according to claim 1. The receiving means receives information including display data obtained by reducing an area of large screen data including the object when the server device determines that the object does not fit.
The display terminal device according to claim 1, wherein the display terminal device is a display terminal device. The receiving means receives information including display data obtained by rotating an area of large screen data including the object by 90 degrees when it is determined that the object does not fit in the server device.
The display terminal apparatus as described in any one of Claims 1-3 characterized by the above-mentioned. A program for controlling a computer of a display terminal device that receives large screen data generated on the server device side and displays part of the display data on the display screen,
The computer,
Setting means for arbitrarily setting whether or not to display the object at the center position of the display screen when displaying the object;
A notification means for notifying the server device that the object is selected when an object included in the large screen data is arbitrarily selected by the display terminal device;
In response to the notification, whether or not the object in the large screen data does not fit on the display screen of the display terminal device is determined in the server device, and is transmitted from the server device when it is determined that the object does not fit in the display screen. Receiving means for receiving information including a display position of the object in the large screen data
When displaying the display data of the display position of the object in the large screen data on the display screen based on the information including the received display position, if the setting means displays the object center position, Table示制control means Ru display the object at the center of the display screen,
A computer-readable program designed to function as a computer.

Images