JP2007264440A - Client device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce the power consumption of a client device having mobile properties, and to improve the visibility of a display screen of the client device, by reducing the frequency in communication between a server device and the client device in a server-based computing. <P>SOLUTION: The client device includes a means for storing a frame memory for display on the client device; a means for receiving display screen data from the server device; a means for receiving a layout image as a whole from the server device; a means for discriminating whether display data within a range of the frame memory is updated by updating display data by a screen updating operation; a means for generating discrimination information, indicating the effective range of the frame memory, for the general layout image, on the basis of the discrimination result; and a means for displaying a layout image as a whole, reflecting contents of the frame memory and the generated discrimination information indicating the effective range of the frame memory. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention is configured such that a client device that makes a service request to a server device that operates an application program and a server device that operates an application program based on the service request from the client device can be connected to each other via a network. Server-based computing system.

In recent years, the adoption of server-based computing by companies has been rapidly progressing.
Server-based computing is a system in which a client device and a server device can be connected to each other via a network. When a client device makes a service request to the server device, the server device receives a request from the client device. Data management and application programs are operated based on service requests (see, for example, Patent Document 1 and Non-Patent Document 1).

  The server device creates display data for the client and sends it to the client device. In a client device (also called a thin client device), operation information such as a user's key and mouse is sent to a server device via a network, and display data for a client created on the server device side is received and displayed. . The client device only needs to include an input device such as a network device, a display device, and a mouse and a keyboard. Since no data is stored in the client device, storage such as a hard disk is not required, and application programs are not executed. Therefore, the processing load required for the client device is light.

By introducing server-based computing, companies can manage resources such as data and application programs on the server device side, which has the advantage of reducing operational costs. In addition, the client device has an advantage that it can be procured at a lower cost than a conventional personal computer. Also in terms of security, it is possible to reduce the risk of unauthorized access to information by restricting access to data in the server device and collecting access logs. It is possible to deal with viruses in a batch with the server device.
JP 2005-228227 A http: // www. keyman. or. jp / search / 30000031_1. html (server-based computing)

  As described above, when server-based computing is executed, a client device that makes a service request to the server device that operates the application program, and a server that operates the application program based on the service request from the client device The apparatus is configured to be connectable to each other via a network.

  When the client device is a mobile terminal device, it is a client device that places importance on mobility, so that the display screen cannot be made large. For example, a 4-inch HVGA (640 × 240) is much smaller than a standard desktop personal computer display size of 15 inches, XGA (1024 × 768). Therefore, every time the display data of the client device is changed in response to the operation of the client device, it is necessary to transmit the display data from the server device to the client device. In particular, when the display screen of the client device is small, access to the server device frequently occurs, increasing the power consumption of the mobile terminal device. Furthermore, when the mobile terminal device is battery-driven, it can be used only for the time corresponding to the installed battery capacity. Also, a large battery pack cannot be used to maintain mobility. In other words, performing server-based computing on a mobile terminal device means using a radio unit that occupies most of the power consumption in the mobile terminal device, which greatly limits the usage time of the mobile terminal device. There was a problem.

  Therefore, the present invention has been made in view of the above problems, and in server-based computing, the frequency of communication between the server device and the client device is reduced, and the power consumption of the client device having mobility is achieved. Another object of the present invention is to provide a server-based computing system that can reduce the visibility and improve the visibility of the display screen of the client device.

The present invention employs the following configuration in order to solve the above problems.
That is, according to one aspect of the present invention, the client device of the present invention is configured such that a server device that operates a program based on a service request from a client device and the client device can be connected to each other via a network. In the server-based computing system, a frame memory storage means for storing a frame memory for display of the client device, a display screen data receiving means for receiving display screen data from the server device, and an overall layout from the server device Based on the determination result of the overall layout image receiving means for receiving the image, the determination means for determining whether the update of the display data by the operation of the screen update is the update of the display data within the range of the frame memory, The frame is added to the entire layout image. Effective range identification information generating means for generating identification information indicating the effective range of the memory, and display means for displaying the entire layout image reflecting the contents of the frame memory and the identification information indicating the generated effective range of the frame memory; It is provided with.

In the client device of the present invention, it is preferable that the identification information generated by the effective range identification information generation unit is a frame.
In the client device of the present invention, it is preferable that the identification information generated by the effective range identification information generation unit is a shade of an image.

  According to an aspect of the present invention, the client device of the present invention is configured such that a server device that operates a program based on a service request from the client device and the client device can be connected to each other via a network. In the server-based computing system, a frame memory storage means for storing a frame memory for display of the client device, a display screen data receiving means for receiving display screen data from the server device, and an overall layout from the server device An overall layout image receiving means for receiving an image; a determining means for determining whether updating of display data by a screen update operation is updating of display data within the range of the frame memory; and a determination result of the determining means is the frame memory Update of display data outside the range A message generating means for generating a message for alerting the user, and a display means for displaying the contents of the frame memory, the entire layout image, and the generated message. To do.

  According to one aspect of the present invention, the program of the present invention is configured such that a server device that operates a program based on a service request from a client device and the client device can be connected to each other via a network. In a server-based computing system, the client device computer includes a display screen data receiving unit that receives display screen data from the server device, an entire layout image receiving unit that receives an entire layout image from the server device, and a screen update operation. Determining means for determining whether the display data is updated by display data within the range of the frame memory, and based on the determination result of the determining means, identification information indicating the effective range of the frame memory is added to the overall layout image. Generate valid range identification information It means a program for functioning as display means for displaying the entire layout image reflecting the identification information indicating the content and scope of the frame memory generated in the frame memory.

  According to one aspect of the present invention, the program of the present invention is configured such that a server device that operates a program based on a service request from a client device and the client device can be connected to each other via a network. In a server-based computing system, the client device computer includes a display screen data receiving unit that receives display screen data from the server device, an entire layout image receiving unit that receives an entire layout image from the server device, and a screen update operation. A discriminating means for discriminating whether or not the display data update by the disc update is an update of the display data within the range of the frame memory, and when the discrimination result of the discriminating means is an update of the display data outside the range of the frame memory Generate a message to alert Message generating means, the contents of the frame memory, a program for functioning as display means for displaying the entire layout image and the generated message.

  According to the present invention, in server-based computing, the frequency of communication between the server device and the client device is reduced, the power consumption of the client device having mobility is reduced, and the display screen of the client device is visually recognized. Can improve sex.

  In addition, according to the present invention, even when there is no valid data for display in the frame buffer when the screen change operation such as scrolling of the client device is performed and the server needs to be accessed, the user can view the frame by viewing the entire layout. Since the effective range of the buffer can be confirmed, it is possible to decide whether or not to access the server according to the user's intention. As a result, it is possible to prevent unnecessary access to the server, thereby reducing the power consumption of the client device and improving the user operability.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing an outline of a network configuration of server-based computing.

In FIG. 1, a server apparatus 101 has a function of executing an application program, a function of managing data, and the like.
The client terminal device 102 is connected to the server device 101 via the network 109. The wireless access point 103 is also connected to the server apparatus 101 via the network 109. In addition, mobile terminal devices such as the mobile terminal device 104 and the smartphone 105 are connected to the server device 101 via the network 9 by performing wireless communication with the access point 103. In the following description, the client terminal device 102, the mobile terminal device 104, and the smartphone 105 are collectively referred to as a client device.

  The client terminal device 102, the mobile terminal device 104, or the smartphone 105 constructs a server-based computing system with the server device 101.

  The mobile terminal device 104 is connected to the server device 101 via a wireless network (for example, WiFi) and the access point 103. A mobile terminal device such as the mobile terminal device 104 is designed with low power consumption in consideration of battery life.

FIG. 2 is a diagram illustrating an example of a breakdown of power consumption of the mobile terminal device 104.
The mobile terminal device 104 consumes power mainly in the LSI unit, the display unit, and the radio unit as shown in FIG. In the example shown in FIG. 2, the wireless unit is operating 100%. If the non-communication period with the server apparatus 101 can be long, the wireless unit can be powered down. However, in general, communication is frequently performed.

  As shown in FIG. 2, the power consumption of the wireless unit occupies 65% of the power consumed by the mobile terminal device 104. Since the mobile terminal device 104 is battery-driven, the mobile terminal device 104 can only use time according to the installed battery capacity, and performing server-based computing in the mobile terminal device 104 means that the power consumption in the mobile terminal device 104 is reduced. The radio unit occupies the majority, and this limits the usage time of the mobile terminal device 104.

  In the server-based computing system to which the present invention is applied, the entire layout image obtained by reducing the frame buffer in the server device is transferred to the client terminal device in advance, and if the operation is within the terminal frame buffer, the entire layout image is transferred. Is used to display the entire layout image on the client device side. When the contents of the image are updated, the entire layout image is transferred from the server device. However, if there are few changes in the image, the entire layout image is not transferred and the entire image remaining in the client device. Use layout images.

FIG. 3 is a diagram illustrating an appearance of the mobile terminal device 104.
In FIG. 3, the mobile terminal device 104 includes an LCD 210 and a keyboard 904. The keyboard 904 includes a cross cursor key including an up cursor key 902a, a right cursor key 902b, a down cursor key 902c, and a left cursor key 902d, and a pointer 901 that is normally operated with the right hand at the center of the cross cursor key. The keyboard 904 includes a left click key 901a and a right click key 901b. When the pointer 901 is operated with the right hand, the right click and the left click operate the left click key 901a and the right click key 901b with the left hand. The keyboard 904 has a slide bar 910 for general use at a position where it can be easily operated with the right hand. The slide bar 910 has a function of scrolling up and down (vertical scrolling). For example, when the slide bar 910 is operated with the left hand while the shift key 905 is pressed, the display screen is reduced in the upward sliding operation, and the sliding screen in the downward direction is operated. The display screen is enlarged.

FIG. 4 is a diagram showing an outline of the configuration of the mobile terminal device 104 to which the present invention is applied.
In FIG. 4, the mobile terminal device 104 includes an LSI 200, an LCD 210, a program storage memory 212, and a work memory 213.

  The LSI 200 is configured by SOC (System On Chip). The internal configuration of the LSI 200 will be described. The CPU 201 controls communication with each unit via an internal bus (Bus) 204a. A memory controller (Mem. Cont.) 204 controls the internal bus 204b, a work memory 213 such as SDRAM, and a program storage memory 212 such as FROM. The LCDC (LCD controller) 202 uses the built-in memory 203 such as a RAM built in the LSI 200 to transfer display data to the LCD 210 (display unit). Further, it is configured by a UART (Universal Asynchronous Receiver) 206, a power management block (Power Mgmt) 207, a real-time counter (RTC) 205, a USB function (USBF) 208, and the like. The wireless communication unit 209 enables communication by WiFi and is connected to the UART 206.

  The display screen of the mobile terminal device 104 is, for example, a 4-inch HVGA (640 × 240), and is smaller than a display screen that is typically used in a personal computer, for example, a 15-inch XGA (1024 × 768). For this reason, display by the virtual display method is performed. That is, the server 101 executes the application as XGA (1024 × 768). On the other hand, the frame buffer in the built-in memory 203 of the mobile terminal device 104 secures an area as XGA. Only the HVGA area which is the size of the LCD 210 is selectively displayed on the mobile terminal device 104.

FIG. 5 is a diagram showing an internal configuration of the LCDC 202.
In FIG. 5, the LCDC 202 is connected to the internal bus 204 a of the LSI 200 via a bus interface (BUS I / F) 301. The register (Reg.) 302 stores various setting information for the LCDC 202. A memory controller (Memory Cont.) 303 controls a built-in memory (memory for storing display data) 203. The memory controller 303 includes a DMAC (direct memory access controller) 303a. The DMAC 303 a manages data transfer from the built-in memory 203 to the LCD 210.

  An FBCT (frame buffer control table) 320 is connected to the memory controller 303, monitors the display data writing state from the CPU 201 to the internal memory 203, and manages valid data in the frame buffer in the internal memory 203.

  Display data read from the internal memory 203 by the DMAC 303a is synchronized by a FIFO (first-in first-out memory) 304, and then processed to a desired enlargement ratio by a resizer 305 having an enlargement / reduction function. . Then, synchronization is taken by the FIFO 306.

  The internal memory 203 also stores an entire reduced image corresponding to the frame buffer of the server apparatus 101 (the operation will be described later). The entire reduced image read by the memory controller 303 is synchronized by the FIFO 307. Further, the frame drawing unit 308 draws the currently displayed position as a frame in the entire image. The FBCT 320 instructs the effective part drawing unit 321 to draw the effective management portion of the frame buffer in the internal memory. Then, the overall reduced image, the frame, and the effective management part are synthesized by the α blend synthesizer 322 as an overall layout display.

  Further, the α blend synthesizer 309 synthesizes the display image synchronized by the FIFO 306 and the entire layout image synthesized by the α blend synthesizer 322. After synchronizing with the FIFO 310, the display data is transferred to the LCD 210 (display unit) via the LCD I / F 311 to display an image. The display unit of the mobile terminal device 104 has a display area of HVGA (640 × 240), while the frame buffer in the built-in memory of the mobile terminal device 104 has a region of VGA (640 × 480). Then, display data equivalent to HVGA (640 × 240) is read from the area of the frame buffer and displayed on the display unit. The display area of the display section and the area of the frame buffer are not limited to the above example, and any area may be used as long as the area of the frame buffer is set larger than the display area of the display section. As described above, the internal memory 203 also stores the overall reduced image. The area currently displayed on the display unit in the overall reduced image is drawn by the frame drawing device 308, and is used as the overall layout image. Generated, synthesized and displayed on a part of the display unit.

FIG. 6 is a diagram showing an outline of the configuration of the server apparatus 101.
In FIG. 6, the server apparatus 101 includes a CPU (Central Processing Unit) 701, a program for executing processing executed in the server apparatus 101, and a control program for controlling and executing each function of the server apparatus 101. A memory 702 such as a ROM or a RAM in which an image is stored, an input unit 703 for inputting various data and signals, a display unit 704 for displaying images and other information, and recording various information including images. A storage unit 705 for driving, a recording medium driving unit 706 for driving an external recording medium, and a network connection unit 707 for connecting to a network 109 such as a LAN are connected to the bus 700, and the CPU 701 controls each of these units. ing.

FIG. 7 is a diagram showing the frame buffer 500 and the entire reduced image 502 on the server apparatus 101 side.
The server apparatus 101 executes an application program with a resolution (display size) of XGA (1024 × 768) and handles a frame buffer 500 equivalent to XGA. On the other hand, on the mobile terminal device 104 side, there is only an HVGA (640 × 240) display area, and display is selectively performed from the XGA area. Although the display area of the mobile terminal apparatus 104 is HVGA, the frame buffer 600 (see FIG. 8) on the mobile terminal apparatus 104 side also has an XGA area. The server apparatus 101 does not transfer the entire XGA area to the mobile terminal apparatus 104 at once, but sequentially transfers only the area to be displayed on the mobile terminal apparatus 104.

  7A shows the frame buffer 500 of the server apparatus 101 and the VGA size area 501 that has already been transmitted to the mobile terminal apparatus 104, and the upper left coordinates of the area 501 that has already been transmitted to the mobile terminal apparatus 104. Although the width and height are not shown, the server device 101 manages and stores each client such as the mobile terminal device 104 and transfers it to the mobile terminal device 104 at a desired timing. FIG. 7B shows an overall reduced image 502 obtained by reducing the frame buffer 500 on the server device 101 side to 1 / n. The overall reduced image 502 and its reduction rate are the mobile terminal device 104 on the server device 101 side. Are stored for each client, and transferred to the mobile terminal device 104 when the contents of the frame buffer 500 are rewritten.

FIG. 8 is a diagram for explaining the states of the frame buffer 600 and the LCD 210 (display unit) of the mobile terminal device 104.
The frame buffer 600 of the mobile terminal device 104 has an area corresponding to XGA. The effective data area in the frame memory 600 is managed by the FBCT 320, and is, for example, the effective area 601 (FIG. 8A). At this time, the display area 602 is drawn on the LCD 210 (FIG. 8B). Here, data has already been sent from the server apparatus 101 so that the display area 602 always fits within the effective area 601.

  FIG. 8C shows an overall layout 604. A frame 606 indicating a currently displayed area and a data area 603 (outlined part in the figure) that is valid in the frame buffer 600 are shown. It is displayed so that it can be identified, and the layout of the entire XGA can be discriminated. FIG. 8D shows an LCD display image 605 displayed on the LCD 210. An overall layout 604 is displayed on the upper right in the figure.

An example in which the screen is scrolled downward (vertically scrolled) in this state will be described.
FIG. 8E shows the display area 602 and the effective area 601 after scrolling down. In this state, an LCD display image 605 including the entire layout 604 is displayed on the LCD 210 as shown in FIG.

FIG. 9 is a diagram for explaining the operation of the FBCT 320.
The FBCT 320 corresponds to the frame buffer 500 in the server apparatus 101 described with reference to FIG.

  FIG. 9A shows a frame buffer 600 in the mobile terminal device 104. Of this frame buffer 600, only the data valid area 601 is valid data. FIG. 9B shows a management state in the FBCT 320 in the state of FIG. The management table 800 is divided into mesh-like small areas 802 and managed in units of divided small areas 802. When the CPU 201 accesses the frame buffer 600 via the memory controller 303, the corresponding address is checked on the management table 800. An area 801 corresponding to the valid data area 601 is checked in the management table 800. With such a configuration, when the FBCT 320 receives an inquiry from the CPU 201, the FBCT 320 can answer whether the inquiry area exists as valid data in the frame buffer 600.

  When a right scroll (horizontal scroll) operation is performed, the deficient data is replenished from the server apparatus 101, and the effective area 601 extends to the right side of the screen as shown in FIG. 9C. The management table 800 in the FBCT 320 at this time is as shown in FIG.

Next, the operation in the mobile terminal device 104 constituting the server-based computing system described above will be described.
FIG. 10 is a flowchart showing a flow of main processing executed in the mobile terminal device 104.

First, when any operation is executed in the mobile terminal device 104 in step 1000, the operation content is determined in step 1001.
If it is determined that the operation executed in step 1000 is a screen reduction operation (step 1001: reduction operation), in step 1002, whether there is valid data that can be reduced in the mobile terminal device 104. Judge whether or not. If there is data (step 1002: present), a reduction process is executed in the mobile terminal device 104 in step 1004. On the other hand, if there is no data (step 1002: none), the server device 101 in step 1009. The reduction process is executed with.

  If it is determined that the operation executed in step 1000 is a rotation operation of the screen (step 1001: rotation operation), valid data that can be instructed to rotate is stored in the mobile terminal device 104 in step 1003. Judge whether or not there is. If there is data (step 1003: present), the rotation processing is executed in the mobile terminal device 104 in step 1005. On the other hand, if there is no data (step 1003: none), the server device 101 in step 1010. Execute the rotation process with.

  Also, if it is determined that the operation executed in step 1000 is a screen enlargement operation (step 1001: enlargement operation), only the portion displayed on the mobile terminal device 104 is enlarged. In step 1006, enlargement processing is executed in the mobile terminal device 104.

  If it is determined that the operation executed in step 1000 is a scroll operation of the screen (step 1001: scroll operation), in step 1007, scroll processing described later is executed using the flowchart shown in FIG.

  If it is determined that the operation is not a reduction operation, a rotation operation, an enlargement operation, or a scroll operation, for example, another operation such as a mouse operation or a key operation (step 1001: other), the operation content is determined in step 1008. Is sent to the server apparatus 101, and display data is generated by processing in the server apparatus 101.

FIG. 11 is a flowchart showing the flow of the scroll process.
In FIG. 11, steps 1100 to 1109 are flowcharts showing the flow of scroll processing of the mobile terminal device 104, and steps 1120 to 1124 are flowcharts showing processing of the server device 101 in response to the scroll processing of the mobile terminal device 104. It is.

If it is determined in step 1001 in FIG. 10 that the scroll operation is performed, the scroll process is started.
First, when the CPU 201 in the mobile terminal device 104 detects a scroll operation in step 1100 in FIG. 11, in step 1101, it is determined whether the scroll destination is a movement in the effective area 601 in the frame buffer 600. judge. That is, the LCD (display unit) 210 of the mobile terminal device 104 is an HVGA (640 × 240) display area, but the frame buffer 600 has a VGA (640 × 480) area 601, so that a new display is made by scrolling. When the display data is read from the area of the frame buffer 600, it is determined whether or not the display data range is within the display area stored in the frame buffer 600. The area read and displayed on the LCD (display unit) 210 is stored and managed in the built-in memory 203 in the frame buffer 600 with the upper left coordinates, height, and width. This determination is realized by the CPU 201 inquiring the FBCT 320 in the LCDC 202 about the destination address and size in the frame buffer 600.

  If it is determined in step 1101 that the range of display data to be newly displayed by scrolling is outside the range of the display area stored in the frame buffer 600 (step 1101: out of range), the content of the frame buffer 600 is determined in step 1102. The server apparatus 101 is requested to rewrite data. In this data request, a scroll event is sent to the server apparatus 101.

  Upon receiving this event, the server apparatus 101 receives the data transmitted from the mobile terminal apparatus 104 in step 1120 and transfers the data required by the mobile terminal apparatus 104 into the frame buffer 600 in step 1121. Data is selected and compressed in step 1122 for transfer of the selected data. In step 1123, the compressed data is transferred to the mobile terminal device 104. In step 1124, the data transferred to the mobile terminal device 104 is also managed in the frame buffer 500 in the server device 101.

  The mobile terminal device 104 receives the compressed display data transferred from the server device 101 in step 1103, decompresses the compressed display data in step 1104, and decompresses the decompressed display data in step 1105. Write (update) to the frame buffer 600. In step 1106, the writing to the frame buffer 600 is monitored, the FBCT (frame buffer management table) 320 is updated, and the process proceeds to step 1107.

  In step 1107, the display area on the LCD (display unit) 210 in the frame buffer 600 is designated to the LCDC 202. When the display area is designated by the CPU 301, the display image selectively designated by the memory controller 204 is read from the frame buffer 600 in the built-in memory 203 in the LCDC 202.

  In step 1108, the entire layout is generated (details will be described later with reference to FIGS. 12 and 13). In step 1109, the entire layout generated in step 1108 and the α blend generator 309 are combined and displayed. Is formed. A display is made on the LCD 202. The α blend generator 309 can set how many percent of the entire layout 604 is superimposed on the LCD display image 605. If 100%, the entire layout 604 is formed on the LCD display image 605 in an overwritten form. If the α blend generator 309 is designated as 50%, the user can also recognize the LCD display image 605 formed under the overall layout 604 by setting 50%, and the display area can be changed. It can be used effectively.

  On the other hand, if the determination in step 1101 is within the range (step 1101: within the range), the process proceeds to step 1107 without performing any data request to the server apparatus 101, and the subsequent processing is executed.

FIG. 12 is a flowchart showing the flow of the first overall layout generation process.
First, in step 1201, an area to be displayed in the frame buffer 600 is set in the LCDC 202, and a frame indicating the display area is drawn by the frame drawing unit 308. Specifically, the entire reduced image 502 is read from the built-in memory 203, and the upper left coordinates indicating the display area (frame buffer 600) of the mobile terminal device 104 received from the server device 101, its width and height, and the entire reduced image are displayed. Based on the reduction ratio of 502, an area corresponding to the frame buffer 600 on the entire reduced image 502 is obtained. The area read out and displayed on the LCD 210 is stored and managed in the built-in memory in the upper left coordinates, height, and width on the frame buffer 600, so that the area corresponding to the frame buffer 600 on the entire reduced image 502 is currently displayed. A frame 606 indicating the currently displayed region after being corrected to the displayed region is drawn on the entire reduced image 502 by the frame drawing device 308 to generate the entire layout 502.

  Next, in step 1202, the effective part drawing unit 321 generates an image with a difference in density inside and outside the effective data area in the frame buffer 600 according to an instruction from the FBCT 320. Here, the effective data area is outlined, and the others are darkened.

  In step 1203, the overall reduced image 502 held in the built-in memory 202 is read out, and the overall reduced image 502, the frame 606, and the light and shade are combined to display the overall layout 502. When the contents of the frame buffer 500 in the server device 101 are updated, the entire reduced image 502 is transferred to the mobile terminal device 104 and stored in the built-in memory 202.

FIG. 13 is a flowchart showing the flow of the second overall layout generation process.
First, in step 1301, an area to be displayed in the frame buffer 600 is set in the LCDC 202, and an image having shading inside and outside the display area is generated by the frame drawing device 308. For example, the display area is thin and the outside of the display area is a dark image.

Next, in step 1302, the valid part drawing unit 321 draws a frame in the valid data area in the frame buffer 600 according to an instruction from the FBCT 320.
In step 1303, the entire reduced image 502 held in the built-in memory 202 is read out, and the entire reduced image 502, the shade and the frame 606 are combined to display the entire layout 502.

  As described with reference to FIGS. 12 and 13, the display area 602 displayed on the LCD 210 is indicated by the frame 606 or the gray image in the overall layout 604. However, the present invention is not limited to this.

Next, a modified example of the scroll process described with reference to FIG. 11 will be described.
FIG. 14 is a flowchart showing a first modification of the scroll process.
First, in step 1400, when the CPU 201 in the mobile terminal device 104 detects a scroll operation, in step 1401, it is determined by inquiring the FBCT 320 whether the display after scrolling is in the valid data area.

  If it is determined that the data is within the valid data (step 1401: within the range), in step 1402, 0 is substituted for the variable K, and the process proceeds to step 1107 in FIG. Here, the variable K is a variable used for detecting a scroll movement from valid data to outside valid data.

  On the other hand, if it is determined in step 1401 that it is not within the valid data (step 1401: out of range), in step 1403, it is determined whether or not the variable K is zero. Here, if the variable K is 0, it indicates that the previous scroll process was an operation within the valid data range. If the variable K is not 0, the previous operation was also outside the valid data range. It will show that.

  If it is determined in step 1403 that the variable K is 0, that is, if it was determined that the previous time was within the valid data range (step 1403: Y), 1 is set in the variable K in step 1404, and the next time Prepare for operation.

  Next, in step 1405, the message is displayed for a certain period. For example, a message such as “I will connect to the server to access data outside the cache” is displayed for one second. Then, after the message display period elapses, it is determined in step 1406 whether or not the scroll operation is continued. If the scroll operation has ended (step 1406: end), the scroll process ends. On the other hand, if it is continuing (step 1406: continuing), the process proceeds to step 1102 in FIG.

  Also, when it is determined in skip 1403 that the variable K is not 0, that is, when it is determined that the previous time is also outside the valid data range (step 1403: N), the process proceeds to step 1102 in FIG. Process.

  In the first modified example, the message is displayed for a certain period, but the scrolling operation may be stopped for a certain period, for example, 0.5 seconds. In this case, the processing in step 1405 is “delay for a certain period”. By temporarily stopping the scroll operation, the user can know that there is no valid data in the mobile terminal device 104 and communication with the server device 101 starts when the operation is continued further.

FIG. 15 is a flowchart showing a second modification of the scroll process.
First, in step 1500, when the CPU 201 in the mobile terminal device 104 detects a scroll operation, in step 1501, it is determined by inquiring the FBCT 320 whether the display after scrolling is in the valid data area.

  If it is determined that the data is within the valid data (step 1501: within range), in step 1502, 0 is substituted for the variable K, the process proceeds to step 1107 in FIG. Here, the variable K is a variable used for detecting a scroll movement from valid data to outside valid data.

  On the other hand, if it is determined in step 1501 that it is not within the valid data (step 1501: out of range), it is determined in step 1503 whether or not the variable K is zero. Here, if the variable K is 0, it indicates that the previous scroll process was an operation within the valid data range. If the variable K is not 0, the previous operation was also outside the valid data range. It will show that.

  If it is determined in step 1503 that the variable K is 0, that is, if it was determined that the previous time was within the valid data range (step 1503: Y), 1 is set in the variable K in step 1504, and the next time Prepare for operation.

  Next, in step 1505, a confirmation dialog is displayed together with a confirmation message, and the user is prompted to determine whether or not to continue the process (for example, if the process can be continued, the “Y” key is pressed). If not, prompt the user to press an “N” key other than the “Y” key). In step 1506, if the key input by the user is the “Y” key (step 1506: Y (movement)), the process proceeds to step 1102 in FIG. On the other hand, if it is determined that a key other than the “Y” key has been input (step 1506: N)), the scroll process ends.

  If it is determined in skip 1503 that the variable K is not 0, that is, if it is determined that the previous time is also outside the valid data range (step 1503: N), the process proceeds to step 1102 in FIG. Process.

Note that the scrolling in this scrolling process is not limited to vertical scrolling and may be horizontal scrolling.
In addition, when the scroll operation is an operation exceeding the effective area 601 of the frame buffer 600, not only a message for alerting the user but also a sound output or a mark display may be used.

  In the embodiment described above, the update of the entire reduced image is determined on the server apparatus 101 side. However, the mobile terminal apparatus 104 compares and determines before and after the update of the frame buffer 600, and if necessary, the mobile terminal apparatus. The entire reduced image may be requested to the server apparatus 101 on the 104 side.

  As described above, the embodiments of the present invention have been described. As a result, in server computing using a client device with a narrow display screen, the communication frequency can be reduced and the power consumption can be reduced. Further, by performing the overall layout display with low power consumption, comfortable operation can be performed even on a narrow screen.

  The embodiment of the present invention described above can be realized by firmware or software on a hardware, a DSP (Digital Signal Processor) board or a CPU board as one function of the server apparatus or the client apparatus.

  The embodiments of the present invention have been described above with reference to the drawings. However, the server device or the client device to which the present invention is applied is limited to the above-described embodiments as long as the function is executed. Needless to say, a single device, a system composed of a plurality of devices, an integrated device, or a system that performs processing via a network such as a LAN or WAN may be used. .

  It can also be realized by a system including a CPU, ROM or RAM memory connected to a bus, an input device, an output device, an external recording device, a medium driving device, and a network connection device. That is, a ROM or RAM memory, an external recording device, or a portable recording medium in which a software program for realizing the system of the above-described embodiment is recorded is supplied to the server device or client device, and the server device or client is supplied. Needless to say, this can also be achieved by the computer of the apparatus reading and executing the program.

  In this case, the program itself read from the portable recording medium or the like realizes the novel function of the present invention, and the portable recording medium or the like on which the program is recorded constitutes the present invention.

  Examples of portable recording media for supplying the program include flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, DVD-RAMs, magnetic tapes, and nonvolatile memory cards. Various recording media recorded via a network connection device (in other words, a communication line) such as a ROM card, electronic mail or personal computer communication can be used.

  The computer (information processing apparatus) executes the program read out on the memory, thereby realizing the functions of the above-described embodiment, and an OS running on the computer based on the instructions of the program. Performs part or all of the actual processing, and the functions of the above-described embodiments are also realized by the processing.

  Furthermore, a program read from a portable recording medium or a program (data) provided by a program (data) provider is stored in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. After being written, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are also realized by the processing. obtain.

  That is, the present invention is not limited to the embodiment described above, and can take various configurations or shapes without departing from the gist of the present invention.

It is a figure which shows the outline of the network structure of server-based computing. It is a figure which shows an example of the breakdown of the power consumption of the mobile terminal device. 2 is a diagram illustrating an appearance of a mobile terminal device 104. FIG. It is a figure which shows the outline of a structure of the mobile terminal device 104 to which this invention is applied. It is a figure which shows the internal structure of LCDC202. 2 is a diagram showing an outline of the configuration of a server device 101. FIG. 3 is a diagram illustrating a frame buffer 500 and an entire reduced image 502 on the server apparatus 101 side. FIG. FIG. 4A is a diagram showing the frame buffer 500 on the server apparatus 101 side, and FIG. 4B is a diagram showing the entire reduced image 502 on the server apparatus 101 side. FIG. 6 is a diagram for explaining states of a frame buffer 600 and an LCD 210 (display unit) of the mobile terminal device 104. 6 is a diagram for explaining the operation of the FBCT 320. FIG. 5 is a flowchart showing a flow of main processing executed in the mobile terminal device 104. It is a flowchart which shows the flow of a scroll process. It is a flowchart which shows the flow of a 1st whole layout production | generation process. It is a flowchart which shows the flow of a 2nd whole layout production | generation process. It is a flowchart which shows the 1st modification of a scroll process. It is a flowchart which shows the 2nd modification of a scroll process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Server apparatus 102 Client terminal apparatus 103 Wireless access point 104 Mobile terminal apparatus 105 Smartphone 109 Network 200 LSI
201 CPU
202 LCD controller (LCDC)
203 Internal memory (RAM)
204 Memory Controller (Mem. Cont.)
204a Internal bus (Bus)
204b Internal bus 205 Real-time counter (RTC)
206 Asynchronous serial communication (UART)
207 Power Management Block (Power Mgmt)
208 USB function (USBF)
209 Wireless communication unit (WiFi)
210 LCD
212 Program storage memory (FROM)
213 Work memory (SDRAM)
301 Bus interface (BUS I / F)
302 Register (Reg.)
303 Memory Controller (Memory Cont.)
303a DMAC (Direct Memory Access Controller)
304 FIFO (first-in first-out memory)
305 Resizer
306 FIFO
307 FIFO
308 Frame drawing device 309 α blend synthesizer 310 FIFO
311 LCD I / F
320 FBCT (frame buffer control table)
321 Effective portion drawing device 322 α blend synthesizer 500 Frame buffer (server device 101 side)
501 VGA size area 502 Whole reduced image 600 Frame buffer (mobile terminal device 104 side)
601 Effective area 602 Display area 603 Data area 604 Overall layout 605 LCD display image 606 Frame 700 Bus 701 CPU
702 Memory 703 Input unit 704 Display unit 705 Storage unit 706 Recording medium drive unit 707 Network connection unit 800 Management table 801 Area 802 Small area 901 Pointer 901a Left click key 901b Right click key 902a Up cursor key 902b Right cursor key 902c Down cursor key 902d Left cursor key 904 Keyboard 905 Shift key 910 Slide bar

Claims (6)

In a server-based computing system configured such that a server device that operates a program based on a service request from a client device and the client device can be connected to each other via a network,
Frame memory storage means for storing a frame memory for display of the client device;
Display screen data receiving means for receiving display screen data from the server device;
Whole layout image receiving means for receiving a whole layout image from the server device;
A discriminating means for discriminating whether the update of the display data by the operation of the screen update is an update of the display data within the range of the frame memory;
Effective range identification information generating means for generating identification information indicating the effective range of the frame memory in the overall layout image based on the determination result of the determination means;
Display means for displaying an entire layout image reflecting identification information indicating the contents of the frame memory and the effective range of the generated frame memory;
A client device comprising:   The client apparatus according to claim 1, wherein the identification information generated by the effective range identification information generation unit is a frame.   The client apparatus according to claim 1, wherein the identification information generated by the effective range identification information generation unit is a shade of an image. In a server-based computing system configured such that a server device that operates a program based on a service request from a client device and the client device can be connected to each other via a network,
Frame memory storage means for storing a frame memory for display of the client device;
Display screen data receiving means for receiving display screen data from the server device;
Whole layout image receiving means for receiving a whole layout image from the server device;
A discriminating means for discriminating whether the update of the display data by the operation of the screen update is an update of the display data within the range of the frame memory;
Message generation means for generating a message for alerting the user when the determination result of the determination means is an update of display data outside the range of the frame memory;
Display means for displaying the contents of the frame memory, the overall layout image and the generated message;
A client device comprising: In a server-based computing system configured such that a server device that operates a program based on a service request from a client device and the client device can be connected to each other via a network,
A computer of the client device;
Display screen data receiving means for receiving display screen data from the server device;
An overall layout image receiving means for receiving an overall layout image from the server device;
A discriminating means for discriminating whether updating of display data by an operation of screen updating is updating of display data within the range of the frame memory;
Effective range identification information generating means for generating identification information indicating the effective range of the frame memory in the overall layout image based on the determination result of the determination means;
Display means for displaying a whole layout image reflecting identification information indicating the contents of the frame memory and the effective range of the generated frame memory;
Program to function as. In a server-based computing system configured such that a server device that operates a program based on a service request from a client device and the client device can be connected to each other via a network,
A computer of the client device;
Display screen data receiving means for receiving display screen data from the server device;
An overall layout image receiving means for receiving an overall layout image from the server device;
A discriminating means for discriminating whether updating of display data by an operation of screen updating is updating of display data within the range of the frame memory;
Message generating means for generating a message for alerting the user when the determination result of the determining means is an update of display data outside the range of the frame memory;
Display means for displaying the contents of the frame memory, the overall layout image and the generated message;
Program to function as.