JP4946667B2 - Server apparatus and program - Google Patents

Description

  According to the present invention, a client device that makes a service request to a server device that operates an application program and a server device that operates an application program based on a service request from the client device can be connected to each other via a network. The present invention relates to a configured server-based computing system.

  2. Description of the Related Art A server-based computing system (thin client system) that transmits a screen of a server device in real time via a network, displays the screen on a remote client device, and operates the server device remotely as the network speed increases. It is spreading. For example, VNC (Virtual Network Computing) that enables a remote machine desktop to be used from a local machine is an example of the server-based computing system.

  A server-based computing system is a system in which a client device (also referred to as a thin client device) and a server device can be connected to each other via a network, and when a client device makes a service request to the server device. The server device operates data management and an application program based on a service request from the client device (see, for example, Patent Document 1).

  The server device creates display data for the client device and sends it to the client device. In the client device, operation information such as a user's key and mouse device is sent to the server device via the network, and the display data for the client device created on the server device side is received and displayed. The client device only needs to include an input device such as a network device, a display device, a mouse device, or a keyboard. Since no data is stored in the client device, storage such as a hard disk is unnecessary, and an application program is executed. Therefore, the processing load required for the client device is light.

FIG. 1 is a diagram illustrating a configuration of a server-based computing system.
As shown in FIG. 1, the server-based computing system sends input information from an input device such as a keyboard and a mouse to the server device 20 from the client device 10, and the server device 20 executes processing based on the input information. Then, the updated screen information (coordinates, size and image) is sent to the client device 10. The client device 10 reflects the screen information on the display device.

FIG. 2 is a diagram for explaining the outline of the server-based computing system.
As shown in FIG. 2, the client device 10 and the server device 20 are connected to each other via a network (communication network) to form a server-based computing system. When the client device 10 performs wireless communication, the client device 10 communicates with the server device 20 via the relay device 30 and the network.

  In such a server-based computing system, for example, when image data is transferred from the server device 20 to the client device 10, the bandwidth that can be used for image transfer is transmitted by transmitting the updated image data with low image quality. Has been disclosed, and the real-time property of screen transfer is improved, and high-quality image data is transmitted again after low-quality image data is transmitted, thereby making image quality degradation inconspicuous ( For example, see Patent Document 2.)

  In such a server-based computing system, when a change occurs in the screen in the server device 20, the difference data before and after the change is extracted from the virtual VRAM, and the difference data is transmitted to the client device 10 as screen data. ing. Normally, the screen data transmission method is as follows:

There are two transmission methods: (1) image transmission (2) command transmission.

  (2) For command transmission, for example, “coordinate”, “width”, “height”, “fill color”, “single color fill transmission”, and “coordinates”, “width”, “height”, “pattern image” are transmitted. "Single pattern fill transmission".

  The former image transmission is a method of transmitting (compressed) image pixel data stored in a virtual VRAM as image information. The latter command transmission transmits only vector data constituting the screen, and pixel data. Deployment to the client device 10 is a method that is left to the client device 10 side.

  In the former image transmission, there is a disadvantage that the data amount becomes large but it does not depend on the client device 10. In the latter command transmission, the data amount can be reduced, but depends on the client device 10. It has the feature that it ends up.

  In the server-based computing system, since the reduction of the data amount affects the performance, how to efficiently implement the latter command transmission command is an important issue.

  Here, when considering transmission (screen transfer) of the screen information to be displayed on the client device 10 from the server device 20, the concept of the drawing process inside the server device 20 is important. The drawing destination of screen drawing in the server device 20 is roughly divided into two memory areas: (1) an on-screen (OnScreen) memory and (2) an off-screen (OffScreen) memory. The former on-screen memory is a memory area for displaying in response to changes in the screen, and the latter off-screen memory is a temporary memory area that is saved to reuse the screen once drawn. Is not reflected. For example, the screen “File (F)” in the menu bar of the Windows system is used many times and is not reflected on the screen.

FIG. 3 is a diagram for explaining the relationship between the off-screen memory 211 and the on-screen memory 212.
The service requested from the client apparatus 10 is composed of various commands. These various commands are mainly stored in the display command for the off-screen memory 211, the display command for the on-screen memory 212, and the off-screen memory 211. The image data can be classified into three types: a copy command for copying the image data to the on-screen memory 212.

  As shown in FIG. 3, in order to reflect the image data stored in the off-screen memory 211 on the screen of the client device 20, the contents of the off-screen memory 211 are copied to the on-screen memory 212. Is done. The copied image data is a transmission target to the client device 10.

JP 2005-228227 A JP 2006-246153 A

FIG. 4 is a diagram for explaining a conventional problem.
In the case of the conventional server-based computing system as described above, as shown in FIG. 4, when copying the contents of the off-screen memory 211 to the on-screen memory 212, the execution results of a plurality of commands are merged as image data. For this reason, transmission to the client device 10 can only be performed by transmitting the image as it is or after compression, and the amount of data tends to increase. As a result, there is a problem that performance tends to deteriorate.

  The present invention has been made in view of the above problems, and can reduce the amount of screen data to be transmitted from the server device 20 to the client device 10 to increase the screen data transmission speed. An object is to provide a base computing system.

The present invention employs the following configuration in order to solve the above problems.
That is, according to one aspect of the present invention, the server device of the present invention is a server device that transmits screen information corresponding to the service request to the client device based on a service request from the client device via a network. A screen information temporary storage means for temporarily storing a command execution image generated by execution of a command constituting the service request; and a command constituting the service request for display on the client device. Screen information storage means for storing a command execution image generated by executing the command, and command log means for creating a command table for storing the command in association with the command execution image when temporarily storing the command execution image; , The command execution image stored in the screen information temporary storage means is stored in the screen information. And a transmission unit that refers to a command table created by the command log unit and transmits the corresponding command to the client device when copying to the information storage unit.

  In the server device of the present invention, it is preferable that the command table created by the command log unit includes information relating to the command and information relating the command to each area.

  The server device of the present invention further refers to the command table created by the command log means when copying the command execution image stored in the screen information temporary storage means to the screen information storage means, When the command execution image is included in the area drawn by the command, it is preferable to include command changing means for changing the command so that the area drawn by the command becomes the area drawing the command execution image.

  According to another aspect of the present invention, the program of the present invention is a server device computer that transmits screen information corresponding to the service request to the client device based on a service request from the client device via a network. Screen information temporary storage means for temporarily storing each command execution image generated when each command constituting the service request is executed, and a command constituting the service request for displaying on the client device Screen information storage means for storing a command execution image generated by execution of the command, command log means for creating a command table for storing the command in association with the command execution image when temporarily stored, The command execution image stored in the screen information temporary storage means is displayed on the screen. When copying the broadcast storing means, the command log means by referring to the command table created by a program for causing a relevant said command as a transmission means for transmitting to the client device.

  According to the present invention, the screen data to be transmitted from the server device 20 to the client device 10 is transmitted as command data instead of image data, so that the data amount is reduced and the screen data transmission speed can be increased.

  Further, according to the present invention, conventionally, when data in the off-screen memory 211 is copied to the on-screen memory 212, it can only be copied as image data. Since the data is stored in the log, the data in the off-screen memory 211 can be copied to the on-screen memory 212 with the command.

  Further, according to the present invention, when copying the data of the off-screen memory 211 to the on-screen memory 212, the type of the command is determined and the data of the off-screen memory 211 is copied to the on-screen memory 212 as image data. Therefore, an optimal transmission method can be selected depending on the type of command.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
First, an outline of an embodiment of the present invention will be described.
The server device 20 to which the present invention is applied is a server device 20 that transmits screen information corresponding to the service request to the client device 10 based on a service request from the client device 10 via a network. Then, it is possible to transmit both image data, and in some cases, compressed image data and command data reproducible on the client device 10 side to the client device 10, and drawing executed on the off-screen memory 211. A command log is managed, and when data in the off-screen memory 211 is reflected in the on-screen memory 212, the command log is transmitted to the client device 10 as a command.

  In addition, the information of the off-screen memory 211 and the command information are stored as a list, and when copying from the off-screen memory 211 to the on-screen memory 212 occurs, the corresponding command list is transmitted to the client device 10 to thereby increase the data amount. To reduce.

FIG. 5 is a diagram illustrating an outline of a hardware configuration of the client device 10.
In FIG. 5, a client device 10 includes a CPU (Central Processing Unit) 302, an input device 303 for inputting various data and signals, a display device 304 for displaying images and other information, In addition to a program for executing processing executed in the client device 10, an image to be displayed on the ROM 305, RAM 306, and display device 304 in which a control program for controlling and executing each function of the client device 10 is temporarily stored. A frame buffer RAM 307 for storing, a communication I / F 308 for connecting to a network such as a wireless LAN or a cellular phone network, an external storage device 309 for recording various information including image data and communication data, and an auxiliary storage device 310 are provided. It is configured to be connected to the bus 301, and the CPU 302 Are your.

FIG. 6 is a diagram illustrating an outline of a hardware configuration of the server device 20.
In FIG. 6, the server device 20 executes processing executed by the CPU 202, the input device 203 for inputting various data and signals, the display device 204 for displaying images and other information, and the server device 20. In addition to the program, a ROM 205 and RAM 206 storing control programs and table data for controlling and executing each function of the server device 20, a VRAM 207 for temporarily storing an image to be displayed on the display device 204, a LAN, and the like Each command that constitutes a service request from the external storage device 209, auxiliary storage device 210, and client device 10 for recording various information including communication I / F 208, image data, communication data, etc. Each command execution image generated by the execution is temporarily stored. Off-screen memory 211, and on-screen memory 212 for storing each command execution image generated by executing each command constituting a service request from the client device 10 for display on the display device 304 of the client device 10. Are connected to the bus 201, and the CPU 202 controls these units.

FIG. 7 is a diagram for explaining the command log.
In FIG. 7, the command log is a command related to drawing among commands composing a service request from the client device 10, and each command is linked by front and back pointers for each screen area as shown in FIG. It is stored in the form. Then, it is directly stored as a command in a transmission queue for transmission to the client device 10.

Next, the present invention will be described more specifically. The present invention is realized as a server process executed in the server device 20.
As described above, the screen drawing inside the server device 20 is roughly divided into drawing on the on-screen memory 212 in a visible form and drawing on the off-screen memory 211 in an invisible form.

  The latter off-screen memory 211 exists to reuse the screen once created. At this time, as described above with reference to FIGS. 3 and 4, the memory area of the off-screen memory 211 is on-screen. This is realized by simply copying (copying) the memory area of the memory 212. That is, the copy source (hereinafter referred to as “SRC” (abbreviation of Source)) is the off-screen memory 211, and the copy destination (hereinafter referred to as “DST” (abbreviation of Destination)) is the on-screen memory 212. In this case, the reused off-screen memory 211 is reflected on the screen. In this case, if the drawing log to the off-screen memory 211 managed as shown in FIG. 7 can be transmitted to the client device 10 side, the command remains as a command without losing the command information as shown in FIG. It is possible to transmit to the client device 10 with a small amount of data.

The point of the present invention here is that
(1) How to manage drawing commands to off-screen memory 211 (2) How to extract drawing commands to be copied when copied to on-screen memory 212

There are two points.
Next, the two points of the present invention will be described in order.
FIG. 8 is a diagram showing a drawing memory array of the off-screen memory 211 or the on-screen memory 212.

  Usually, the memory for holding the screen of the computer is formed by integrating the memory area of the off-screen memory 211 and the memory area of the on-screen memory 212, and the screen number and the off-screen memory 211 or the on-screen memory. 212. For example, the flag indicating the off-screen memory 211 is “0” and the flag indicating the on-screen memory 212 is “1”.

First, “(1) How to manage drawing commands to the off-screen memory 211” will be described with reference to FIG.
FIG. 9 is a flowchart showing the flow of server processing executed in the server device 20.

  When a drawing command is received in step S901, a search for region information is executed using the region number in step S902. As shown in FIG. 3, the drawing command is executed on either the off-screen memory 211 or the on-screen memory 212. In this case, the area number shown in FIG. 8 is always passed. .

Next, in step S903, it is determined whether or not the flag value is a flag “1” indicating the on-screen memory 212.
When the data structure is searched from the area number and it is determined that the flag is “1” (step S903: YES), that is, in the case of drawing in the memory area of the on-screen memory 212, Since the change is visible, the screen data is transmitted to the client device 10 as it is in step S904. On the other hand, if it is determined that the flag is “0” (step S903: NO), that is, in the case of drawing in the memory area of the off-screen memory 211, a subroutine “off-screen command” described later with reference to FIG. The command log is managed as in “Management process”.

  When the drawing command is for the off-screen memory 211, it is necessary to manage the command log. Here, the data stored in the off-screen memory 211 is reflected in the on-screen memory 212 when the SRC of the copy command is the off-screen memory 211 and the DST is the on-screen memory 212. In this case, since the “area number”, “X coordinate”, “Y coordinate”, “width”, and “height” of each of the SRC and DST are passed for the copy command, these information and command-specific information (for example, the above-described information) In the case of “single color fill transmission”, “fill color” is equivalent to this).

  Next, “(2) How to extract a drawing command to be copied when copying to the on-screen memory 212” will be described with reference to FIGS. When SRC is the off-screen memory 211 and DST is the on-screen memory 212, what is written in the off-screen memory 211 becomes a trigger reflected in the on-screen memory 212. At this time, since the area number, X coordinate, Y coordinate, width, and height are passed, a command log of the off-screen memory 211 is created based on these information, and necessary commands are created based on the created command log. It transmits to the client device 10.

FIG. 10 is a flowchart showing a flow of a subroutine “off-screen command management process”, and FIG. 11 is a diagram for explaining command log extraction.
First, in step S1001 of FIG. 10, a copy command (copy command) is received.

  As shown in FIG. 11, the data structure of the command log is managed by two data structures of (a) an area number management array and (b) a command list holding list. The address of the top list of the list holding list and the same area number as the area number shown in FIG. 8 are held.

  Then, in step S1002 in FIG. 10, the array of the off-screen memory 211 serving as the SRC is searched from (a) in FIG. 11 based on the area number passed to the copy drawing function.

Next, in step S1003 in FIG. 10, the head address in FIG.
(A) in FIG. 11 shows the data structure of the bidirectional link list, and each list is held in the list in the order of command execution. Each list holds the addresses of the previous list and the next list. When there is no corresponding item, it points to a NULL pointer. Each list holds the necessary lists (X coordinate, Y coordinate, width, height, command information) described above. Thus, when a copy command is issued from the off-screen memory 211 to the on-screen memory 212, it is possible to hold necessary information as to which command should be copied.

  Next, in step S1004 of FIG. 10, it is determined whether or not the end of the list has been reached. When the end is reached (step S1004: YES), this subroutine “off-screen command management process” is terminated.

  If the end of the list has not been reached (step S1004: NO), in step S1005, a command list to be transmitted is searched from the SRC area (X coordinate, Y coordinate, width, height), and no area is included. If so, move on to the next list.

  Then, in step S1006, it is determined whether or not the region is completely included. If not completely included (step S1006: NO), that is, if only a part is included, in step S1007, FIG. By executing a sub-routine “off-screen command management process” which will be described later, only the corresponding area is cut out and transmitted to the client apparatus 10 in step S1008.

On the other hand, if the area is completely included (step S1006: YES), the list is transmitted to the client device 10 as it is in step S1008.
In step S1009, the process moves to the next list, and step S1004 and subsequent steps are repeated until the end of the list is reached (YES in step S1004).

  As described above, the subroutine “off-screen command management process” transmits command information to the client device 10 in the case of a drawing command supported by the server-based computing system, based on the information passed from the off-screen memory 211. If it is not supported, the image data itself is cut out from the virtual VRAM of the off-screen memory 211, and the image data is compressed and transmitted to the client device 10 to complete a series of processing.

  FIG. 12 is a diagram for explaining the subroutine “included region extraction process”, and FIG. 13 is a flowchart showing the flow of the subroutine “included region extraction process”.

  First, in step S1301, it is determined whether or not “sx”, which is the X coordinate of the copy area, is larger than “lx”, which is the X coordinate of the list area. If it is determined that it is larger (step S1301: YES), step If “sx”, which is the X coordinate of the copy area, is substituted into the variable “mx” in S1302 and is determined not to be large (NO in Step S1301), the X coordinate of the list area is set in the variable “mx” in Step S1303. “Lx” is substituted.

  Next, in step S1304, it is determined whether or not “sy” that is the Y coordinate of the copy area is larger than “ly” that is the Y coordinate of the list area. If it is determined that it is larger (YES in step S1304), If it is determined in step S1305 that “y”, which is the Y coordinate of the copy area, is substituted for the variable “my” and is not large (step S1304: NO), the variable “my” in the list area is set in step S1306. “Ly” which is a coordinate is substituted.

  In step S 1307, the sum (lx + lw) of “lx” that is the X coordinate of the list area and “lw” that is the width of the list area is “sx” that is the X coordinate of the copy area and the width of the copy area. It is determined whether or not it is smaller than the sum (sx + sw) with a certain “sw”. If it is determined that it is small (step S1307: YES), in step S1308, from the sum (lx + lw) of “lx” that is the X coordinate of the list area and “lw” that is the width of the list area, in step S1302. The value of the variable “mx” to which “sx” that is the X coordinate of the copy area is substituted or “lx” that is the X coordinate of the list area in step S1303 is subtracted and substituted into the variable “mw”. On the other hand, if it is determined in step S1307 that it is not small (step S1307: NO), in step S1309, from the sum (sx + sw) of “sx” that is the X coordinate of the copy area and “sw” that is the width of the copy area. In step S1302, the value “sx” that is the X coordinate of the copy area is substituted, or the value of the variable “mx” that is assigned “lx” that is the X coordinate of the list area in step S1303 is subtracted, and the variable “mw” is subtracted. Assign to.

  In step S1310, the sum (ly + lh) of “ly” that is the Y coordinate of the list area and “lh” that is the height of the list area is “y” that is the Y coordinate of the copy area and the height of the copy area. It is determined whether or not the sum is smaller than the sum (sy + sh) of “sh”. If it is determined that it is small (step S1310: YES), in step S1311, the sum (ly + lh) of “ly” that is the Y coordinate of the list area and “lh” that is the height of the list area is determined in step S1305. In step S1306, the value of the variable “my” into which the Y coordinate of the copy area or “ly” in the list area is substituted is subtracted and substituted into the variable “mh”. . On the other hand, if it is determined in step S1310 that it is not small (step S1310: NO), in step S1312, the sum of “y” that is the Y coordinate of the copy area and “sh” that is the height of the copy area (sy + sh). In step S1305, the value of the variable “my” substituted with “sy” that is the Y coordinate of the copy area or “ly” that is the Y coordinate of the list area in step S1306 is subtracted. Is substituted.

  In step S1313, the x coordinate of the rectangular area of the command is changed to the value of the variable mx substituted in step S1302 or step S1303, and the y coordinate of the rectangular area of the command is substituted in step S1305 or step S1306. The value is changed to the value of the variable my, the width of the rectangular area of the command is changed to the value of the variable mw assigned in step S1308 or step S1309, and the height of the rectangular area of the command is assigned in step S1311 or step S1312. Change to the value of the variable mh.

  As described above, since the drawing command executed on the off-screen memory 211 is managed as a command log, semantic (semantic) information accompanying the command is not lost. Thereby, since a command can be transmitted to the client apparatus 10 as a command, there is an effect of reducing the amount of data, leading to an improvement in performance.

  As described above, the embodiments of the present invention have been described with reference to the drawings. However, in the above-described embodiments of the present invention, a hardware, a DSP (Digital Signal Processor) board or a CPU board is used as one function of the server device. It can be realized by firmware or software.

  Further, the server device to which the present invention is applied is not limited to the above-described embodiment as long as the function is executed, and even a single device or a system composed of a plurality of devices is integrated. Needless to say, the apparatus may be a system that performs processing via a network such as a LAN or a WAN.

  It can also be realized by a system including a CPU, a ROM or RAM memory connected to a bus, an input device, an output device, an external recording device, a medium driving device, and a network connection device. That is, the ROM, RAM memory, external recording device, and portable recording medium in which the software program for realizing the system of the above-described embodiment is recorded are supplied to the server device, and the computer of the server device reads the program. Needless to say, it can also be achieved through implementation.

  In this case, the program itself read from the portable recording medium or the like realizes the novel function of the present invention, and the portable recording medium or the like on which the program is recorded constitutes the present invention.

  Examples of portable recording media for supplying the program include flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, DVD-RAMs, magnetic tapes, and nonvolatile memory cards. Various recording media recorded via a network connection device (in other words, a communication line) such as a ROM card, electronic mail or personal computer communication can be used.

  The computer (information processing apparatus) executes the program read out on the memory, thereby realizing the functions of the above-described embodiment, and an OS running on the computer based on the instructions of the program. Performs part or all of the actual processing, and the functions of the above-described embodiments are also realized by the processing.

  Furthermore, a program read from a portable recording medium or a program (data) provided by a program (data) provider is stored in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. After being written, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are also realized by the processing. obtain.

  That is, the present invention is not limited to the embodiment described above, and can take various configurations or shapes without departing from the gist of the present invention.

It is a figure which shows the structure of a server base computing system. It is a figure for demonstrating the outline | summary of a server base computing system. 4 is a diagram for explaining a relationship between an off-screen memory 211 and an on-screen memory 212. FIG. It is a figure for demonstrating the conventional problem. 2 is a diagram showing an outline of a hardware configuration of a client device 10. FIG. 2 is a diagram illustrating an outline of a hardware configuration of a server device 20. FIG. It is a figure for demonstrating a command log. FIG. 3 is a diagram showing a drawing memory array of an off-screen memory 211 or an on-screen memory 212. 4 is a flowchart showing a flow of server processing executed in the server device 20. It is a flowchart which shows the flow of a subroutine "off-screen command management process." It is a figure for demonstrating extraction of a command log. It is a figure for demonstrating a subroutine "extraction process of the area | region included." It is a flowchart which shows the flow of subroutine "Extraction process of the area | region included."

Explanation of symbols

10 Client device 20 Server device 30 Relay device 201 Bus 202 CPU
203 Input device 204 Display device 205 ROM
206 RAM
207 Frame buffer RAM
208 Communication I / F
209 External storage device 210 Auxiliary storage device 211 Off-screen memory 212 On-screen memory 301 Bus 302 CPU
303 Input device 304 Display device 305 ROM
306 RAM
307 Frame buffer RAM
308 Communication I / F
309 External storage device 310 Auxiliary storage device

Claims (4)

Based on a service request from a client device via a network, the server device transmits screen information corresponding to the service request to the client device,
Screen information temporary storage means for temporarily storing a command execution image generated by execution of a command constituting the service request;
Screen information storage means for storing a command execution image generated by execution of a command constituting the service request for display on the client device;
Command log means for creating a command table for associating and storing the command when temporarily storing the command execution image;
When copying the command execution image stored in the screen information temporary storage means to the screen information storage means, the command table created by the command log means is referred to and the corresponding command is transmitted to the client device. A transmission means;
A server device comprising:   2. The server apparatus according to claim 1, wherein the command table created by the command log means includes information relating to the command and information associating the command with each area. further,
An area in which the command execution image is drawn by the command with reference to the command table created by the command log means when copying the command execution image stored in the screen information temporary storage means to the screen information storage means A command changing means for changing the command so that an area to be drawn by the command becomes an area to draw the command execution image,
The server device according to claim 1, comprising: a server device according to claim 1. Based on a service request from a client device via a network, a computer of a server device that transmits screen information corresponding to the service request to the client device.
Screen information temporary storage means for temporarily storing each command execution image generated by execution of each command constituting the service request;
Screen information storage means for storing a command execution image generated by execution of a command constituting the service request for display on the client device;
Command log means for creating a command table for storing the commands in association with each other when temporarily storing the command execution image;
When copying the command execution image stored in the screen information temporary storage means to the screen information storage means, the command table created by the command log means is referred to and the corresponding command is transmitted to the client device. Transmission means,
Program to function as.